ZurichNLP #9
[about]
We’re happy to announce ZurichNLP #9 on April 25th with the following speakers:
Lewis Tunstall (MLE @ HuggingFace) on How to Align Your LLM
Vilém Zouhar (PhD @ ETH Zurich) on Pride and BPE: How We Solved Tokenization but Got It Wrong
“Tokenization is present in almost all NLP pipelines, but rarely examined mathematically. We formalize and show boundaries to the most popular tokenization algorithm, Byte-Pair Encoding. Then, with information theory, we show what makes some tokenization better than others and how to use this as a metric before training your expensive models. Lastly, we admit how we got this hypothesis wrong.”
Slides from Lewis’s presentation can be found here!
RSVP soon as spots are limited.
[speakers]
Lewis Tunstall
Hugging Face
Vilém Zouhar
ETH Zurich
[details]
- time
- 25 apr 2024 18:00
- location
- ETH AI Center
- address
- Andreasstrasse 5, OAT, 14th floor, 8050, Zürich
- format
- talk
- status
- finished
- tags
- access
- OAT building.