zurich.tech

[about]

We’re happy to announce ZurichNLP #9 on April 25th with the following speakers:

  • Lewis Tunstall (MLE @ HuggingFace) on How to Align Your LLM

  • Vilém Zouhar (PhD @ ETH Zurich) on Pride and BPE: How We Solved Tokenization but Got It Wrong

    “Tokenization is present in almost all NLP pipelines, but rarely examined mathematically. We formalize and show boundaries to the most popular tokenization algorithm, Byte-Pair Encoding. Then, with information theory, we show what makes some tokenization better than others and how to use this as a metric before training your expensive models. Lastly, we admit how we got this hypothesis wrong.”

Slides from Lewis’s presentation can be found here!

RSVP soon as spots are limited.

[speakers]

Lewis Tunstall

Hugging Face

Vilém Zouhar

ETH Zurich

[details]

time
25 apr 2024 18:00
location
ETH AI Center
address
Andreasstrasse 5, OAT, 14th floor, 8050, Zürich
format
talk
status
finished
tags
#past#language-models#nlp#tokenization#zurichnlp
access
OAT building.

[photos]

5