like "can you please" maps to 3895 instead of something like "10 245 87 941"
Or does it not matter since tokenization is already a kind of compression?
like "can you please" maps to 3895 instead of something like "10 245 87 941"
Or does it not matter since tokenization is already a kind of compression?