All languages are NOT created (tokenized) equal.
Language models cost much more in some languages than others
Read in full here:
https://blog.yenniejun.com/p/all-languages-are-not-created-tokenized
This thread was posted by one of our members via one of our news source trackers.