
Nature describes byteification, which converts language models to bytes
Researchers proposed converting ready-made language models to work with UTF-8 bytes. This takes less than 1% of a typical pretraining budget, and the quality of the byte versions is close…
Read the news








