Beksultan's blog

use Pix2Struct as the base model and further pretrain it with chart derendering and math reasoning tasks. [Read More]

LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. They have been trained on trillions of tokens. Also, it shows that it is possible to train state-of-the-art models using exclusively publicly available datasets, without resorting to proprietary and inaccessible datasets. Large transformers were trained on... [Read More]

This is a demo post to show you how to write blog posts with markdown. I strongly encourage you to take 5 minutes to learn how to write in markdown - it’ll teach you how to transform regular text into bold/italics/tables/etc.I also encourage you to look at the code that... [Read More]