ENG ҚАЗ

Tags

LLM(4)

Paper Review 6: Mixtral of Experts January 30, 2024

Paper Review 5: Mistral 7B January 26, 2024

Paper Review 4: Self-attention Does Not Need O(n^2) Memory January 22, 2024

Paper Review 1: LLaMA - Open and Efficient Foundation Language Models January 22, 2024

Multimodality(2)

Paper Review 3: Pix2Struct is an image-encoder-text-decoder based on the Vision Transformer (ViT) January 22, 2024

Paper Review 2: MATCHA : Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering January 22, 2024

basis(1)

Paper Review 8: SGDR: SGD with warm restarts(+ theory behind the Grad descent algorithm) July 27, 2026

charts and graphs(1)

Paper Review 2: MATCHA : Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering January 22, 2024

efficiency(2)

Paper Review 7: FlashAttention - Fast and Memory-Efficient Exact Attention with IO-Awareness February 6, 2024

Paper Review 4: Self-attention Does Not Need O(n^2) Memory January 22, 2024

image2text(2)

Paper Review 3: Pix2Struct is an image-encoder-text-decoder based on the Vision Transformer (ViT) January 22, 2024

Paper Review 2: MATCHA : Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering January 22, 2024

long input transformers(4)

Paper Review 7: FlashAttention - Fast and Memory-Efficient Exact Attention with IO-Awareness February 6, 2024

Paper Review 6: Mixtral of Experts January 30, 2024

Paper Review 5: Mistral 7B January 26, 2024

Paper Review 4: Self-attention Does Not Need O(n^2) Memory January 22, 2024