Interesting Papers

The Deepseek Series

Better, faster, and more efficient approaches to language modeling:

• Mixture of Experts
• GRPO reinforcement learning for reasoning
• Deepseek R1
• Multi-Head Latent Attention, applying principles from CNNs to LLMs to reduce memory usage