LLM 关键节点论文 · 深度解读总览

133 个关键节点 · 按优先级分批深度解读（六层结构：问题定位→概念内核→方法拆解→证据链→批判→启示）· 点击标题进入 HTML 解读版

B1_P3 P3 · 必读核心 · 38 篇已完成

  1. Attention Is All You Need2017-06 · Google Brain/Research · E1
  2. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018-10 · Google · E1
  3. Learning Transferable Visual Models From Natural Language Supervision2021-02 · OpenAI · E2
  4. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models2022-01 · Google · E2
  5. Training Compute-Optimal Large Language Models2022-03 · DeepMind · E2
  6. Constitutional AI: Harmlessness from AI Feedback2022-12 · Anthropic · E3
  7. Direct Preference Optimization: Your Language Model is Secretly a Reward Model2023-05 · Stanford · E3
  8. DeepSeek-OCR: Contexts Optical Compression2025-10 · DeepSeek-AI · E5
  9. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning2025-01 · DeepSeek-AI · E5
  10. DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model2024-05 · DeepSeek-AI · E4
  11. DeepSeek-V3 Technical Report2024-12 · DeepSeek-AI · E4
  12. DeepSeek-V4 Technical Report (Pro/Flash)2026-04 · DeepSeek-AI · E5
  13. Finetuned Language Models Are Zero-Shot Learners2021-09 · Google · E2
  14. FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness2022-05 · Stanford/UC Berkeley等 · E2
  15. GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models2025-08 · Z.ai/智谱 · E5
  16. GLM-5: from Vibe Coding to Agentic Engineering2026-02 · Z.ai/智谱 · E5
  17. Language Models are Few-Shot Learners2020-05 · OpenAI · E2
  18. GPT-4 Technical Report2023-03 · OpenAI · E3
  19. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models2024-02 · DeepSeek-AI · E4
  20. Training language models to follow instructions with human feedback2022-03 · OpenAI · E2
  21. Scaling Laws for Neural Language Models2020-01 · OpenAI · E2
  22. Kimi K2: Open Agentic Intelligence2025-07 · Moonshot AI · E5
  23. Kimi K3: Open Frontier Intelligence2026-07 · Moonshot AI · E5
  24. LLaMA: Open and Efficient Foundation Language Models2023-02 · Meta · E3
  25. Llama 2: Open Foundation and Fine-Tuned Chat Models2023-07 · Meta · E3
  26. The Llama 3 Herd of Models2024-07 · Meta · E4
  27. LoRA: Low-Rank Adaptation of Large Language Models2021-06 · Microsoft · E2
  28. Mamba: Linear-Time Sequence Modeling with Selective State Spaces2023-12 · CMU/Princeton · E4
  29. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks2020-05 · Meta AI · E2
  30. ReAct: Synergizing Reasoning and Acting in Language Models2022-10 · Google Brain+Princeton · E3
  31. RoFormer: Enhanced Transformer with Rotary Position Embedding2021-04 · 追一科技 · E2
  32. Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters2024-08 · OpenAI/UMD · E4
  33. Self-Instruct: Aligning Language Models with Self-Generated Instructions2022-12 · UW/Microsoft · E3
  34. Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2021-01 · Google · E2
  35. Thinking with Visual Primitives2026-04 · DeepSeek-AI+北大+清华 · E5
  36. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale2020-10 · Google Brain · E2
  37. Learning to Reason with LLMs (OpenAI o1)2024-09 · OpenAI · E4
  38. Efficient Memory Management for Large Language Model Serving with PagedAttention2023-09 · UC Berkeley · E4

B2_P2 P2 · 重要 · 81 篇已完成

  1. Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation2021-08 · MosaicML · E2
  2. AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration2023-06 · MIT韩松组 · E3
  3. Stanford Alpaca: An Instruction-following LLaMA Model2023-03 · Stanford · E3
  4. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models2023-01 · Salesforce · E3
  5. System Card: Claude Opus 4.52025-11 · Anthropic · E5
  6. Teaching Small Language Models to Reason2022-12 · Google · E3
  7. DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence2024-06 · DeepSeek-AI · E4
  8. DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models (DSA)2025-12 · DeepSeek-AI · E5
  9. DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models2024-01 · DeepSeek-AI · E4
  10. DeepSeek LLM: Scaling Open-Source Language Models with Longtermism2024-01 · DeepSeek-AI · E4
  11. ZeRO: Memory Optimizations Toward Training Trillion Parameter Models2019-10 · Microsoft · E1
  12. EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty2024-01 · 中科大+微软 · E4
  13. Deep Contextualized Word Representations2018-02 · AI2 · E1
  14. Are Emergent Abilities of Large Language Models a Mirage?2023-04 · Stanford · E3
  15. The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale2024-06 · HuggingFace · E4
  16. Flamingo: a Visual Language Model for Few-Shot Learning2022-04 · DeepMind · E2
  17. FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning2023-07 · Princeton/Together AI · E3
  18. FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision2024-07 · Together AI/Princeton等 · E4
  19. Forge: Scalable Agent RL Framework and CISPO2026-02 · MiniMax · E5
  20. GLM-130B: An Open Bilingual Pre-trained Model2022-10 · 清华KEG×智谱AI · E3
  21. GLM-5.2: Built for Long-Horizon Tasks2026-06 · 智谱Z.ai · E5
  22. GLM-5.3：Frontier Foundation Model（文本旗舰）2026-08 · 智谱Z.ai · E5
  23. GLM-5.3-Flash（ox-alpha/牛来，原生多模态低延迟版）2026-08 · 智谱Z.ai · E5
  24. Improving Language Understanding by Generative Pre-Training2018-06 · OpenAI · E1
  25. Language Models are Unsupervised Multitask Learners2019-02 · OpenAI · E1
  26. GPT-5 System Card2025-08 · OpenAI · E5
  27. GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers2022-10 · IST Austria+HF · E3
  28. GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints2023-05 · Google Research · E3
  29. Gated Linear Attention Transformers with Hardware-Efficient Training2023-12 · UIUC等 · E4
  30. Gemini 2.5 Technical Report2025-06 · Google DeepMind · E5
  31. Gemini: A Family of Highly Capable Multimodal Models2023-12 · Google DeepMind · E4
  32. Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets2022-01 · OpenAI · E2
  33. H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models2023-06 · 斯坦福 · E3
  34. HunyuanImage 3.0: Unified Multimodal Understanding and Generation2025-09 · 腾讯混元 · E5
  35. Jamba: A Hybrid Transformer-Mamba Language Model2024-03 · AI21 Labs · E4
  36. Kimi K2.5: Visual Agentic Intelligence2026-02 · Moonshot AI · E5
  37. Kimi K2 Thinking（技术博客/模型发布）2025-11 · Moonshot AI · E5
  38. Kimi Linear: An Expressive, Efficient Attention Architecture2025-10 · Moonshot AI · E5
  39. Kimi k1.5: Scaling Reinforcement Learning with LLMs2025-01 · Moonshot AI · E5
  40. LIMA: Less Is More for Alignment2023-05 · Meta · E3
  41. Visual Instruction Tuning2023-04 · UW/Microsoft/Wisconsin · E3
  42. The Llama 4 Herd (Scout/Maverick)2025-04 · Meta · E5
  43. LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models2023-09 · 上海交大等 · E4
  44. LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens2024-02 · 微软亚洲 · E4
  45. Fast Transformer Decoding: One Write-Head is All You Need2019-11 · Google · E1
  46. Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality2024-05 · Princeton/CMU · E4
  47. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism2019-09 · NVIDIA · E1
  48. MiniMax-01: Scaling Foundation Models with Lightning Attention2025-01 · MiniMax · E5
  49. MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention2025-06 · MiniMax · E5
  50. The MiniMax-M2 Series Technical Report2026-05 · MiniMax · E5
  51. Mixtral of Experts2024-01 · Mistral AI · E4
  52. MoBA: Mixture of Block Attention for Long-Context LLMs2025-02 · Moonshot AI+清华 · E5
  53. Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention2025-02 · DeepSeek-AI+北大/UW · E5
  54. PaLM: Scaling Language Modeling with Pathways2022-04 · Google · E2
  55. Extending Context Window of Large Language Models via Positional Interpolation2023-06 · Meta · E3
  56. Qwen2 Technical Report2024-07 · 阿里云通义千问 · E4
  57. Qwen2.5 Technical Report2024-12 · 阿里云通义千问 · E4
  58. Qwen3 Technical Report2025-05 · 阿里通义 · E5
  59. Qwen3.5: Towards Native Multimodal Agents2026-02 · 阿里通义 · E5
  60. Qwen3.5-Omni Technical Report2026-04 · 阿里通义 · E5
  61. Qwen3.8-Max: A New Bar for Coding and Cowork2026-08 · 阿里通义 · E5
  62. Qwen Technical Report2023-09 · 阿里云通义千问 · E4
  63. REALM: Retrieval-Augmented Language Model Pre-Training2020-02 · Google · E2
  64. Reflexion: Language Agents with Verbal Reinforcement Learning2023-03 · Northeastern+MIT · E3
  65. Scaling Laws for Precision2024-11 · Harvard/MIT/Stanford/Databricks · E4
  66. Seed-OSS-36B Open Source Models2025-08 · 字节跳动Seed · E5
  67. Seed1.8 Model Card2026-03 · 字节跳动Seed · E5
  68. Seed 2.0 Model Card2026-06 · 字节跳动Seed · E5
  69. Self-Consistency Improves Chain of Thought Reasoning in Language Models2022-03 · Google · E2
  70. Self-Refine: Iterative Refinement with Self-Feedback2023-03 · CMU+AI2 · E3
  71. Generating Long Sequences with Sparse Transformers2019-04 · OpenAI · E1
  72. Fast Inference from Transformers via Speculative Decoding2022-11 · Google Research · E2
  73. Efficient Streaming Language Models with Attention Sinks2023-09 · MIT · E4
  74. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019-10 · Google · E1
  75. Toolformer: Language Models Can Teach Themselves to Use Tools2023-02 · Meta AI · E3
  76. Tree of Thoughts: Deliberate Problem Solving with Large Language Models2023-05 · Princeton+DeepMind · E3
  77. Tülu 3: Pushing Frontiers in Open Language Model Post-Training2024-11 · AI2 · E4
  78. UI-TARS: Pioneering Automated GUI Interaction with Native Agents2025-01 · 字节跳动Seed · E5
  79. Voyager: An Open-Ended Embodied Agent with Large Language Models2023-05 · NVIDIA+Caltech等 · E3
  80. YaRN: Efficient Context Window Extension of Large Language Models2023-09 · Nous Research等 · E4
  81. s1: Simple test-time scaling2025-01 · Stanford+UW+AI2 · E5

B3_P1 P1 · 基础补充 · 14 篇已完成

  1. ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools2024-06 · 智谱AI×清华 · E4
  2. DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding2024-12 · DeepSeek-AI · E4
  3. GLM-5.1（迭代版，无独立技术报告）2026-04 · 智谱Z.ai · E5
  4. GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding2020-06 · Google · E2
  5. IndexShare: Sharing the Indexer of Sparse Attention2026-03 · 智谱 · E5
  6. InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks2023-12 · 上海AI实验室等 · E4
  7. KTO: Model Alignment as Prospect Theoretic Optimization2024-02 · ContextualAI/MIT · E4
  8. Towards Reasoning Era: A Survey of Long Chain-of-Thought2025-03 · 哈工大/中南/HKU/复旦 · E5
  9. NTK-aware Scaled RoPE（社区方案）2023-07 · r/LocalLLaMA社区 · E3
  10. QwQ-32B: Embracing the Power of Reinforcement Learning2025-03 · 阿里Qwen团队 · E5
  11. Qwen2.5-VL Technical Report2025-02 · 阿里Qwen团队 · E5
  12. Qwen3.6 (35B-A3B)2026-04 · 阿里通义 · E5
  13. WebExplorer: Explore Progressive Web Information Acquisition2025-09 · MiniMax · E5
  14. Manifold-Constrained Hyper-Connections (mHC)2026-04 · DeepSeek-AI · E5
进度：已完成深度解读 133 / 133 篇。批次顺序 B1(P3) → B2(P2) → B3(P1)。每篇目录含 00-源数据提取.md（AI 权威数据层）、01-深度解读报告.md（AI 镜像）、03-深度解读报告.html（人类阅读入口）。论文 PDF（Git LFS）下载入口见互动时间线。