- ignore node_modules/ and статьи/ (binary research sources) - track .github/review-cache/authoritative-sources-by-topic.md - track package.json/package-lock.json (mermaid-cli) - commit updated book chapters, build artifacts and build script
50 KiB
50 KiB
Authoritative Sources for LLM Fact-Checking — by Topic
Generated 2026-05-20. Covers all 24 content chapters. Sources are primary papers, official docs, benchmarks, and authoritative blogs (no Medium, Substack, Twitter, YouTube, news).
1. Tokenizers, Embeddings, Semantic Space
Foundational
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Neural Machine Translation of Rare Words with Subword Units | Sennrich, Haddow, Birch | 2016 | ACL | Introduced BPE for NLP; 4000+ citations |
| SentencePiece: A simple and language independent subword tokenizer and detokenizer | Kudo & Richardson | 2018 | EMNLP | Standard tokenizer library; 3000+ citations |
| Efficient Estimation of Word Representations in Vector Space | Mikolov et al. | 2013 | ICLR (workshop) | Word2Vec — foundational embedding work; 40000+ citations |
| GloVe: Global Vectors for Word Representation | Pennington, Socher, Manning | 2014 | EMNLP | Foundational dense embeddings; 40000+ citations |
| BERT: Pre-training of Deep Bidirectional Transformers | Devlin, Chang, Lee, Toutanova | 2019 | NAACL | Bidirectional pre-training paradigm; 70000+ citations |
| Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks | Reimers & Gurevych | 2019 | EMNLP | Sentence-level embeddings standard |
Benchmarks & Tools
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| MTEB: Massive Text Embedding Benchmark | Muennighoff et al. | 2023 | EACL | Standard embedding benchmark; HuggingFace leaderboard |
| tiktoken | OpenAI | 2022– | GitHub repo | Official BPE tokenizer for GPT models |
| HuggingFace Tokenizers | HuggingFace | 2019– | Library | Industry-standard tokenizer library |
Modern Contextual Embeddings
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Matryoshka Representation Learning | Kusupati et al. | 2022 | NeurIPS | Matryoshka embeddings — variable-size representations |
| Text and Code Embeddings by Contrastive Pre-Training | Neelakantan et al. (OpenAI) | 2022 | arXiv:2201.10005 | OpenAI embedding models (text-embedding-ada-002) |
2. Transformer Architecture, Attention, MLP Layers
Architecture Foundation
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Attention Is All You Need | Vaswani et al. | 2017 | NeurIPS | Original Transformer; 130000+ citations |
| GLU Variants Improve Transformer | Shazeer | 2020 | arXiv:2002.05202 | SwiGLU — activation used in modern LLMs |
| Transformer Feed-Forward Layers Are Key-Value Memories | Geva et al. | 2021 | EMNLP | MLP layers as associative memory; foundational interpretability |
| Gaussian Error Linear Units (GELUs) | Hendrycks & Gimpel | 2016 | arXiv:1606.08415 | GELU activation; used in GPT/BERT |
| Layer Normalization | Ba, Kiros, Hinton | 2016 | arXiv:1607.06450 | LayerNorm — foundational; 8000+ citations |
Attention Variants
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Fast Transformer Decoding: One Write-Head is All You Need | Shazeer | 2019 | arXiv:1911.02150 | Multi-Query Attention (MQA) |
| GQA: Training Generalized Multi-Query Transformer Models | Ainslie et al. | 2023 | EMNLP | Grouped-Query Attention (GQA) — used in Llama, Gemma |
| FlashAttention: Fast and Memory-Efficient Exact Attention | Dao et al. | 2022 | NeurIPS | IO-aware exact attention; enables long context |
| FlashAttention-2: Faster Attention with Better Parallelism | Dao | 2023 | arXiv:2307.08691 | Improved parallelism + work partitioning |
| FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision | Shah et al. | 2024 | arXiv:2407.08608 | Hopper GPU optimizations |
| Ring Attention with Blockwise Transformers for Near-Infinite Context | Liu et al. | 2023 | arXiv:2310.01889 | Distributed attention for ultra-long context |
Positional Encodings
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| RoFormer: Enhanced Transformer with Rotary Position Embedding | Su et al. | 2021 | arXiv:2104.09864 | RoPE — standard in Llama, Qwen, DeepSeek, Gemma |
| Train Short, Test Long: Attention with Linear Biases (ALiBi) | Press et al. | 2022 | ICLR | ALiBi — length extrapolation without positional embeddings |
| YaRN: Efficient Context Window Extension | Peng et al. | 2023 | arXiv:2309.00071 | RoPE interpolation for context extension |
MoE (Mixture of Experts)
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Outrageously Large Neural Networks: The Sparsely-Gated MoE Layer | Shazeer et al. | 2017 | ICLR | Original MoE for language models |
| Switch Transformers: Scaling to Trillion Parameter Models | Fedus et al. | 2021 | JMLR | Simplified MoE routing; T5-based |
| Mixtral of Experts | Jiang et al. (Mistral AI) | 2024 | arXiv:2401.04088 | Production MoE: 8×7B, outperforms Llama 2 70B |
| DeepSeek-V3 Technical Report | DeepSeek-AI | 2024 | arXiv:2412.19437 | 671B MoE with multi-token prediction |
Interpretability
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Knowledge Neurons in Pretrained Transformers | Dai et al. | 2022 | ACL | Factual knowledge localization |
| Locating and Editing Factual Associations in GPT | Meng et al. | 2022 | NeurIPS | ROME — causal tracing of facts |
| Mass-Editing Memory in a Transformer | Meng et al. | 2023 | ICLR | MEMIT — batched fact editing |
| Towards Monosemanticity: Decomposing LMs With Dictionary Learning | Bricken et al. (Anthropic) | 2023 | Transformer Circuits | Sparse autoencoders for features |
| Scaling Monosemanticity | Templeton et al. (Anthropic) | 2024 | Anthropic Research | Feature extraction from Claude 3 Sonnet |
| Transformers represent belief state geometry in their residual stream | Shai et al. | 2024 | arXiv:2405.15943 | Belief state geometry |
| The Geometry of Reasoning | Zhou et al. | 2025 | arXiv:2510.09782 | Reasoning geometry in representation space |
State Space Models / Hybrids
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Efficiently Modeling Long Sequences with Structured State Spaces (S4) | Gu et al. | 2021 | ICLR 2022 | Original S4 — linear-time sequence modeling |
| Mamba: Linear-Time Sequence Modeling with Selective State Spaces | Gu & Dao | 2023 | arXiv:2312.00752 | Selective SSM; linear attention alternative |
| Transformers are SSMs (Mamba-2) | Dao & Gu | 2024 | ICML | Unified framework; SSD layer |
| Jamba: A Hybrid Transformer-Mamba Language Model | Lieber et al. (AI21) | 2024 | arXiv:2403.19887 | Production hybrid; Transformer + Mamba + MoE |
| Jamba 2 | AI21 Labs | 2026 | ai21.com/blog | Apache 2.0 hybrid, 256K context |
Scaling Laws
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Scaling Laws for Neural Language Models | Kaplan et al. (OpenAI) | 2020 | arXiv:2001.08361 | Power-law scaling; 2000+ citations |
| Training Compute-Optimal Large Language Models (Chinchilla) | Hoffmann et al. (DeepMind) | 2022 | NeurIPS | Optimal compute allocation; 2000+ citations |
3. Hallucinations in LLMs
Surveys & Taxonomies
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Survey of Hallucination in Natural Language Generation | Ji et al. | 2023 | ACM Computing Surveys | Canonical hallucination taxonomy; 1500+ citations |
| A Survey on Hallucination in Large Language Models | Huang et al. | 2023 | arXiv:2311.05232 | Comprehensive causes + mitigation review |
Benchmarks & Metrics
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| TruthfulQA: Measuring How Models Mimic Human Falsehoods | Lin et al. | 2022 | ACL | Standard truthfulness benchmark |
| FActScore: Fine-grained Atomic Evaluation of Factual Precision | Min et al. | 2023 | EMNLP | Atomic fact verification metric |
| SimpleQA: Measuring Short-form Factuality | OpenAI | 2024 | openai.com/index/simpleqa | OpenAI factual accuracy benchmark |
| ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidence | Wu, Wu, Zou | 2025 | arXiv:2404.10198 | Measures prior vs. evidence conflict |
Mechanisms & Detection
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Language Models Don't Always Say What They Think | Turpin et al. | 2023 | NeurIPS | Unfaithful CoT explanations |
| Measuring Faithfulness in Chain-of-Thought Reasoning | Lanham et al. | 2023 | arXiv:2307.13702 | CoT faithfulness metrics |
| Towards Understanding Sycophancy in Language Models | Sharma et al. | 2024 | ICLR | Sycophancy — models agreeing with user bias |
Mitigation
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Chain-of-Verification Reduces Hallucination | Dhuliawala et al. | 2023 | arXiv:2309.11495 | CoVe — self-verification loop |
| Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks | Lewis et al. | 2020 | NeurIPS | Original RAG as anti-hallucination |
4. Causal Decoding, Context Windows, Long Context
Position & Context Mechanics
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Lost in the Middle: How Language Models Use Long Contexts | Liu et al. | 2023 | TACL | U-shaped attention curve in long context |
| Efficient Streaming Language Models with Attention Sinks | Xiao et al. | 2023 | ICLR 2024 | StreamingLLM — initial tokens as attention sinks |
| Longformer: The Long-Document Transformer | Beltagy et al. | 2020 | arXiv:2004.05150 | Sparse attention for long documents |
| Big Bird: Transformers for Longer Sequences | Zaheer et al. | 2020 | NeurIPS | Sparse + global + random attention |
Context Extension
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| YaRN: Efficient Context Window Extension | Peng et al. | 2023 | arXiv:2309.00071 | NTK-aware RoPE interpolation; widely adopted |
| Self-Extend: Extending LLM Context Windows | Jin et al. | 2024 | arXiv:2401.01325 | Training-free extension via grouped attention |
| HELMET: How to Evaluate Long-context LMs Effectively and Thoroughly | Yen et al. | 2024 | arXiv:2410.02666 | Long-context eval framework |
Causal Masking Fundamentals
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Language Models are Unsupervised Multitask Learners (GPT-2) | Radford et al. (OpenAI) | 2019 | OpenAI Blog | Causal (autoregressive) LM paradigm formalized |
| Language Models are Few-Shot Learners (GPT-3) | Brown et al. | 2020 | NeurIPS | Scaling causal LM to 175B; in-context learning |
Diffusion LLM (alternatives to causal)
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Simple and Effective Masked Diffusion Language Models | Sahoo et al. | 2024 | NeurIPS | MDLM — masked diffusion for text |
| Discrete Diffusion Modeling (SEDD) | Lou et al. | 2024 | ICML | Score entropy discrete diffusion |
| Large Language Diffusion Models (LLaDA) | Nie et al. | 2025 | arXiv:2502.09992 | 8B diffusion model matching LLaMA3 |
| Mercury: The Fastest LLM | Inception Labs | 2025–2026 | inceptionlabs.ai | First production diffusion LLM |
5. Prompt Engineering, XML Markup, Chain-of-Thought
Prompting Methods
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Chain-of-Thought Prompting Elicits Reasoning in LLMs | Wei et al. (Google) | 2022 | NeurIPS | Introduced CoT; 3000+ citations |
| Large Language Models are Zero-Shot Reasoners | Kojima et al. | 2022 | NeurIPS | "Let's think step by step" |
| Plan-and-Solve Prompting | Wang et al. | 2023 | ACL | Structured planning in zero-shot |
| Decomposed Prompting: A Modular Approach | Khot et al. | 2023 | ICLR | Task decomposition via prompting |
| Least-to-Most Prompting | Zhou et al. | 2023 | ICLR | Progressive complexity prompting |
Structured Output & Prompt Architecture
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Use XML tags to structure your prompts | Anthropic | 2024–2026 | Official docs | Primary guidance on XML markup for Claude |
| Prompt engineering best practices | OpenAI | 2024–2026 | Official docs | Prompt structure for OpenAI models |
| Structured Outputs API | OpenAI | 2024–2026 | Official docs | JSON Schema constrained decoding |
| Efficient Guided Generation for LLMs (Outlines) | Willard & Louf | 2023 | arXiv:2307.09702 | Structured generation via FSM |
| Guidance | Microsoft | 2023– | GitHub repo | DSL for controlling LLM output structure |
| LMQL | Beurer-Kellner et al. | 2023–2025 | arXiv | SQL-like language for LLM constraints |
Prompt Optimization
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| DSPy: Compiling Declarative Language Model Calls | Khattab et al. | 2024 | ICLR/TMLR | Automated prompt optimization via signatures |
| Large Language Models as Optimizers (OPRO) | Yang et al. | 2024 | ICLR | LLMs as prompt optimizers |
| The Unreasonable Effectiveness of Eccentric Automatic Prompts | Battle & Gollapudi | 2024 | arXiv | Systematic prompt search |
Agent-Specific Prompting
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| ReAct: Synergizing Reasoning and Acting | Yao et al. | 2023 | ICLR | Interleaved reasoning + action |
| Reflexion: Language Agents with Verbal RL | Shinn et al. | 2023 | NeurIPS | Self-reflection via verbal feedback |
| Tree of Thoughts | Yao et al. | 2023 | NeurIPS | Tree search over reasoning paths |
| Graph of Thoughts | Besta et al. | 2024 | AAAI | Graph-based reasoning framework |
| Language Agent Tree Search (LATS) | Zhou et al. | 2024 | arXiv:2310.04406 | Unified reasoning + acting + planning |
Prompt Safety & Alignment
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Constitutional AI: Harmlessness from AI Feedback | Bai et al. (Anthropic) | 2022 | arXiv:2212.08073 | Self-critique + revision via constitution |
| Calibrate Before Use | Zhao et al. | 2021 | ICML | Few-shot calibration; format sensitivity |
6. Agents vs Chat, Tool Use, MCP Protocol
Agent Foundations
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| ReAct: Synergizing Reasoning and Acting in Language Models | Yao et al. | 2023 | ICLR | Defines agent loop: Thought → Action → Observation |
| Cognitive Architectures for Language Agents (CoALA) | Sumers, Yao, Narasimhan, Griffiths | 2023 | TMLR 2024 | Cognitive framework for LLM agents |
| Generative Agents: Interactive Simulacra of Human Behavior | Park et al. | 2023 | UIST | Agent memory + reflection architecture |
| Building Effective Agents | Anthropic | 2024 | anthropic.com/research | Definitive agent design patterns guide |
| A Practical Guide to Building Agents | OpenAI | 2025 | platform.openai.com | OpenAI agent building patterns |
Tool Use
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Toolformer: Language Models Can Teach Themselves to Use Tools | Schick et al. (Meta) | 2023 | NeurIPS | Self-supervised tool learning |
| PAL: Program-aided Language Models | Gao et al. | 2023 | ICML | Code as reasoning + computation |
| Tool Learning with Foundation Models | Qin et al. | 2024 | Nature Machine Intelligence | Comprehensive tool-learning survey |
| Tool Use API docs | Anthropic | 2024–2026 | Official docs | Native tool calling for Claude |
| Tools, Connectors, and MCP | OpenAI | 2025–2026 | Official docs | Tool use in Responses API |
| Computer Use | Anthropic | 2024–2026 | Official docs | GUI agent capabilities |
| Code Execution Tool | Anthropic | 2026 | Official docs | Sandboxed code execution for agents |
MCP Ecosystem
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| MCP Specification (v2025-11-25) | Anthropic / LF Projects | 2024–2025 | Formal spec | Canonical MCP protocol definition |
| MCP Introduction & Concepts | Anthropic | 2024–2026 | Official docs | MCP architecture and concepts |
| MCP Servers Repository | Community | 2025– | GitHub repo | Reference MCP server implementations |
| MCP Authorization Spec | LF Projects | 2025 | Formal spec | OAuth 2.0 authorization for MCP |
Agent-to-Agent
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Agent-to-Agent Protocol (A2A) | 2025 | GitHub repo | Google's inter-agent communication standard |
Multi-Agent Systems
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation | Wu et al. (Microsoft) | 2024 | COLM | Multi-agent conversation framework |
| MemGPT: Towards LLMs as Operating Systems | Packer et al. | 2023 | arXiv:2310.08560 | OS-like memory management for agents |
| Agentic Memory: Learning Unified Memory Management for LLM Agents | Yu et al. | 2026 | arXiv:2601.01885 | Unified STM + LTM memory policy |
Agent Benchmarks
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| SWE-bench: Can Language Models Resolve Real-World GitHub Issues? | Jimenez et al. | 2024 | ICLR | Agentic coding benchmark; official leaderboard |
| GAIA: A Benchmark for General AI Assistants | Mialon et al. | 2024 | ICLR | General agent capability benchmark |
| WebArena: A Realistic Web Environment for Building Autonomous Agents | Zhou et al. | 2024 | arXiv | Web-based agent benchmark |
| τ-bench: A Benchmark for Tool-Agent-User Interaction | Yao et al. | 2024 | arXiv | Tool + user interaction benchmark |
Agent Frameworks (official docs)
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| LangGraph | LangChain | 2024–2026 | Official docs | Stateful multi-actor agent framework |
| CrewAI | CrewAI | 2024–2026 | Official docs | Role-based multi-agent orchestration |
7. RAG Pipelines, Anti-Hallucination Loops
RAG Foundations
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks | Lewis et al. (Meta) | 2020 | NeurIPS | Original end-to-end RAG; 4000+ citations |
| Retrieval-Augmented Generation for LLMs: A Survey | Gao et al. | 2024 | arXiv:2312.10997 | Comprehensive RAG survey (2024) |
| Precise Zero-Shot Dense Retrieval without Relevance Labels (HyDE) | Gao et al. | 2023 | ACL | Hypothesis-based retrieval |
| Self-RAG: Learning to Retrieve, Generate, and Critique | Asai et al. | 2024 | ICLR | Self-reflective retrieval |
| Corrective Retrieval Augmented Generation (CRAG) | Yan et al. | 2024 | arXiv:2401.15884 | Retrieval quality evaluator + correction |
Advanced Retrieval
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| From Local to Global: A Graph RAG Approach (GraphRAG) | Edge et al. (Microsoft) | 2024 | Microsoft Research | Graph-based RAG; enterprise adoption |
| RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval | Sarthi et al. | 2024 | ICLR | Hierarchical summarization for retrieval |
| Introducing Contextual Retrieval | Anthropic | 2024 | Anthropic Blog | Context-enhanced chunking |
| ColPali: Efficient Document Retrieval with Vision Language Models | Faysse et al. | 2024 | ICLR 2025 | Vision-based document retrieval |
| Matryoshka Representation Learning | Kusupati et al. | 2022 | NeurIPS | Variable-size embeddings for flexible retrieval |
RAG Evaluation
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| RAGAS: Automated Evaluation of Retrieval Augmented Generation | Es et al. | 2024 | EACL | Standard RAG eval framework |
| RAGChecker: A Fine-grained Framework for Diagnosing RAG | Ru et al. | 2024 | arXiv:2408.08067 | Fine-grained RAG diagnostics |
| ClashEval: Quantifying the tug-of-war between LLM prior and evidence | Wu, Wu, Zou | 2025 | arXiv:2404.10198 | Internal prior vs. external evidence conflict |
Anti-Hallucination
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Chain-of-Verification Reduces Hallucination | Dhuliawala et al. | 2023 | arXiv:2309.11495 | CoVe: generate → verify → revise |
| NeMo Guardrails: Programmable Rails for Safe LLM Applications | Rebedea et al. (NVIDIA) | 2023 | arXiv:2310.10501 | Guardrails framework |
| Reducing Hallucination — Best Practices | Anthropic | 2024–2026 | Official docs | Provider guidance on hallucination reduction |
| LangSmith Tracing & Evaluation | LangChain | 2024–2026 | Official docs | Trace-based hallucination detection |
| Arize Phoenix: LLM Observability | Arize AI | 2025–2026 | Official docs | Open-source hallucination monitoring |
| W&B Weave: LLM Monitoring | Weights & Biases | 2025–2026 | Official docs | ML monitoring for LLM quality |
8. LLM Evaluation (Evals, Benchmarks)
LLM-as-Judge
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena | Zheng et al. | 2023 | NeurIPS | Defines LLM-as-Judge methodology |
| G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment | Liu et al. | 2023 | arXiv:2303.16634 | Chain-of-Thought evaluation with GPT-4 |
| Large Language Models are not Fair Evaluators | Wang et al. | 2023 | arXiv:2305.17926 | Position bias in LLM evaluation |
| Who Validates the Validators? | Shankar et al. | 2024 | arXiv:2404.12272 | Meta-evaluation of LLM judges |
| Self-Generated Critiques Boost Reward Modeling | Yu et al. | 2025 | NAACL | Self-critique as reward signal |
| Chatbot Arena: Open Platform for Evaluating LLMs by Human Preference | Chiang et al. | 2024 | arXiv:2403.04132 | LMSys Arena methodology |
| Evalica: Reliable, Reproducible Leaderboards | Ustalov | 2025 | COLING | Statistical significance in leaderboard ranking |
Key Benchmarks
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| MMLU: Measuring Massive Multitask Language Understanding | Hendrycks et al. | 2021 | ICLR | Most-cited LLM knowledge benchmark |
| BIG-bench: Beyond the Imitation Game | Srivastava et al. | 2022 | arXiv | 204-task collaborative benchmark |
| GSM8K: Training Verifiers to Solve Math Word Problems | Cobbe et al. (OpenAI) | 2021 | NeurIPS | Standard grade-school math benchmark |
| MATH: Measuring Mathematical Problem Solving | Hendrycks et al. | 2021 | NeurIPS | Competition-level math benchmark |
| HumanEval: Evaluating LLMs Trained on Code | Chen et al. (OpenAI) | 2021 | arXiv | Code generation benchmark |
| SWE-bench | Jimenez et al. | 2024 | ICLR | Real-world GitHub issue resolution |
| GAIA | Mialon et al. | 2024 | ICLR | General AI assistant benchmark |
| TruthfulQA | Lin et al. | 2022 | ACL | Truthfulness benchmark |
| HellaSwag | Zellers et al. | 2019 | ACL | Commonsense reasoning |
Evaluation Frameworks
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| DeepEval | Confident AI | 2024–2026 | GitHub repo | Unit-testing framework for LLM outputs |
| Promptfoo | Promptfoo | 2024–2026 | GitHub repo | Prompt eval + red-teaming CLI |
| RAGAS | VibrantLabs | 2024–2026 | GitHub repo | RAG-specific evaluation |
| Braintrust Autoevals | Braintrust | 2024–2026 | GitHub repo | Auto-evaluation for LLM outputs |
| LangSmith | LangChain | 2024–2026 | Official docs | Trace-based eval pipeline |
9. LLM Security (Prompt Injection, Jailbreaks, OWASP)
Standards & Taxonomies
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| OWASP Top 10 for LLM Applications 2025 | OWASP | 2025 | Formal standard | Industry standard vulnerability taxonomy |
| MITRE ATLAS (Adversarial Threat Landscape for AI Systems) | MITRE | 2024–2026 | Formal framework | AI threat framework; MITRE ATT&CK companion |
Prompt Injection
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Not what you've signed up for: Indirect Prompt Injection | Greshake et al. | 2023 | arXiv:2302.12173 | Original indirect prompt injection paper |
| Prompt Injection Attacks and Defenses in LLM-Integrated Applications | Liu et al. | 2024 | arXiv:2402.02393 | Comprehensive injection survey |
| Ignore Previous Prompt: Attack Techniques For Language Models | Schulhoff et al. | 2023 | NeurIPS (SoLaR) | Prompt injection taxonomy |
Jailbreaks
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Universal and Transferable Adversarial Attacks (GCG) | Zou et al. | 2023 | arXiv:2307.15043 | Greedy Coordinate Gradient — universal suffix attack |
| AutoDAN: Generating Stealthy Jailbreak Prompts | Liu et al. | 2023 | arXiv:2310.04451 | Automated genetic jailbreak generation |
| Many-shot jailbreaking | Anthropic | 2024 | anthropic.com/research | Long-context jailbreak technique |
| The Crescendo Multi-Turn LLM Jailbreak Attack | Russinovich, Salem, Eldan (Microsoft) | 2024 | arXiv:2404.01833 | Multi-turn escalation jailbreak |
| Mitigating Skeleton Key | Microsoft | 2024 | Security blog | Skeleton key jailbreak technique + mitigation |
| Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks | Andriushchenko et al. | 2024 | ICLR 2025 | Adaptive jailbreak; SOTA attack method |
Red-Teaming
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Red Teaming Language Models with Language Models | Perez et al. (Anthropic) | 2022 | arXiv:2202.03286 | Automated LLM red-teaming |
| NeMo Guardrails: Programmable Rails | Rebedea et al. (NVIDIA) | 2023 | arXiv:2310.10501 | Guardrails for safe LLM apps |
| PyRIT (Python Risk Identification Toolkit) | Microsoft | 2024–2026 | GitHub repo | Automated red-teaming framework |
Provider Safety Docs
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Safety & Security documentation | Anthropic | 2024–2026 | Official docs | Claude safety practices |
| GPT-5.4 System Card | OpenAI | 2026 | Official report | Safety evaluation for GPT-5.4 |
| Gemini Safety documentation | 2025–2026 | Official docs | Gemini safety features |
10. AI-Friendly Code Architecture
Foundational Principles
| Source | Authors | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Clean Code | Martin | 2008 | Book | Industry-standard code quality principles |
| Refactoring, 2nd Ed. | Fowler | 2018 | Book | Refactoring patterns; code improvement |
LLM-Aware Architecture
| Source | Authors/Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| AGENTS.md: A standard for AI agent project configuration | Anthropic | 2026 | Official spec | Standard for AI-readable project config |
| Rules for AI | Cursor | 2025–2026 | Official docs | Cursor rules for LLM-guided coding |
| Best practices for agentic coding | Anthropic | 2025 | Official docs | Coding patterns for AI agent workflows |
| copilot-instructions.md | GitHub | 2026 | Official docs | Copilot coding agent customization |
Code Generation & Understanding
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Enriching Source Code with Contextual Data for Code Completion | van Dam, Izadi, van Deursen | 2023 | MSR | Impact of comments/code structure on completion |
| Dataflow-Guided Retrieval Augmentation for Repository-Level Code Completion | Cheng, Wu, Hu | 2024 | ACL | Repo context graph for code completion |
| SpecRover: Code Intent Extraction via LLMs | Ruan, Zhang, Roychoudhury | 2024 | ICSE 2025 | Extracting developer intent from code |
| Revisiting the Role of Natural Language Code Comments | Gupta et al. | 2026 | arXiv:2601.16661 | Comments vs. LLM code understanding |
| Less is more: DocString compression in code generation | Yang et al. | 2026 | ACM TOSEM | DocString impact on generation quality |
| Beyond the Black Box: Survey on Theory and Mechanism of LLMs | Gan et al. | 2026 | arXiv:2601.02907 | Meta-survey covering inference-stage practices |
Prompt Pipeline Optimization
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| DSPy: Compiling Declarative Language Model Calls | Khattab et al. | 2024 | ICLR | Optimize LLM pipelines by metric, not manual tuning |
| Rethinking the Role of Demonstrations | Min et al. | 2022 | EMNLP | What makes in-context learning work |
| Calibrate Before Use | Zhao et al. | 2021 | ICML | LLM calibration for better performance |
| Large Language Models as Optimizers | Yang et al. | 2024 | ICLR | Iterative prompt optimization |
11. Observability (OpenTelemetry, SLO)
Standards & Specifications
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Semantic Conventions for Generative AI (v1.40.0) | OpenTelemetry / CNCF | 2026 | Formal spec | Industry-standard GenAI observability conventions |
| OpenTelemetry Specification | CNCF | 2019–2026 | Formal spec | Distributed tracing and metrics standard |
LLM-Specific Tools
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| OpenLLMetry | Traceloop | 2025–2026 | GitHub repo | OpenTelemetry-native LLM observability |
| Arize Phoenix | Arize AI | 2025–2026 | GitHub repo | Open-source LLM observability platform |
| LangSmith | LangChain | 2024–2026 | Official docs | Trace-based LLM observability + eval |
| W&B Weave | Weights & Biases | 2025–2026 | Official docs | LLM monitoring and evaluation |
SLO & Reliability
| Source | Authors | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Site Reliability Engineering | Beyer et al. (Google) | 2016 | Book (O'Reilly) | SLI/SLO/Error Budget canon |
| LLMs Get Lost In Multi-Turn Conversation | Laban et al. | 2025 | ICLR 2026 | Multi-turn reliability degradation |
| The Molecular Structure of Thought | Chen et al. | 2026 | arXiv:2601.06002 | Typed traces: deep reasoning, self-reflection, self-exploration |
12. Multimodal Systems
Vision-Language
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| CLIP: Learning Transferable Visual Models From Natural Language Supervision | Radford et al. (OpenAI) | 2021 | ICML | Contrastive vision-language pre-training; 15000+ citations |
| Flamingo: a Visual Language Model for Few-Shot Learning | Alayrac et al. (DeepMind) | 2022 | NeurIPS | Few-shot multimodal model |
| LLaVA: Visual Instruction Tuning | Liu et al. | 2024 | NeurIPS | Instruction-tuned vision-language model |
| Visual Instruction Tuning (LLaVA 1.5) | Liu et al. | 2024 | arXiv | Improved multimodal instruction tuning |
| Gemini: A Family of Highly Capable Multimodal Models | Gemini Team (Google) | 2023 | arXiv | Native multimodal architecture |
| Gemini 1.5: Unlocking multimodal understanding across millions of tokens | Reid et al. (Google) | 2024 | arXiv | Ultra-long multimodal context |
| GPT-4V(ision) System Card | OpenAI | 2023 | Official report | GPT-4 vision capabilities |
| Vision API docs | OpenAI | 2024–2026 | Official docs | OpenAI vision capabilities |
| Vision API docs | Anthropic | 2024–2026 | Official docs | Claude vision capabilities |
| Image Understanding docs | 2025–2026 | Official docs | Gemini vision capabilities |
Audio & Speech
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Audio Understanding | 2025–2026 | Official docs | Gemini native audio processing | |
| Realtime API | OpenAI | 2025–2026 | Official docs | Speech-to-speech realtime API |
| Whisper: Robust Speech Recognition | Radford et al. (OpenAI) | 2022 | OpenAI | Speech recognition model |
Document Understanding
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| ColPali: Efficient Document Retrieval with Vision Language Models | Faysse et al. | 2024 | ICLR 2025 | Visual document retrieval via VLMs |
| DocTR | Mindee | 2023– | GitHub repo | Open-source OCR for documents |
Multimodal Hallucination
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Evaluating Object Hallucination in Large Vision-Language Models (POPE) | Li et al. | 2023 | EMNLP | Vision-language hallucination benchmark |
| HallusionBench: An Advanced Diagnostic Suite | Guan et al. | 2024 | CVPR | Diagnostic vision-language hallucination |
13. Fine-Tuning, Post-Training (SFT, RLHF, DPO, LoRA)
Supervised Fine-Tuning
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Finetuned Language Models Are Zero-Shot Learners (FLAN) | Wei et al. (Google) | 2021 | ICLR | Instruction tuning paradigm |
| Self-Instruct: Aligning LMs with Self-Generated Instructions | Wang et al. | 2022 | ACL | Synthetic instruction generation |
| Textbooks Are All You Need (Phi-1) | Gunasekar et al. (Microsoft) | 2023 | arXiv:2306.11644 | Quality > quantity for training data |
| Orca: Progressive Learning from Complex Explanation Traces | Mukherjee et al. (Microsoft) | 2023 | arXiv:2306.02707 | Learning from GPT-4 reasoning traces |
| LIMA: Less Is More for Alignment | Zhou et al. (Meta) | 2023 | arXiv:2305.11206 | 1000 examples enough for alignment |
RLHF & Alignment
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Training language models to follow instructions with human feedback (InstructGPT) | Ouyang et al. (OpenAI) | 2022 | NeurIPS | Original RLHF for instruction following |
| Constitutional AI: Harmlessness from AI Feedback | Bai et al. (Anthropic) | 2022 | arXiv:2212.08073 | RLAIF — AI feedback instead of human |
| Scaling Laws for Reward Model Overoptimization | Gao et al. | 2022 | NeurIPS | Reward hacking in RLHF |
| DeepSeekMath: Pushing the Limits of Mathematical Reasoning | Shao et al. | 2024 | arXiv:2402.03300 | GRPO — Group Relative Policy Optimization |
| DeepSeek-R1: Incentivizing Reasoning via RL | Guo et al. | 2025 | Nature vol. 645 | Pure RL for reasoning emergence |
DPO & Variants
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Direct Preference Optimization (DPO) | Rafailov et al. (Stanford) | 2023 | NeurIPS | RL-free preference optimization; 2000+ citations |
| ORPO: Monolithic Preference Optimization without Reference Model | Hong et al. | 2024 | arXiv:2403.07691 | Reference-free DPO alternative |
| KTO: Model Alignment as Prospect Theoretic Optimization | Ethayarajh et al. | 2024 | arXiv:2402.01306 | Kahneman-Tversky prospect theory alignment |
| SimPO: Simple Preference Optimization with Reference-Free Reward | Meng et al. | 2024 | arXiv:2405.14734 | Length-normalized preference optimization |
| RLHF Workflow: From Reward Modeling to Online RLHF | Dong et al. | 2024 | arXiv:2405.07863 | Online vs offline RLHF comparison |
Parameter-Efficient Fine-Tuning
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| LoRA: Low-Rank Adaptation of Large Language Models | Hu et al. (Microsoft) | 2021 | ICLR | Dominant PEFT method; 10000+ citations |
| QLoRA: Efficient Finetuning of Quantized LLMs | Dettmers et al. | 2023 | NeurIPS | LoRA + 4-bit quantization |
| IA3: Few-shot Parameter-Efficient Fine-Tuning | Liu et al. | 2022 | ACL | Inference-time PEFT via learned vectors |
Knowledge Distillation
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Distilling the Knowledge in a Neural Network | Hinton, Vinyals, Dean | 2015 | arXiv:1503.02531 | Original distillation framework |
| Distilling Step-by-Step! | Hsieh et al. | 2023 | ACL | Reasoning distillation via CoT |
| MiniLLM: On-Policy Distillation of LLMs | Gu et al. | 2024 | ICLR | Knowledge distillation for LLMs |
Provider Fine-Tuning Docs
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Model Optimization (fine-tuning) | OpenAI | 2024–2026 | Official docs | GPT fine-tuning API |
| Reinforcement Fine-Tuning | OpenAI | 2025–2026 | Official docs | RL-based fine-tuning |
14. Design Patterns for LLM Apps
Agent Patterns (detailed in book chapters 8–10, 20)
| Source | Authors | Year | Venue | Pattern |
|---|---|---|---|---|
| Chain-of-Thought | Wei et al. | 2022 | NeurIPS | Reasoning via step-by-step |
| Self-Consistency | Wang et al. | 2023 | ICLR | Majority vote over multiple reasoning paths |
| ReAct | Yao et al. | 2023 | ICLR | Interleaved reasoning + action |
| Reflexion | Shinn et al. | 2023 | NeurIPS | Self-reflection + verbal RL |
| Tree of Thoughts | Yao et al. | 2023 | NeurIPS | Tree search over reasoning paths |
| Graph of Thoughts | Besta et al. | 2024 | AAAI | Graph-structured reasoning |
| Chain-of-Verification | Dhuliawala et al. | 2023 | arXiv:2309.11495 | Generate → verify → revise |
| RAG | Lewis et al. | 2020 | NeurIPS | Retrieve → augment → generate |
| Self-RAG | Asai et al. | 2024 | ICLR | Self-reflective retrieval |
| GraphRAG | Edge et al. | 2024 | Microsoft Research | Graph-based retrieval |
Architectural Pattern Guides
| Source | Authors/Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Building Effective Agents | Anthropic | 2024 | Anthropic Blog | Agent design patterns: workflows → agents |
| LLM Powered Autonomous Agents | Weng (OpenAI) | 2023 | Blog | Comprehensive agent design survey |
| Building Production RAG | LlamaIndex | 2024 | Official docs | Production RAG patterns |
15. Serving & Inference
KV-Cache & Memory Management
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Efficient Memory Management for LLM Serving with PagedAttention | Kwon et al. (vLLM) | 2023 | SOSP | PagedAttention — OS-inspired KV-cache; standard in vLLM |
| vLLM Documentation | vLLM Project | 2023–2026 | Official docs | Production LLM serving; disaggregated prefill |
| SGLang: Efficient Execution of Structured Language Model Programs | Zheng et al. | 2024 | arXiv | RadixAttention — prefix-aware KV-cache reuse |
| Prompt Cache: Modular Attention Reuse for Low-Latency Inference | Gim et al. | 2024 | MLSys | Prompt-level KV-cache sharing |
Speculative Decoding
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Fast Inference from Transformers via Speculative Decoding | Leviathan et al. (Google) | 2023 | ICML | Draft-then-verify; 2–3× speedup |
| Accelerating LLM Decoding with Speculative Sampling | Chen et al. (DeepMind) | 2023 | arXiv:2302.01318 | Independent speculative sampling variant |
Quantization
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| GPTQ: Accurate Post-Training Quantization for GPTs | Frantar et al. | 2023 | ICLR | OBQ-based weight quantization |
| AWQ: Activation-aware Weight Quantization | Lin et al. | 2024 | MLSys | Activation-aware 4-bit quantization |
| SmoothQuant: Accurate and Efficient Post-Training Quantization | Xiao et al. | 2023 | ICML | Activation + weight quantization |
| QLoRA: Efficient Finetuning of Quantized LLMs | Dettmers et al. | 2023 | NeurIPS | 4-bit + PEFT |
| The Era of 1-bit LLMs (BitNet) | Ma et al. (Microsoft) | 2024 | arXiv:2402.17764 | 1.58-bit LLMs |
Serving Frameworks
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| vLLM | vLLM Project (UC Berkeley) | 2023–2026 | GitHub repo | Most popular open-source LLM serving engine |
| TensorRT-LLM | NVIDIA | 2023–2026 | GitHub repo | NVIDIA-optimized inference |
| Ollama | Ollama | 2024–2026 | Official site | Local LLM serving for devs |
| SGLang | SGLang Project | 2024–2026 | GitHub repo | Structured generation serving |
Test-Time Compute (Budget Forcing, Scaling)
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Scaling LLM Test-Time Compute Optimally | Snell et al. (UC Berkeley, Google DeepMind) | 2024 | arXiv:2408.03314 | Adaptive test-time compute allocation |
| Scaling Test-Time Compute Without Verification or RL is Suboptimal | Setlur et al. | 2025 | arXiv:2506.14495 | Verifier necessity for test-time scaling |
| All Roads Lead to Likelihood: The Value of RL in Fine-Tuning | Swamy et al. | 2025 | arXiv:2505.14864 | Solution space constrained by verifier |
| To CoT or not to CoT? | Sprague et al. | 2025 | arXiv:2503.16411 | When CoT helps and when it doesn't |
| Chain-of-Thought Reasoning Without Prompting | Wang & Zhou | 2024 | arXiv:2402.10200 | CoT can happen internally, not just in output |
16. Agent Orchestration, Durable Execution
Durable Execution
| Source | Authors/Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| Sagas | Garcia-Molina & Salem | 1987 | ACM SIGMOD | Foundational compensating transaction pattern |
| Temporal: Durable Execution | Temporal Technologies | 2020–2026 | Official docs | Durable execution platform |
| Inngest: Durable Functions for AI Workflows | Inngest | 2023–2026 | Official docs | Serverless durable execution for AI |
| ADK: Long-Running Tasks | 2025 | Official docs | Google Agent Development Kit |
Agent Lifecycle & Memory
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| MemGPT: Towards LLMs as Operating Systems | Packer et al. | 2023 | arXiv:2310.08560 | Virtual memory for agent context |
| Agentic Memory: Learned Unified Memory Management | Yu et al. | 2026 | arXiv:2601.01885 | Learned STM + LTM memory policy |
| Generative Agents: Interactive Simulacra | Park et al. | 2023 | UIST | Agent memory + reflection patterns |
| LLMs Get Lost In Multi-Turn Conversation | Laban et al. | 2025 | ICLR 2026 | Multi-turn drift; checkpoint summaries |
| Codex: Background Tasks & Sandbox Execution | OpenAI | 2026 | Official docs | Persistent agent execution |
| Claude Code: Headless & Background Mode | Anthropic | 2026 | Official docs | Background agent workflows |
Multi-Agent Orchestration
| Source | Authors/Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| AutoGen | Wu et al. (Microsoft) | 2024 | COLM | Multi-agent conversation framework |
| CrewAI | CrewAI | 2024–2026 | Official docs | Role-based orchestration |
| LangGraph | LangChain | 2024–2026 | Official docs | Graph-based stateful agent orchestration |
17. LLM Landscape 2026
Major Model Families (Official Docs)
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| GPT-5.4 System Card | OpenAI | 2026 | Official report | SOTA frontier model (May 2026) |
| Claude models overview (Claude Opus 4.6) | Anthropic | 2026 | Official docs | Frontier model with extended thinking |
| Claude Mythos Preview System Card | Anthropic | 2026 | Official report | Next-gen Claude (Project Glasswing) |
| Gemini API models | Google DeepMind | 2026 | Official docs | Gemini 3.x family |
| Gemma 4 | Google DeepMind | 2026 | Official docs | Open-weight Gemma family |
| Llama 4 | Meta AI | 2025–2026 | Official site | Meta open(-weight) model |
| DeepSeek models | DeepSeek-AI | 2024–2026 | GitHub + arXiv | DeepSeek-V3, DeepSeek-R1 |
| Qwen3 / Qwen3.5 / Qwen3.6 | Alibaba | 2025–2026 | GitHub + blog | Qwen open-weight family |
| GLM-5.1 | Zhipu AI / Z.ai | 2026 | Official site | Agentic-optimized model |
| Grok 4.20 | xAI | 2026 | Official docs | Grok family |
| MiniMax-M2.7 | MiniMax | 2026 | Official site | Self-evolution claims |
Reasoning Models
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| DeepSeek-R1 | Guo et al. / DeepSeek-AI | 2025 | Nature vol. 645 | Pure RL for reasoning emergence |
| o3 System Card | OpenAI | 2025 | Official report | Frontier reasoning model |
| GPT-5.4 System Card | OpenAI | 2026 | Official report | Reasoning + tool use integration |
| Qwen3.6-Plus: Towards Real World Agents | Qwen Team | 2026 | Research blog | Agentic reasoning capabilities |
| Training LLMs to Reason in a Continuous Latent Space (Coconut) | Hao et al. | 2025 | arXiv:2412.06769 | Continuous latent reasoning |
MoE & Hybrid Architecture
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Mixtral of Experts | Mistral AI | 2024 | arXiv:2401.04088 | Production MoE (8×7B) |
| DeepSeek-V3 Technical Report | DeepSeek-AI | 2024 | arXiv:2412.19437 | 671B MoE production model |
| Jamba 2 | AI21 Labs | 2026 | Official blog | Hybrid SSM-Transformer-MoE, 256K |
| Transformers are SSMs (Mamba-2) | Dao & Gu | 2024 | ICML | Unified hybrid framework |
SLM & Edge
| Source | Authors/Org | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| Phi-4 Technical Report | Microsoft | 2025 | arXiv | MSR's small language model family |
| SmolLM3 | HuggingFace | 2025 | HuggingFace | Open lightweight LM (3B) |
| Qwen3.5-0.8B | Alibaba / Qwen Team | 2026 | HuggingFace | Sub-1B capable model |
| The Era of 1-bit LLMs (BitNet) | Ma et al. (Microsoft) | 2024 | arXiv:2402.17764 | 1.58-bit extreme compression |
Emerging: Diffusion LLM
| Source | Authors | Year | Venue | Why Authoritative |
|---|---|---|---|---|
| MDLM | Sahoo et al. | 2024 | NeurIPS | Masked diffusion for language |
| SEDD | Lou et al. | 2024 | ICML | Score entropy discrete diffusion |
| Mercury | Inception Labs | 2025–2026 | Official site | First production diffusion LLM |
| LLaDA | Nie et al. | 2025 | arXiv:2502.09992 | 8B diffusion matching LLaMA3 |
MCP Ecosystem
| Source | Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| MCP Spec (v2025-11-25) | LF Projects / Anthropic | 2024–2025 | Formal spec | Canonical protocol specification |
| MCP Connector (Anthropic) | Anthropic | 2025–2026 | Official docs | Native MCP client in Claude |
| Tools, Connectors, and MCP | OpenAI | 2025–2026 | Official docs | MCP support in Responses API |
| A2A Protocol | 2025 | GitHub repo | Inter-agent protocol |
Model Technical Reports (Official)
| Source | Authors/Org | Year | Type | Why Authoritative |
|---|---|---|---|---|
| GPT-4 Technical Report | OpenAI | 2023 | arXiv:2303.08774 | GPT-4 architecture overview |
| The Claude 3 Model Family: Opus, Sonnet, Haiku | Anthropic | 2024 | Anthropic | Claude 3 family |
| The Llama 3 Herd of Models | Meta AI | 2024 | arXiv:2407.21783 | Llama 3 family (8B, 70B, 405B) |
| Gemma 2: Improving Open Language Models at a Practical Size | Google DeepMind | 2024 | arXiv:2408.00118 | Gemma 2 family |
| GLM-5: from Vibe Coding to Agentic Engineering | Du et al. (Zhipu) | 2026 | arXiv:2602.15763 | GLM-5 technical report |
Key Benchmark Official Pages
| Benchmark | Official URL | What It Measures |
|---|---|---|
| LMSys Chatbot Arena | https://chat.lmsys.org/ | Human preference ELO ranking |
| MMLU | https://github.com/hendrycks/test | Multi-task language understanding |
| SWE-bench | https://www.swebench.com/ | Real GitHub issue resolution |
| GAIA | https://huggingface.co/gaia-benchmark | General AI assistant capabilities |
| HumanEval | https://github.com/openai/human-eval | Code generation |
| GSM8K | https://github.com/openai/grade-school-math | Grade-school math |
| MATH | https://github.com/hendrycks/math | Competition math |
| TruthfulQA | https://github.com/sylinrl/TruthfulQA | Truthfulness |
| BIG-bench | https://github.com/google/BIG-bench | 204 diverse tasks |
| MT-Bench | https://github.com/lm-sys/FastChat | Multi-turn conversation |
| HellaSwag | https://rowanzellers.com/hellaswag/ | Commonsense reasoning |
| SimpleQA | https://openai.com/index/simpleqa/ | Short-form factuality |
| HELMET | https://github.com/princeton-nlp/HELMET | Long-context evaluation |
Notes
- Venue abbreviations: NeurIPS, ICML, ICLR, ACL, EMNLP, NAACL, AAAI, TACL, TMLR, SOSP, MLSys, COLM, MSR, CVPR, EACL, COLING, SIGMOD, SOSP.
- Official docs include Anthropic Platform docs, OpenAI API docs, Google AI docs, and official GitHub repos.
- "Official blog" refers only to research blogs from OpenAI, Anthropic, Google DeepMind, Meta AI, Microsoft Research — not personal blogs.
- Sources already cited in the book's chapter
## Источникиsections are all included above, with additions for completeness. - For fact-checking: verify claims against the most recent version of official docs (Anthropic Platform, OpenAI API, Google AI) as they update frequently.