{
  "source_file": "0930",
  "source_platform": "Substack",
  "author": "Deep (Learning) Focus Cameron R. Wolfe",
  "title_listed": "The Evolution of Language Models: From RNN to Transformer",
  "keywords": "语言模型,RNN,演化",
  "domain": "大模型算法",
  "content_type": "深度技术解析",
  "is_paid_flag": "否",
  "url": "https://cameronrwolfe.substack.com/p/evolution-of-language-models",
  "publish_date": "2023-05",
  "corpus_stage": "预训练/SFT",
  "notes": "语言模型演化史",
  "id": "991537c1e944",
  "collected_at": "2026-10-01T20:48:25",
  "title": "Deep (Learning) Focus | Cameron R. Wolfe, Ph.D. | Substack",
  "body_markdown": "[![Deep \\(Learning\\) Focus](https://substackcdn.com/image/fetch/$s_!87xa!,w_40,h_40,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fab9b43fb-52d5-40da-995d-5b7cd3f91064_896x896.png)](https://cameronrwolfe.substack.com/)\n# [Deep (Learning) Focus](https://cameronrwolfe.substack.com/)\nSubscribeSign in\n[Home](https://cameronrwolfe.substack.com/)\n[Notes](https://cameronrwolfe.substack.com/notes)\n[The Author](https://cameronrwolfe.me)\n[Archive](https://cameronrwolfe.substack.com/archive)\n[About](https://cameronrwolfe.substack.com/about)\n## Page not found\nLatestTopDiscussions\n[Notes on NVIDIA Nemotron](https://cameronrwolfe.substack.com/p/nemotron)\n[A broad coverage of the most practically useful series of open LLM tech reports...](https://cameronrwolfe.substack.com/p/nemotron)\nSep 28 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n47\n9\n![](../images/013.png)\n### August 2026\n[Reinforcement Learning for LLMs: The Complete Guide](https://cameronrwolfe.substack.com/p/llm-rl)\n[Tracing the evolution of RL from first principles to the frontier of modern AI research...](https://cameronrwolfe.substack.com/p/llm-rl)\nAug 24 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n345\n10\n43\n![](../images/031.png)\n[Notes on Midtraining](https://cameronrwolfe.substack.com/p/midtraining-notes)\n[Creating better specialized LLMs with midtraining and continual pretraining...](https://cameronrwolfe.substack.com/p/midtraining-notes)\nAug 10 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n73\n8\n![](../images/body-e3a473e183a6f8af92e4.png)\n### July 2026\n[Agentic World Models](https://cameronrwolfe.substack.com/p/agentic-world-models)\n[Creating better language agents by teaching them to model their environment...](https://cameronrwolfe.substack.com/p/agentic-world-models)\nJul 20 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n128\n9\n19\n![](../images/body-1012a3d330000e12e1e7.png)\n### June 2026\n[Agentic RL: Frameworks and Best Practices](https://cameronrwolfe.substack.com/p/agentic-rl)\n[How LLMs are trained to handle long horizon tasks in complex environments...](https://cameronrwolfe.substack.com/p/agentic-rl)\nJun 22 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n194\n14\n20\n![](../images/body-4c9994acaff529c793c6.png)\n### May 2026\n[Agent Evaluation: A Detailed Guide](https://cameronrwolfe.substack.com/p/agent-evals)\n[Best practices and common patterns for effectively evaluating AI agents...](https://cameronrwolfe.substack.com/p/agent-evals)\nMay 18 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n338\n26\n53\n![](../images/body-5cf22a261ce0c733924d.png)\n### April 2026\n[RL Scaling Laws for LLMs](https://cameronrwolfe.substack.com/p/rl-scaling-laws)\n[How scaling laws have evolved from pretraining to reinforcement learning...](https://cameronrwolfe.substack.com/p/rl-scaling-laws)\nApr 20 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n144\n3\n17\n![](../images/body-546fe271d6459d1e8944.png)\n### March 2026\n[The Anatomy of an LLM Benchmark](https://cameronrwolfe.substack.com/p/llm-bench)\n[Common patterns used to create the most effective LLM evaluation datasets...](https://cameronrwolfe.substack.com/p/llm-bench)\nMar 30 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n118\n4\n17\n![](../images/body-0c66677da0ae74552937.png)\n[Applying Statistics to LLM Evaluations](https://cameronrwolfe.substack.com/p/stats-llm-evals)\n[An overview of useful statistics for building and interpreting LLM evaluations...](https://cameronrwolfe.substack.com/p/stats-llm-evals)\nMar 9 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n148\n9\n15\n![](../images/body-5488950eca7e4e671309.png)\n### February 2026\n[Rubric-Based Rewards for RL](https://cameronrwolfe.substack.com/p/rubric-rl)\n[Extending the benefits of large-scale RL training to non-verifiable domains...](https://cameronrwolfe.substack.com/p/rubric-rl)\nFeb 16\n134\n11\n18\n![](../images/body-41692c847a1946c758cc.png)\n### January 2026\n[Continual Learning with RL for LLMs](https://cameronrwolfe.substack.com/p/rl-continual-learning)\n[Exploring the impressive continual learning capabilities of RL training...](https://cameronrwolfe.substack.com/p/rl-continual-learning)\nJan 26 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n160\n15\n20\n![](../images/body-704df4e08e7d36e517be.png)\n[GRPO++: Tricks for Making RL Actually Work](https://cameronrwolfe.substack.com/p/grpo-tricks)\n[How to go from the vanilla GRPO algorithm to functional RL training at scale...](https://cameronrwolfe.substack.com/p/grpo-tricks)\nJan 5 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n167\n10\n18\n![](../images/body-03fa8cffb92ee3176432.png)\n### December 2025\n[Olmo 3 and the Open LLM Renaissance](https://cameronrwolfe.substack.com/p/olmo-3)\n[Fully-open artifacts with the potential to make LLM research a reality for anyone...](https://cameronrwolfe.substack.com/p/olmo-3)\nDec 15, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n85\n7\n14\n![](../images/body-b5870b795892abcd6ba2.png)\n### November 2025\n[Group Relative Policy Optimization (GRPO)](https://cameronrwolfe.substack.com/p/grpo)\n[How the algorithm that teaches LLMs to reason actually works...](https://cameronrwolfe.substack.com/p/grpo)\nNov 24, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n136\n11\n14\n![](../images/body-3b7875e64c0be40c5c27.png)\n### October 2025\n[PPO for LLMs: A Guide for Normal People](https://cameronrwolfe.substack.com/p/ppo-llm)\n[Understanding the complex RL algorithm that gave us modern LLMs…](https://cameronrwolfe.substack.com/p/ppo-llm)\nOct 27, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n185\n13\n14\n![](../images/body-d376c3f6174436bf5e60.png)\n### September 2025\n[REINFORCE: Easy Online RL for LLMs](https://cameronrwolfe.substack.com/p/reinforce)\n[How to get the benefits of online RL without the complexity of PPO...](https://cameronrwolfe.substack.com/p/reinforce)\nSep 29, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n106\n11\n6\n![](../images/body-18445455c8f92b714e39.png)\n[Online versus Offline RL for LLMs](https://cameronrwolfe.substack.com/p/online-rl)\n[A deep dive into the online-offline performance gap in LLM alignment...](https://cameronrwolfe.substack.com/p/online-rl)\nSep 8, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n93\n4\n10\n![](../images/body-e5907245629c928f8db4.png)\n### August 2025\n[GPT-oss from the Ground Up](https://cameronrwolfe.substack.com/p/gpt-oss)\n[Everything you should know about OpenAI's new open-weight language models...](https://cameronrwolfe.substack.com/p/gpt-oss)\nAug 18, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n105\n14\n15\n![](../images/body-631803b0aad1f4333c95.png)\n### July 2025\n[Direct Preference Optimization (DPO)](https://cameronrwolfe.substack.com/p/direct-preference-optimization)\n[How to align LLMs with limited hardware and minimal complexity...](https://cameronrwolfe.substack.com/p/direct-preference-optimization)\nJul 28, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n142\n20\n11\n![](../images/body-7150bc39909d5b48847f.png)\n### June 2025\n[Reward Models](https://cameronrwolfe.substack.com/p/reward-models)\n[Modeling human preferences for LLMs in the age of reasoning models...](https://cameronrwolfe.substack.com/p/reward-models)\nJun 30, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n145\n13\n20\n![](../images/body-cf341d25c37d3cedaf96.png)\n[AI Agents from First Principles](https://cameronrwolfe.substack.com/p/ai-agents)\n[Understanding AI agents by building upon the most basic concepts of LLMs...](https://cameronrwolfe.substack.com/p/ai-agents)\nJun 9, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n381\n26\n46\n![](../images/body-ced1fdf7e22892eecc47.png)\n### May 2025\n[A Guide for Debugging LLM Training Data](https://cameronrwolfe.substack.com/p/llm-debugging)\n[Data-centric techniques and tools that anyone should use when training an LLM...](https://cameronrwolfe.substack.com/p/llm-debugging)\nMay 19, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n89\n3\n13\n![](../images/body-25c4f69725ccd3ac19ae.png)\n### April 2025\n[Llama 4: The Challenges of Creating a Frontier-Level LLM](https://cameronrwolfe.substack.com/p/llama-4)\n[The full story behind Llama 4 and Meta's huge pivot in research strategy...](https://cameronrwolfe.substack.com/p/llama-4)\nApr 28, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n83\n2\n11\n![](../images/body-7f695f890ad621e1b37d.png)\n### March 2025\n[Vision Large Language Models (vLLMs)](https://cameronrwolfe.substack.com/p/vision-llms)\n[Teaching LLMs to understand images and videos in addition to text...](https://cameronrwolfe.substack.com/p/vision-llms)\nMar 31, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n156\n15\n14\n![](../images/body-3cde6af56e6afa149880.png)\n© 2026 Cameron R. Wolfe · [Privacy](https://substack.com/privacy) ∙ [Terms](https://substack.com/tos) ∙ [Collection notice](https://substack.com/ccpa#personal-data-collected)\n[ Start your Substack](https://substack.com/signup?utm_source=substack&utm_medium=web&utm_content=footer)[Get the app](https://substack.com/app/app-store-redirect?utm_campaign=app-marketing&utm_content=web-footer-button)\n[Substack](https://substack.com) is the home for great culture\n",
  "metadata": {
    "title": "Deep (Learning) Focus | Cameron R. Wolfe, Ph.D. | Substack",
    "description": "I contextualize and explain important topics in AI research. Click to read Deep (Learning) Focus, by Cameron R. Wolfe, Ph.D., a Substack publication with tens of thousands of subscribers.",
    "keywords": null,
    "author": "Cameron R. Wolfe, Ph.D.",
    "og:type": "article",
    "og:title": "Deep (Learning) Focus | Cameron R. Wolfe, Ph.D. | Substack",
    "og:description": "I contextualize and explain important topics in AI research. Click to read Deep (Learning) Focus, by Cameron R. Wolfe, Ph.D., a Substack publication with tens of thousands of subscribers.",
    "og:image": "https://substackcdn.com/image/fetch/$s_!gMCp!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Fcameronrwolfe.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1723253948%26version%3D9",
    "og:url": "https://cameronrwolfe.substack.com/evolution-of-language-models",
    "twitter:title": "Deep (Learning) Focus | Cameron R. Wolfe, Ph.D. | Substack",
    "twitter:description": "I contextualize and explain important topics in AI research. Click to read Deep (Learning) Focus, by Cameron R. Wolfe, Ph.D., a Substack publication with tens of thousands of subscribers.",
    "twitter:image": "https://substackcdn.com/image/fetch/$s_!gMCp!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Fcameronrwolfe.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1723253948%26version%3D9",
    "twitter:card": "summary_large_image"
  },
  "paywall": {
    "listed_paid": false,
    "detected": false,
    "marker": "",
    "public_only": false,
    "policy": "付费/会员内容只保留页面公开可见部分，不绕过付费墙"
  },
  "crawl": {
    "success": true,
    "status_code": 302,
    "error": ""
  },
  "code_blocks": [],
  "images": [
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!x3MA!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe158ca71-07cc-4663-b7a2-a23e2562ef84_2284x1280.png",
      "bytes": 11794,
      "reused": true,
      "local_path": "attachments/991537c1e944/images/013.png",
      "src": "https://substackcdn.com/image/fetch/$s_!x3MA!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe158ca71-07cc-4663-b7a2-a23e2562ef84_2284x1280.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!o2i3!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21f052bf-af13-4d05-9790-41a5da8e017f_2498x1398.png",
      "bytes": 13458,
      "reused": true,
      "local_path": "attachments/991537c1e944/images/031.png",
      "src": "https://substackcdn.com/image/fetch/$s_!o2i3!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21f052bf-af13-4d05-9790-41a5da8e017f_2498x1398.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!QM1Z!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe7068dcb-f82f-4ef6-afd2-eeccb4c4efd3_1720x964.png",
      "bytes": 12051,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-e3a473e183a6f8af92e4.png",
      "src": "https://substackcdn.com/image/fetch/$s_!QM1Z!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe7068dcb-f82f-4ef6-afd2-eeccb4c4efd3_1720x964.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!kVDg!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0e9f3da6-d693-421a-bd43-0fb630796385_2496x1404.png",
      "bytes": 12754,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-1012a3d330000e12e1e7.png",
      "src": "https://substackcdn.com/image/fetch/$s_!kVDg!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0e9f3da6-d693-421a-bd43-0fb630796385_2496x1404.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!8LN6!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa621de0a-6d3e-4989-b7ef-f3cb2c142060_2504x1408.png",
      "bytes": 16392,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-4c9994acaff529c793c6.png",
      "src": "https://substackcdn.com/image/fetch/$s_!8LN6!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa621de0a-6d3e-4989-b7ef-f3cb2c142060_2504x1408.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!34pV!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43315619-4430-4543-9aea-c8c1655549c2_1928x1080.png",
      "bytes": 12374,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-5cf22a261ce0c733924d.png",
      "src": "https://substackcdn.com/image/fetch/$s_!34pV!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43315619-4430-4543-9aea-c8c1655549c2_1928x1080.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!WoyR!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fabed5c67-abb9-497c-8919-033e2df09e43_1960x1100.png",
      "bytes": 11638,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-546fe271d6459d1e8944.png",
      "src": "https://substackcdn.com/image/fetch/$s_!WoyR!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fabed5c67-abb9-497c-8919-033e2df09e43_1960x1100.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Cvpf!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56cd7776-e590-4fe6-82ca-34a65900b409_2124x1192.png",
      "bytes": 13827,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-0c66677da0ae74552937.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Cvpf!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56cd7776-e590-4fe6-82ca-34a65900b409_2124x1192.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!D2VF!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a61c723-9423-49ea-af11-85b7ed56b342_2498x1404.png",
      "bytes": 13202,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-5488950eca7e4e671309.png",
      "src": "https://substackcdn.com/image/fetch/$s_!D2VF!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a61c723-9423-49ea-af11-85b7ed56b342_2498x1404.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!X-hS!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F97a09d37-0d6b-493e-a68c-300f80550467_2329x1299.png",
      "bytes": 13583,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-41692c847a1946c758cc.png",
      "src": "https://substackcdn.com/image/fetch/$s_!X-hS!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F97a09d37-0d6b-493e-a68c-300f80550467_2329x1299.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!L2cL!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3374fbcb-9fae-40e0-b756-fe0889f4aef4_2116x1183.png",
      "bytes": 13542,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-704df4e08e7d36e517be.png",
      "src": "https://substackcdn.com/image/fetch/$s_!L2cL!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3374fbcb-9fae-40e0-b756-fe0889f4aef4_2116x1183.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!r8Bx!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F168ff804-da03-4ce5-84be-4f3f7322ff70_2500x1404.png",
      "bytes": 14375,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-03fa8cffb92ee3176432.png",
      "src": "https://substackcdn.com/image/fetch/$s_!r8Bx!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F168ff804-da03-4ce5-84be-4f3f7322ff70_2500x1404.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Ju4h!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4535661c-4484-4944-b8ac-6ab546ee3b3d_2483x1398.png",
      "bytes": 13628,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-b5870b795892abcd6ba2.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Ju4h!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4535661c-4484-4944-b8ac-6ab546ee3b3d_2483x1398.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!VeOQ!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff98b75b5-c615-4139-a045-ad9572f3cf9f_2008x1130.png",
      "bytes": 11836,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-3b7875e64c0be40c5c27.png",
      "src": "https://substackcdn.com/image/fetch/$s_!VeOQ!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff98b75b5-c615-4139-a045-ad9572f3cf9f_2008x1130.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!BX2i!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F61f107c1-95cb-4438-84b9-8d87c9cdc04f_2502x1408.png",
      "bytes": 11978,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-d376c3f6174436bf5e60.png",
      "src": "https://substackcdn.com/image/fetch/$s_!BX2i!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F61f107c1-95cb-4438-84b9-8d87c9cdc04f_2502x1408.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!7PHr!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa93eba44-8bc9-40ed-b91a-9e71797aea35_2484x1402.png",
      "bytes": 11253,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-18445455c8f92b714e39.png",
      "src": "https://substackcdn.com/image/fetch/$s_!7PHr!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa93eba44-8bc9-40ed-b91a-9e71797aea35_2484x1402.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!zA4Q!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496476e6-d878-4cb2-9e11-948ac7e2e443_2240x1258.png",
      "bytes": 14187,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-e5907245629c928f8db4.png",
      "src": "https://substackcdn.com/image/fetch/$s_!zA4Q!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496476e6-d878-4cb2-9e11-948ac7e2e443_2240x1258.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!zRzH!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e1fd6f8-4805-43c3-bfe4-5e66bd3983ca_2454x1378.png",
      "bytes": 11080,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-631803b0aad1f4333c95.png",
      "src": "https://substackcdn.com/image/fetch/$s_!zRzH!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e1fd6f8-4805-43c3-bfe4-5e66bd3983ca_2454x1378.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Hcxq!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdfcbd2e-ac10-4767-8a84-d54b07eeed2b_2488x1402.png",
      "bytes": 11197,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-7150bc39909d5b48847f.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Hcxq!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdfcbd2e-ac10-4767-8a84-d54b07eeed2b_2488x1402.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!qm0_!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f2dc466-5918-4e2d-9698-c2626e71089f_1988x1116.png",
      "bytes": 12257,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-cf341d25c37d3cedaf96.png",
      "src": "https://substackcdn.com/image/fetch/$s_!qm0_!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f2dc466-5918-4e2d-9698-c2626e71089f_1988x1116.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!IitU!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcee4a772-78a7-41b7-8cf1-4da233376ea6_2002x1122.png",
      "bytes": 12179,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-ced1fdf7e22892eecc47.png",
      "src": "https://substackcdn.com/image/fetch/$s_!IitU!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcee4a772-78a7-41b7-8cf1-4da233376ea6_2002x1122.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Ji6s!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F725f69ce-2f6f-4914-a797-01ace5b67332_2484x1380.png",
      "bytes": 10039,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-25c4f69725ccd3ac19ae.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Ji6s!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F725f69ce-2f6f-4914-a797-01ace5b67332_2484x1380.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!KPTz!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4bd4b93b-9169-433e-bfa2-0613e8816420_2376x1332.png",
      "bytes": 9524,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-7f695f890ad621e1b37d.png",
      "src": "https://substackcdn.com/image/fetch/$s_!KPTz!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4bd4b93b-9169-433e-bfa2-0613e8816420_2376x1332.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!9PkX!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F12372b06-0850-4b33-b8a8-dd01dd5662fb_2208x1218.png",
      "bytes": 9697,
      "reused": false,
      "content_type": "image/jpeg",
      "local_path": "attachments/991537c1e944/images/body-3cde6af56e6afa149880.png",
      "src": "https://substackcdn.com/image/fetch/$s_!9PkX!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F12372b06-0850-4b33-b8a8-dd01dd5662fb_2208x1218.png",
      "alt": "",
      "downloaded": true,
      "discovery": "saved_markdown"
    }
  ],
  "audio": [],
  "videos": [],
  "links": [
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/notes"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/archive"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/about"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/nemotron"
    },
    {
      "type": "internal",
      "href": "https://substack.com/@cwolferesearch"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/llm-rl"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/midtraining-notes"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/agentic-world-models"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/agentic-rl"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/agent-evals"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/rl-scaling-laws"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/llm-bench"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/stats-llm-evals"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/rubric-rl"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/rl-continual-learning"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/grpo-tricks"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/olmo-3"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/grpo"
    },
    {
      "type": "internal",
      "href": "https://cameronrwolfe.substack.com/p/ppo-llm"
    },
    {
      "type": "external",
      "href": "https://cameronrwolfe.me"
    }
  ],
  "repair_version": 2,
  "repaired_at": "2026-10-20T17:31:53Z",
  "source_url": "https://cameronrwolfe.substack.com/p/evolution-of-language-models",
  "delivery_status": "unverified",
  "discovery_status": "http_404",
  "missing_reason": "http_404",
  "repair_error": "",
  "actual_video_files": [],
  "expected_saved_body_images": 24,
  "image_discovery": "saved_markdown",
  "source_body_markdown": "[![Deep \\(Learning\\) Focus](https://substackcdn.com/image/fetch/$s_!87xa!,w_40,h_40,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fab9b43fb-52d5-40da-995d-5b7cd3f91064_896x896.png)](https://cameronrwolfe.substack.com/)\n# [Deep (Learning) Focus](https://cameronrwolfe.substack.com/)\nSubscribeSign in\n[Home](https://cameronrwolfe.substack.com/)\n[Notes](https://cameronrwolfe.substack.com/notes)\n[The Author](https://cameronrwolfe.me)\n[Archive](https://cameronrwolfe.substack.com/archive)\n[About](https://cameronrwolfe.substack.com/about)\n## Page not found\nLatestTopDiscussions\n[Notes on NVIDIA Nemotron](https://cameronrwolfe.substack.com/p/nemotron)\n[A broad coverage of the most practically useful series of open LLM tech reports...](https://cameronrwolfe.substack.com/p/nemotron)\nSep 28 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n47\n9\n![](https://substackcdn.com/image/fetch/$s_!x3MA!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe158ca71-07cc-4663-b7a2-a23e2562ef84_2284x1280.png)\n### August 2026\n[Reinforcement Learning for LLMs: The Complete Guide](https://cameronrwolfe.substack.com/p/llm-rl)\n[Tracing the evolution of RL from first principles to the frontier of modern AI research...](https://cameronrwolfe.substack.com/p/llm-rl)\nAug 24 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n345\n10\n43\n![](https://substackcdn.com/image/fetch/$s_!o2i3!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21f052bf-af13-4d05-9790-41a5da8e017f_2498x1398.png)\n[Notes on Midtraining](https://cameronrwolfe.substack.com/p/midtraining-notes)\n[Creating better specialized LLMs with midtraining and continual pretraining...](https://cameronrwolfe.substack.com/p/midtraining-notes)\nAug 10 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n73\n8\n![](https://substackcdn.com/image/fetch/$s_!QM1Z!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe7068dcb-f82f-4ef6-afd2-eeccb4c4efd3_1720x964.png)\n### July 2026\n[Agentic World Models](https://cameronrwolfe.substack.com/p/agentic-world-models)\n[Creating better language agents by teaching them to model their environment...](https://cameronrwolfe.substack.com/p/agentic-world-models)\nJul 20 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n128\n9\n19\n![](https://substackcdn.com/image/fetch/$s_!kVDg!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0e9f3da6-d693-421a-bd43-0fb630796385_2496x1404.png)\n### June 2026\n[Agentic RL: Frameworks and Best Practices](https://cameronrwolfe.substack.com/p/agentic-rl)\n[How LLMs are trained to handle long horizon tasks in complex environments...](https://cameronrwolfe.substack.com/p/agentic-rl)\nJun 22 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n194\n14\n20\n![](https://substackcdn.com/image/fetch/$s_!8LN6!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa621de0a-6d3e-4989-b7ef-f3cb2c142060_2504x1408.png)\n### May 2026\n[Agent Evaluation: A Detailed Guide](https://cameronrwolfe.substack.com/p/agent-evals)\n[Best practices and common patterns for effectively evaluating AI agents...](https://cameronrwolfe.substack.com/p/agent-evals)\nMay 18 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n338\n26\n53\n![](https://substackcdn.com/image/fetch/$s_!34pV!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43315619-4430-4543-9aea-c8c1655549c2_1928x1080.png)\n### April 2026\n[RL Scaling Laws for LLMs](https://cameronrwolfe.substack.com/p/rl-scaling-laws)\n[How scaling laws have evolved from pretraining to reinforcement learning...](https://cameronrwolfe.substack.com/p/rl-scaling-laws)\nApr 20 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n144\n3\n17\n![](https://substackcdn.com/image/fetch/$s_!WoyR!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fabed5c67-abb9-497c-8919-033e2df09e43_1960x1100.png)\n### March 2026\n[The Anatomy of an LLM Benchmark](https://cameronrwolfe.substack.com/p/llm-bench)\n[Common patterns used to create the most effective LLM evaluation datasets...](https://cameronrwolfe.substack.com/p/llm-bench)\nMar 30 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n118\n4\n17\n![](https://substackcdn.com/image/fetch/$s_!Cvpf!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56cd7776-e590-4fe6-82ca-34a65900b409_2124x1192.png)\n[Applying Statistics to LLM Evaluations](https://cameronrwolfe.substack.com/p/stats-llm-evals)\n[An overview of useful statistics for building and interpreting LLM evaluations...](https://cameronrwolfe.substack.com/p/stats-llm-evals)\nMar 9 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n148\n9\n15\n![](https://substackcdn.com/image/fetch/$s_!D2VF!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a61c723-9423-49ea-af11-85b7ed56b342_2498x1404.png)\n### February 2026\n[Rubric-Based Rewards for RL](https://cameronrwolfe.substack.com/p/rubric-rl)\n[Extending the benefits of large-scale RL training to non-verifiable domains...](https://cameronrwolfe.substack.com/p/rubric-rl)\nFeb 16\n134\n11\n18\n![](https://substackcdn.com/image/fetch/$s_!X-hS!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F97a09d37-0d6b-493e-a68c-300f80550467_2329x1299.png)\n### January 2026\n[Continual Learning with RL for LLMs](https://cameronrwolfe.substack.com/p/rl-continual-learning)\n[Exploring the impressive continual learning capabilities of RL training...](https://cameronrwolfe.substack.com/p/rl-continual-learning)\nJan 26 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n160\n15\n20\n![](https://substackcdn.com/image/fetch/$s_!L2cL!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3374fbcb-9fae-40e0-b756-fe0889f4aef4_2116x1183.png)\n[GRPO++: Tricks for Making RL Actually Work](https://cameronrwolfe.substack.com/p/grpo-tricks)\n[How to go from the vanilla GRPO algorithm to functional RL training at scale...](https://cameronrwolfe.substack.com/p/grpo-tricks)\nJan 5 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n167\n10\n18\n![](https://substackcdn.com/image/fetch/$s_!r8Bx!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F168ff804-da03-4ce5-84be-4f3f7322ff70_2500x1404.png)\n### December 2025\n[Olmo 3 and the Open LLM Renaissance](https://cameronrwolfe.substack.com/p/olmo-3)\n[Fully-open artifacts with the potential to make LLM research a reality for anyone...](https://cameronrwolfe.substack.com/p/olmo-3)\nDec 15, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n85\n7\n14\n![](https://substackcdn.com/image/fetch/$s_!Ju4h!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4535661c-4484-4944-b8ac-6ab546ee3b3d_2483x1398.png)\n### November 2025\n[Group Relative Policy Optimization (GRPO)](https://cameronrwolfe.substack.com/p/grpo)\n[How the algorithm that teaches LLMs to reason actually works...](https://cameronrwolfe.substack.com/p/grpo)\nNov 24, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n136\n11\n14\n![](https://substackcdn.com/image/fetch/$s_!VeOQ!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff98b75b5-c615-4139-a045-ad9572f3cf9f_2008x1130.png)\n### October 2025\n[PPO for LLMs: A Guide for Normal People](https://cameronrwolfe.substack.com/p/ppo-llm)\n[Understanding the complex RL algorithm that gave us modern LLMs…](https://cameronrwolfe.substack.com/p/ppo-llm)\nOct 27, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n185\n13\n14\n![](https://substackcdn.com/image/fetch/$s_!BX2i!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F61f107c1-95cb-4438-84b9-8d87c9cdc04f_2502x1408.png)\n### September 2025\n[REINFORCE: Easy Online RL for LLMs](https://cameronrwolfe.substack.com/p/reinforce)\n[How to get the benefits of online RL without the complexity of PPO...](https://cameronrwolfe.substack.com/p/reinforce)\nSep 29, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n106\n11\n6\n![](https://substackcdn.com/image/fetch/$s_!7PHr!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa93eba44-8bc9-40ed-b91a-9e71797aea35_2484x1402.png)\n[Online versus Offline RL for LLMs](https://cameronrwolfe.substack.com/p/online-rl)\n[A deep dive into the online-offline performance gap in LLM alignment...](https://cameronrwolfe.substack.com/p/online-rl)\nSep 8, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n93\n4\n10\n![](https://substackcdn.com/image/fetch/$s_!zA4Q!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496476e6-d878-4cb2-9e11-948ac7e2e443_2240x1258.png)\n### August 2025\n[GPT-oss from the Ground Up](https://cameronrwolfe.substack.com/p/gpt-oss)\n[Everything you should know about OpenAI's new open-weight language models...](https://cameronrwolfe.substack.com/p/gpt-oss)\nAug 18, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n105\n14\n15\n![](https://substackcdn.com/image/fetch/$s_!zRzH!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e1fd6f8-4805-43c3-bfe4-5e66bd3983ca_2454x1378.png)\n### July 2025\n[Direct Preference Optimization (DPO)](https://cameronrwolfe.substack.com/p/direct-preference-optimization)\n[How to align LLMs with limited hardware and minimal complexity...](https://cameronrwolfe.substack.com/p/direct-preference-optimization)\nJul 28, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n142\n20\n11\n![](https://substackcdn.com/image/fetch/$s_!Hcxq!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdfcbd2e-ac10-4767-8a84-d54b07eeed2b_2488x1402.png)\n### June 2025\n[Reward Models](https://cameronrwolfe.substack.com/p/reward-models)\n[Modeling human preferences for LLMs in the age of reasoning models...](https://cameronrwolfe.substack.com/p/reward-models)\nJun 30, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n145\n13\n20\n![](https://substackcdn.com/image/fetch/$s_!qm0_!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f2dc466-5918-4e2d-9698-c2626e71089f_1988x1116.png)\n[AI Agents from First Principles](https://cameronrwolfe.substack.com/p/ai-agents)\n[Understanding AI agents by building upon the most basic concepts of LLMs...](https://cameronrwolfe.substack.com/p/ai-agents)\nJun 9, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n381\n26\n46\n![](https://substackcdn.com/image/fetch/$s_!IitU!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcee4a772-78a7-41b7-8cf1-4da233376ea6_2002x1122.png)\n### May 2025\n[A Guide for Debugging LLM Training Data](https://cameronrwolfe.substack.com/p/llm-debugging)\n[Data-centric techniques and tools that anyone should use when training an LLM...](https://cameronrwolfe.substack.com/p/llm-debugging)\nMay 19, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n89\n3\n13\n![](https://substackcdn.com/image/fetch/$s_!Ji6s!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F725f69ce-2f6f-4914-a797-01ace5b67332_2484x1380.png)\n### April 2025\n[Llama 4: The Challenges of Creating a Frontier-Level LLM](https://cameronrwolfe.substack.com/p/llama-4)\n[The full story behind Llama 4 and Meta's huge pivot in research strategy...](https://cameronrwolfe.substack.com/p/llama-4)\nApr 28, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n83\n2\n11\n![](https://substackcdn.com/image/fetch/$s_!KPTz!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4bd4b93b-9169-433e-bfa2-0613e8816420_2376x1332.png)\n### March 2025\n[Vision Large Language Models (vLLMs)](https://cameronrwolfe.substack.com/p/vision-llms)\n[Teaching LLMs to understand images and videos in addition to text...](https://cameronrwolfe.substack.com/p/vision-llms)\nMar 31, 2025 • [Cameron R. Wolfe, Ph.D.](https://substack.com/@cwolferesearch)\n156\n15\n14\n![](https://substackcdn.com/image/fetch/$s_!9PkX!,w_320,h_213,c_fill,f_auto,q_auto:good,fl_progressive:steep,g_center/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F12372b06-0850-4b33-b8a8-dd01dd5662fb_2208x1218.png)\n© 2026 Cameron R. Wolfe · [Privacy](https://substack.com/privacy) ∙ [Terms](https://substack.com/tos) ∙ [Collection notice](https://substack.com/ccpa#personal-data-collected)\n[ Start your Substack](https://substack.com/signup?utm_source=substack&utm_medium=web&utm_content=footer)[Get the app](https://substack.com/app/app-store-redirect?utm_campaign=app-marketing&utm_content=web-footer-button)\n[Substack](https://substack.com) is the home for great culture\n",
  "body_base_path": "attachments/991537c1e944/pages/",
  "body_markdown_path": "attachments/991537c1e944/pages/archived-body.md",
  "local_html": "attachments/991537c1e944/pages/archived-body.html",
  "body_source": "prior_capture"
}