{
  "source_file": "0930",
  "source_platform": "Substack",
  "author": "Exploring Language Models Maarten Grootendorst",
  "title_listed": "A Visual Guide to Mixture of Experts (MoE)",
  "keywords": "MoE,专家混合,架构",
  "domain": "大模型算法",
  "content_type": "深度技术解析",
  "is_paid_flag": "否",
  "url": "https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mixture-of-experts",
  "publish_date": "2024-05",
  "corpus_stage": "预训练/SFT",
  "notes": "MoE可视化指南",
  "id": "96393521b8b8",
  "collected_at": "2026-10-01T20:46:49",
  "title": "A Visual Guide to Mixture of Experts (MoE)",
  "body_markdown": "Translations\n-\nKorean\n-\nFrench\n-\nChinese\n| Also check out the\nYouTube\nversion with lots of animations!\nWhen looking at the latest releases of Large Language Models (LLMs), you will often see “\nMoE\n” in the title. What does this “\nMoE\n” represent and why are so many LLMs using it?\nIn this visual guide, we will take our time to explore this important component,\nMixture of Experts\n(MoE) through\nmore than 50 visualizations\n!\nIn this visual guide, we will go through the two main components of MoE, namely\nExperts\nand the\nRouter\n, as applied in typical LLM-based architectures.\nTo see a\nTable of Contents\n(ToC), click on the stack of lines on the left-hand side.\nThanks for reading\nExploring Language Models\n! Subscribe to receive new posts on\nGen AI\nand the book:\nHands-On Large Language Models\nSubscribe\nTo see more visualizations related to LLMs and to support this newsletter, check out the book I wrote on Large Language Models!\nOfficial website\nof the book. You can order the book on\nAmazon\n. All code is uploaded to\nGitHub\n.\nP.S. If you read the book, a\nquick review\nwould mean the world—it really helps us authors!\nWhat is Mixture of Experts?\nMixture of Experts (MoE) is a technique that uses many different sub-models (or “experts”) to improve the quality of LLMs.\nTwo main components define a MoE:\nExperts\n- Each FFNN layer now has a set of “experts” of which a subset can be chosen. These “experts” are typically FFNNs themselves.\nRouter\nor\ngate network\n- Determines which tokens are sent to which experts.\nIn each layer of an LLM with an MoE, we find (somewhat specialized) experts:\nKnow that an “expert” is not specialized in a specific domain like “Psychology” or “Biology”. At most, it learns syntactic information on a word level instead:\nMore specifically, their expertise is in handling specific tokens in specific contexts.\nThe\nrouter\n(gate network) selects the expert(s) best suited for a given input:\nEach expert is not an entire LLM but a submodel part of an LLM’s architecture.\nThe Experts\nTo explore what experts represent and how they work, let us first examine what MoE is supposed to replace; the\ndense layers\n.\nDense Layers\nMixture of Experts (MoE) all start from a relatively basic functionality of LLMs, namely the\nFeedforward Neural Network\n(FFNN).\nRemember that a standard decoder-only Transformer architecture has the FFNN applied after layer normalization:\nAn FFNN allows the model to use the contextual information created by the attention mechanism, transforming it further to capture more complex relationships in the data.\nThe FFNN, however, does grow quickly in size. To learn these complex relationships, it typically expands on the input it receives:\nSparse Layers\nThe FFNN in a traditional Transformer is called a\ndense\nmodel since all parameters (its weights and biases) are activated. Nothing is left behind and everything is used to calculate the output.\nIf we take a closer look at the dense model, notice how the input activates all parameters to some degree:\nIn contrast,\nsparse\nmodels only activate a portion of their total parameters and are closely related to Mixture of Experts.\nTo illustrate, we can chop up our dense model into pieces (so-called experts), retrain it, and only activate a subset of experts at a given time:\nThe underlying idea is that each expert learns different information during training. Then, when running inference, only specific experts are used as they are most relevant for a given task.\nWhen asked a question, we can select the expert best suited for a given task:\nWhat does an Expert Learn?\nAs we have seen before, experts learn more fine-grained information than entire domains.\n1\nAs such, calling them “experts” has sometimes been seen as misleading.\nExpert specialization of an encoder model in the ST-MoE paper.\nExperts in decoder models, however, do not seem to have the same type of specialization. That does not mean though that all experts are equal.\nA great example can be found in the\nMixtral 8x7B paper\nwhere each token is colored with the first expert choice.\nThis visual also demonstrates that experts tend to focus on syntax rather than a specific domain.\nThus, although decoder experts do not seem to have a specialism they do seem to be used consistently for certain types of tokens.\nThe Architecture of Experts\nAlthough it’s nice to visualize experts as a hidden layer of a dense model cut in pieces, they are often whole FFNNs themselves:\nSince most LLMs have several decoder blocks, a given text will pass through multiple experts before the text is generated:\nThe chosen experts likely differ between tokens which results in different “paths”  being taken:\nIf we update our visualization of the decoder block, it would now contain more FFNNs (one for each expert) instead:\nThe decoder block now has multiple FFNNs (each an “expert”) that it can use during inference.\nThe Routing Mechanism\nNow that we have a set of experts, how does the model know which experts to use?\nJust before the experts, a\nrouter\n(also called a\ngate network\n) is added which is trained to choose which expert to choose for a given token.\nThe Router\nThe\nrouter\n(or\ngate network\n) is also an FFNN and is used to choose the expert based on a particular input. It outputs probabilities which it uses to select the best matching expert:\nThe expert layer returns the output of the selected expert multiplied by the gate value (selection probabilities).\nThe router together with the experts (of which only a few are selected) makes up the\nMoE Layer\n:\nA given MoE layer comes in two sizes, either a\nsparse\nor a\ndense\nmixture of experts.\nBoth use a router to select experts but a Sparse MoE only selects a few whereas a Dense MoE selects them all but potentially in different distributions.\nFor instance, given a set of tokens, a MoE will distribute the tokens across all experts whereas a Sparse MoE will only select a few experts.\nIn the current state of LLMs, when you see a “MoE” it will typically be a Sparse MoE as it allows you to use a subset of experts. This is computationally cheaper which is an important trait for LLMs.\nSelection of Experts\nThe gating network is arguably the most important component of any MoE as it not only decides which experts to choose during\ninference\nbut also\ntraining\n.\nIn its most basic form, we multiply the input (\nx\n) by the router weight matrix (\nW)\n:\nThen, we apply a\nSoftMax\non the output to create a probability distribution\nG\n(\nx\n) per expert:\nThe router uses this probability distribution to choose the best matching expert for a given input.\nFinally, we multiply the output of each router with each selected expert and sum the results.\nLet’s put everything together and explore how the input flows through the router and experts:\nThe Complexity of Routing\nHowever, this simple function often results in the router choosing the same expert since certain experts might learn faster than others:\nNot only will there be an uneven distribution of experts chosen, but some experts will hardly be trained at all. This results in issues during both training and inference.\nInstead, we want equal importance among experts during training and inference, which we call\nload balancing\n. In a way, it’s to prevent overfitting on the same experts.\nLoad Balancing\nTo balance the importance of experts, we will need to look at the router as it is the main component to decide which experts to choose at a given time.\nKeepTopK\nOne method of load balancing the router is through a straightforward extension called\nKeepTopK\n2\n. By introducing trainable (gaussian) noise, we can prevent the same experts from always being picked:\nThen, all but the top k experts that you want activating (for example 2) will have their weights set to -∞\n:\nBy setting these weights to\n-∞\n, the output of the SoftMax on these weights will result in a probability of\n0\n:\nThe KeepTopK strategy is one that many LLMs still use despite many promising alternatives. Note that KeepTopK can also be used without the additional noise.\nToken Choice\nThe KeepTopK strategy routes each token to a few selected experts. This method is called\nToken Choice\n3\nand allows for a given token to be sent to one expert (\ntop-1 routing\n):\nor to more than one expert (top-k routing):\nA major benefit is that it allows the experts’ respective contributions to be weighed and integrated.\nAuxiliary Loss\nTo get a more even distribution of experts during training, the auxiliary loss (also called\nload balancing loss\n) was added to the network’s regular loss.\nIt adds a constraint that forces experts to have equal importance.\nThe first component of this auxiliary loss is to sum the router values for each expert over the entire batch:\nThis gives us the\nimportance scores\nper expert which represents how likely a given expert will be chosen regardless of the input.\nWe can use this to calculate the\ncoefficient variation\n(\nCV\n), which tells us how different the importance scores are between experts.\nFor instance, if there are a lot of differences in importance scores, the\nCV\nwill be high:\nIn contrast, if all experts have similar importance scores, the\nCV\nwill be low (which is what we aim for):\nUsing this\nCV\nscore, we can update the\nauxiliary\nloss\nduring training such that it aims to lower the\nCV\nscore as much as possible (\nthereby\ngiving equal importance to each expert\n):\nFinally, the auxiliary loss is added as a separate loss to optimize during training.\nExpert Capacity\nImbalance is not just found in the experts that were chosen but also in the distributions of tokens that are sent to the expert.\nFor instance, if input tokens are disproportionally sent to one expert over another then that might also result in undertraining:\nHere, it is not just about which experts are used but\nhow much\nthey are used.\nA solution to this problem is to limit the amount of tokens a given expert can handle, namely\nExpert Capacity\n4\n. By the time an expert has reached capacity, the resulting tokens will be sent to the next expert:\nIf both experts have reached their capacity, the token will not be processed by any expert but instead sent to the next layer. This is referred to as\ntoken overflow\n.\nSimplifying MoE with the Switch Transformer\nOne of the first transformer-based MoE models that dealt with the training instability issues of MoE (such as load balancing) is the Switch Transformer.\n5\nIt simplifies much of the architecture and training procedure while increasing training stability.\nThe Switching Layer\nThe Switch Transformer is a T5 model (encoder-decoder) that replaces the traditional FFNN layer with a Switching Layer. The Switching Layer is a Sparse MoE layer that selects a single expert for each token (\nTop-1 routing\n).\nThe router does no special tricks for calculating which expert to choose and takes the softmax of the input multiplied by the expert’s weights (same as we did previously).\nThis architecture (\ntop-1 routing\n) assumes that only 1 expert is needed for the router to learn how to route the input. This is in contrast to what we have seen previously where we assumed that tokens should be routed to multiple experts (\ntop-k routing\n) to learn the routing behavior.\nCapacity Factor\nThe capacity factor is an important value as it determines how many tokens an expert can process. The Switch Transformer extends upon this by introducing a\ncapacity factor\ndirectly influencing the expert capacity.\nThe components of expert capacity are straightforward:\nIf we increase the capacity factor each expert will be able to process more tokens.\nHowever, if the capacity factor is too large, we waste computing resources. In contrast, if the capacity factor is too small, the model performance will drop due to\ntoken overflow\n.\nAuxiliary Loss\nTo further prevent dropping tokens a simplified version of auxiliary loss was introduced.\nInstead of calculating the coefficient variation, this simplified loss weighs the fraction of tokens dispatched against the fraction of router probability per expert:\nSince the goal is to get a uniform routing of tokens across the\nN\nexperts, we want vectors\nP\nand\nf\nto have values of 1/\nN\n.\nα\nis a hyperparameter that we can use to fine-tune the importance of this loss during training. Too high values will overtake the primary loss function and too low values will do little for load balancing.\nMixture of Experts in Vision Models\nMoE is not a technique that is only available to language models. Vision models (such as ViT) leverage transformer-based architectures and therefore have the potential to use MoE.\nAs a quick recap, ViT (Vision-Transformer) is an architecture that splits images into patches that are processed similarly to tokens.\n6\nThese patches (or tokens) are then projected into embeddings (with additional positional embeddings) before being fed into a regular encoder:\nThe moment these patches enter the encoder, they are processed like tokens which makes this architecture leverage itself well for MoE.\nVision-MoE\nVision-MoE (V-MoE) is one of the first implementations of MoE in an image model.\n7\nIt takes the ViT as we saw before and replaces the dense FFNN in the encoder with a Sparse MoE.\nThis allows ViT models, typically smaller in size than language models, to be massively scaled by adding experts.\nA small pre-defined expert capacity was used for each expert to reduce hardware constraints since images generally have many patches. However, a low capacity tends to lead to patches being dropped (akin to\ntoken overflow\n).\nTo keep the capacity low, the network assigns importance scores to patches and processes those first so that overflowed patches are generally less important. This is called Batch\nPriority Routing\n.\nAs a result, we should still see important patches routed if the percentage of tokens decreases.\nThe priority routing allows fewer patches to be processed by focusing on the most important ones.\nFrom Sparse to Soft MoE\nIn V-MoE, the priority scorer helps differentiate between more and less important patches. However, patches are assigned to each expert, and information in unprocessed patches is lost.\nSoft-MoE aims to go from a discrete to a soft patch (token) assignment by mixing patches.\n8\nIn the first step, we multiply the input\nx\n(the patch embeddings) with a learnable matrix Φ. This gives us\nrouter information\nwhich tells us how related a certain token is to a given expert.\nBy then taking the softmax of the router information matrix (on the columns), we update the embeddings of each patch.\nThe updated patch embeddings are essentially the weighted average of all patch embeddings.\nVisually, it is as if all patches were mixed. These combined patches are then sent to each expert. After generating the output, they are again multiplied with the router matrix.\nThe router matrix affects the input on a token level and the output on an expert level.\nAs a result, we get “soft” patches/tokens that are processed instead of discrete input.\nActive vs. Sparse Parameters with Mixtral 8x7B\nA big part of what makes MoE interesting is its computational requirements. Since only a subset of experts are used at a given time, we have access to more parameters than we are using.\nAlthough a given MoE has more parameters to load (\nsparse parameters\n), fewer are activated since we only use some experts during inference (\nactive parameters\n).\nIn other words, we still need to load the entire model (including all experts) onto your device (\nsparse parameters\n) but when we run inference, we only need to use a subset (\nactive parameters\n). MoE models need more VRAM to load in all experts but run faster during inference.\nLet’s explore the number of sparse vs active parameters with an example, Mixtral 8x7B.\n9\nHere, we can see that each expert is\n5.6B\nin size and not 7B (although there are 8 experts).\nWe will have to\nload\n8x5.6B (\n46.7B\n)\nparameters (along with all shared parameters) but we only need to use\n2x5.6B (\n12.8B\n)\nparameters for\ninference\n.\nConclusion\nThis concludes our journey with a Mixture of Experts! Hopefully, this post gives you a better understanding of the potential of this interesting technique. Now that almost all sets of models contain at least one MoE variant, it feels like it is here to stay.\nTo see more visualizations related to LLMs and to support this newsletter, check out the book I wrote on Large Language Models!\nOfficial website\nof the book. You can order the book on\nAmazon\n. All code is uploaded to\nGitHub\n.\nResources\nHopefully, this was an accessible introduction to Mixture of Experts. If you want to go deeper, I would suggest the following resources:\nThis\nand\nthis\npaper are great overviews of the latest MoE innovations.\nThe paper on\nexpert choice routing\nthat has gained some traction.\nA\ngreat blog post\ngoing through some of the major papers (and their findings).\nA similar\nblog post\nthat goes through the timeline of MoE.\n1\nZoph, Barret, et al. \"St-moe: Designing stable and transferable sparse expert models. arXiv 2022.\"\narXiv preprint arXiv:2202.08906\n.\n2\nShazeer, Noam, et al. \"Outrageously large neural networks: The sparsely-gated mixture-of-experts layer.\"\narXiv preprint arXiv:1701.06538\n(2017).\n3\nShazeer, Noam, et al. \"Outrageously large neural networks: The sparsely-gated mixture-of-experts layer.\"\narXiv preprint arXiv:1701.06538\n(2017).\n4\nLepikhin, Dmitry, et al. \"Gshard: Scaling giant models with conditional computation and automatic sharding.\"\narXiv preprint arXiv:2006.16668\n(2020).\n5\nFedus, William, Barret Zoph, and Noam Shazeer. \"Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity.\"\nJournal of Machine Learning Research\n23.120 (2022): 1-39.\n6\nDosovitskiy, Alexey. \"An image is worth 16x16 words: Transformers for image recognition at scale.\"\narXiv preprint arXiv:2010.11929\n(2020).\n7\nRiquelme, Carlos, et al. \"Scaling vision with sparse mixture of experts.\"\nAdvances in Neural Information Processing Systems\n34 (2021): 8583-8595.\n8\nPuigcerver, Joan, et al. \"From sparse to soft mixtures of experts.\"\narXiv preprint arXiv:2308.00951\n(2023).\n9\nJiang, Albert Q., et al. \"Mixtral of experts.\"\narXiv preprint arXiv:2401.04088\n(2024).",
  "metadata": {
    "title": "A Visual Guide to Mixture of Experts (MoE)",
    "description": "Demystifying the role of Mixture of Experts (MoE) in Large Language Models (LLMs) with over 50 illustrations.",
    "keywords": null,
    "author": "Maarten Grootendorst",
    "og:type": "article",
    "og:title": "A Visual Guide to Mixture of Experts (MoE)",
    "og:description": "Demystifying the role of MoE in Large Language Models",
    "og:image": "https://substackcdn.com/image/fetch/$s_!o-PE!,w_1200,h_675,c_fill,f_jpg,q_auto:good,fl_progressive:steep,g_auto/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a9eba8-8490-4959-8cda-f0855af65d67_1360x972.png",
    "og:url": "https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mixture-of-experts",
    "twitter:title": "A Visual Guide to Mixture of Experts (MoE)",
    "twitter:description": "Demystifying the role of MoE in Large Language Models",
    "twitter:image": "https://substackcdn.com/image/fetch/$s_!Wpsm!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Fmaartengrootendorst.substack.com%2Fapi%2Fv1%2Fpost_preview%2F148217245%2Ftwitter.jpg%3Fversion%3D4",
    "twitter:card": "summary_large_image",
    "article:modified_time": "2025-07-01T07:02:47.993Z"
  },
  "paywall": {
    "listed_paid": false,
    "detected": false,
    "marker": "",
    "public_only": false,
    "policy": "付费/会员内容只保留页面公开可见部分，不绕过付费墙"
  },
  "crawl": {
    "success": true,
    "status_code": 200,
    "error": ""
  },
  "code_blocks": [],
  "images": [
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!o-PE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a9eba8-8490-4959-8cda-f0855af65d67_1360x972.png",
      "bytes": 18090,
      "reused": true,
      "local_path": "attachments/96393521b8b8/images/039.png",
      "src": "https://substackcdn.com/image/fetch/$s_!o-PE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a9eba8-8490-4959-8cda-f0855af65d67_1360x972.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!MdLW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0b260f5-da52-4186-bc06-fd22077b2737_590x768.jpeg",
      "bytes": 57995,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-37a6e30fd6cc6a216913.jpeg",
      "src": "https://substackcdn.com/image/fetch/$s_!MdLW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0b260f5-da52-4186-bc06-fd22077b2737_590x768.jpeg",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!--9T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7931367a-a4a0-47ac-b363-62907cd6291c_1460x356.png",
      "bytes": 62396,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-e769d904800cb981da28.png",
      "src": "https://substackcdn.com/image/fetch/$s_!--9T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7931367a-a4a0-47ac-b363-62907cd6291c_1460x356.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!GNME!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6a81780-27c8-45f8-bccc-cc8f1ce3e943_1460x252.png",
      "bytes": 64750,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-3f0639d8d0bccc730f49.png",
      "src": "https://substackcdn.com/image/fetch/$s_!GNME!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc6a81780-27c8-45f8-bccc-cc8f1ce3e943_1460x252.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!4NiQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6a623a4-fdbc-4abf-883b-3c2679b4ad4d_1460x640.png",
      "bytes": 101970,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-e231982cfa37a4e2009d.png",
      "src": "https://substackcdn.com/image/fetch/$s_!4NiQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6a623a4-fdbc-4abf-883b-3c2679b4ad4d_1460x640.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!SOKY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4729d2a-a51a-4224-93fe-c5674b9b38eb_1460x800.png",
      "bytes": 189810,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-eb0cc2f4b1444b261b66.png",
      "src": "https://substackcdn.com/image/fetch/$s_!SOKY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4729d2a-a51a-4224-93fe-c5674b9b38eb_1460x800.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!YGa3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F091ec102-45f0-4456-9e0a-7218a49e01df_1460x732.png",
      "bytes": 185263,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-3365e7ae26988ddeef29.png",
      "src": "https://substackcdn.com/image/fetch/$s_!YGa3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F091ec102-45f0-4456-9e0a-7218a49e01df_1460x732.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!fE65!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F101e8ddc-9aa7-4e24-92fc-78d25da73399_880x656.png",
      "bytes": 26123,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-d5f5ea20c91ea722abef.png",
      "src": "https://substackcdn.com/image/fetch/$s_!fE65!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F101e8ddc-9aa7-4e24-92fc-78d25da73399_880x656.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!7R1U!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc4eeaf8-166b-419f-896c-463498af5692_880x656.png",
      "bytes": 29848,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-d5bc272d61b34eda6243.png",
      "src": "https://substackcdn.com/image/fetch/$s_!7R1U!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc4eeaf8-166b-419f-896c-463498af5692_880x656.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!bmV0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce63e5cc-9b82-45b4-b3dc-9db0cac47da3_880x748.png",
      "bytes": 41042,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-2e4876a3d4fcde968420.png",
      "src": "https://substackcdn.com/image/fetch/$s_!bmV0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce63e5cc-9b82-45b4-b3dc-9db0cac47da3_880x748.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!u8o5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04123f9e-b798-4712-bcfb-70a26438f3b9_2240x1588.png",
      "bytes": 234457,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-2b84b05cee544bbbe474.png",
      "src": "https://substackcdn.com/image/fetch/$s_!u8o5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04123f9e-b798-4712-bcfb-70a26438f3b9_2240x1588.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!guHK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd03e32b4-5830-4d98-8514-0c1a28127ed9_1028x420.png",
      "bytes": 78628,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-ff3fa82151dac29d695a.png",
      "src": "https://substackcdn.com/image/fetch/$s_!guHK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd03e32b4-5830-4d98-8514-0c1a28127ed9_1028x420.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!dNL3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe51561eb-f3d6-45ca-a2f8-c71abfa7c2a9_880x748.png",
      "bytes": 21269,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-d0115d59078d0b8c32fa.png",
      "src": "https://substackcdn.com/image/fetch/$s_!dNL3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe51561eb-f3d6-45ca-a2f8-c71abfa7c2a9_880x748.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Xs0T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F89b1caad-5201-43fe-b7de-04ebe877eb2d_1196x836.png",
      "bytes": 33973,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-3ad4e0f34bee2566d5bb.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Xs0T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F89b1caad-5201-43fe-b7de-04ebe877eb2d_1196x836.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Z27D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcde4794d-8b3e-454d-9a1c-88c1999fdd45_1372x932.png",
      "bytes": 56203,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-5381a194333dae90fc63.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Z27D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcde4794d-8b3e-454d-9a1c-88c1999fdd45_1372x932.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!7Tla!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb97a8ac7-db97-497f-866d-10400729d51e_1248x764.png",
      "bytes": 27897,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-b41dc81dd69859a99725.png",
      "src": "https://substackcdn.com/image/fetch/$s_!7Tla!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb97a8ac7-db97-497f-866d-10400729d51e_1248x764.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!K5Xp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Facc49abf-bc55-45fd-9697-99c9434087d0_864x916.png",
      "bytes": 22850,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-97ea922e0971646e5174.png",
      "src": "https://substackcdn.com/image/fetch/$s_!K5Xp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Facc49abf-bc55-45fd-9697-99c9434087d0_864x916.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!U_7N!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa6fcabc6-78cd-477f-ac4e-2260cb06e230_1160x688.png",
      "bytes": 21997,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-67eea7ff0fcedb8976d4.png",
      "src": "https://substackcdn.com/image/fetch/$s_!U_7N!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa6fcabc6-78cd-477f-ac4e-2260cb06e230_1160x688.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Ofa6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46aadf17-3afe-4c98-b57c-83b7b38918b2_1004x720.png",
      "bytes": 17087,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-93a4e17780c01c64457e.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Ofa6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46aadf17-3afe-4c98-b57c-83b7b38918b2_1004x720.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!rutb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58234ce0-bf96-49ab-b414-674a710a1c3c_1164x368.png",
      "bytes": 15357,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-50fd2424b3d7f0bd2fe2.png",
      "src": "https://substackcdn.com/image/fetch/$s_!rutb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58234ce0-bf96-49ab-b414-674a710a1c3c_1164x368.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!SC8j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb888a32f-acef-4fff-9d4b-cc70e148a8f2_1164x384.png",
      "bytes": 22224,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-42fd6df7ab4503cf39ef.png",
      "src": "https://substackcdn.com/image/fetch/$s_!SC8j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb888a32f-acef-4fff-9d4b-cc70e148a8f2_1164x384.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!6sXB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6e46ea4-dbd4-4cc4-aa2b-2c5474917f31_1164x464.png",
      "bytes": 34593,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-16c400f3686e592df817.png",
      "src": "https://substackcdn.com/image/fetch/$s_!6sXB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6e46ea4-dbd4-4cc4-aa2b-2c5474917f31_1164x464.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!7ajO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5d24a0b-2d78-4c69-b6fe-d75ba34bdd0c_2080x2240.png",
      "bytes": 54983,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-a7bc694dd528a0dbb19b.png",
      "src": "https://substackcdn.com/image/fetch/$s_!7ajO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5d24a0b-2d78-4c69-b6fe-d75ba34bdd0c_2080x2240.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!wqYK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3d1122aa-7248-47d0-8e01-caa941ce0aa9_2080x2240.png",
      "bytes": 58711,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-3f7bb7164671639be1a9.png",
      "src": "https://substackcdn.com/image/fetch/$s_!wqYK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3d1122aa-7248-47d0-8e01-caa941ce0aa9_2080x2240.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!ZTBl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9233733c-c152-428a-ae99-1ed185fc3d50_1164x660.png",
      "bytes": 26550,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-7b179be26e91ca97ddff.png",
      "src": "https://substackcdn.com/image/fetch/$s_!ZTBl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9233733c-c152-428a-ae99-1ed185fc3d50_1164x660.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!7VGM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1b95b020-ae34-40f0-a5c4-9542343beea9_1164x412.png",
      "bytes": 27940,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-6aa55140fa48d9b69675.png",
      "src": "https://substackcdn.com/image/fetch/$s_!7VGM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1b95b020-ae34-40f0-a5c4-9542343beea9_1164x412.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!9wtR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F66bea40e-3fb0-4937-88d5-2852af456cf3_1164x488.png",
      "bytes": 28089,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-88c55ae1b8edfd9cd983.png",
      "src": "https://substackcdn.com/image/fetch/$s_!9wtR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F66bea40e-3fb0-4937-88d5-2852af456cf3_1164x488.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!MGk6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F687d2279-1d8b-4af1-b55e-55d618ee877f_1164x496.png",
      "bytes": 32381,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-7737744581831b783bf2.png",
      "src": "https://substackcdn.com/image/fetch/$s_!MGk6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F687d2279-1d8b-4af1-b55e-55d618ee877f_1164x496.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!fl3F!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a9988-d4c8-4b1b-a968-073a6b3bfc6a_1004x648.png",
      "bytes": 15153,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-dacd38f3d51860caa1fa.png",
      "src": "https://substackcdn.com/image/fetch/$s_!fl3F!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a9988-d4c8-4b1b-a968-073a6b3bfc6a_1004x648.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Ps3o!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb3f283f1-c359-4baf-8d01-8ebb2a90665f_1004x720.png",
      "bytes": 17764,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-eb81fcc02c0e8ac1d03e.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Ps3o!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb3f283f1-c359-4baf-8d01-8ebb2a90665f_1004x720.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!9DwH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3624da0-3137-42ba-95e8-88fcbddb5f9f_1108x288.png",
      "bytes": 24785,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-4d90b673f1c25131ccb5.png",
      "src": "https://substackcdn.com/image/fetch/$s_!9DwH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3624da0-3137-42ba-95e8-88fcbddb5f9f_1108x288.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!d3cI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94def8dc-2a65-4a02-855f-219f0df2a119_916x128.png",
      "bytes": 12191,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-aec9ab64bb3a90f0f2f7.png",
      "src": "https://substackcdn.com/image/fetch/$s_!d3cI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F94def8dc-2a65-4a02-855f-219f0df2a119_916x128.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!S63p!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab71b90c-ba29-42a9-944b-3dee52fc5c32_916x372.png",
      "bytes": 18874,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-382a71feddee1f4737c8.png",
      "src": "https://substackcdn.com/image/fetch/$s_!S63p!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab71b90c-ba29-42a9-944b-3dee52fc5c32_916x372.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!hc-d!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5cb91ac-4aab-4eb5-80bf-84e2bd4dc576_916x324.png",
      "bytes": 18267,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-e8547368add244bd0a40.png",
      "src": "https://substackcdn.com/image/fetch/$s_!hc-d!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5cb91ac-4aab-4eb5-80bf-84e2bd4dc576_916x324.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!vU-f!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4aac801-af89-44e7-aaea-c57a55ff282c_916x312.png",
      "bytes": 25832,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-b3bb2987206010a1b745.png",
      "src": "https://substackcdn.com/image/fetch/$s_!vU-f!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4aac801-af89-44e7-aaea-c57a55ff282c_916x312.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!rZmG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F749eac8e-36e5-450f-a6fc-fbe48b7a1312_1004x484.png",
      "bytes": 13627,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-7251c9315f72ad45591a.png",
      "src": "https://substackcdn.com/image/fetch/$s_!rZmG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F749eac8e-36e5-450f-a6fc-fbe48b7a1312_1004x484.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!44Xf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf67563f-755a-47a7-bebc-c1ac81a01f8f_1004x568.png",
      "bytes": 18603,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-53961adf86549cc31d9b.png",
      "src": "https://substackcdn.com/image/fetch/$s_!44Xf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf67563f-755a-47a7-bebc-c1ac81a01f8f_1004x568.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!CsiT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe92ce4c5-affa-454d-8fd2-4debf9a08ce2_1004x544.png",
      "bytes": 18412,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-20ade02ba22c971f4fe7.png",
      "src": "https://substackcdn.com/image/fetch/$s_!CsiT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe92ce4c5-affa-454d-8fd2-4debf9a08ce2_1004x544.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!SsAV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F024d1788-9007-4953-9bf7-883da0db7f8d_1160x688.png",
      "bytes": 22339,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-2149ea06a1d8ffe8ee7c.png",
      "src": "https://substackcdn.com/image/fetch/$s_!SsAV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F024d1788-9007-4953-9bf7-883da0db7f8d_1160x688.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Lk3v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0758a7f-e26b-44b9-9d75-80ac6caa9802_1104x384.png",
      "bytes": 26923,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-b78decffa25b1a5fcf89.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Lk3v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0758a7f-e26b-44b9-9d75-80ac6caa9802_1104x384.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Aqb-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22715139-3955-4e00-bed7-c45cffa52744_964x128.png",
      "bytes": 12990,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-fda3a384f4dde36f66fb.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Aqb-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F22715139-3955-4e00-bed7-c45cffa52744_964x128.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!FTrV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4b399c6-723b-4de6-94ca-7020cd1bb181_908x380.png",
      "bytes": 25077,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-9e1b88cfb4070e508e8d.png",
      "src": "https://substackcdn.com/image/fetch/$s_!FTrV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4b399c6-723b-4de6-94ca-7020cd1bb181_908x380.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!U4FT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2aea0-fddf-4a43-ac79-7c5e5194c115_1240x472.png",
      "bytes": 21673,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-7aa5d6d838c3a0d31e2d.png",
      "src": "https://substackcdn.com/image/fetch/$s_!U4FT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2aea0-fddf-4a43-ac79-7c5e5194c115_1240x472.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!ezjV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608da44a-7510-4ab6-97c9-e8ab212a567d_836x388.png",
      "bytes": 29154,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-840bb7765b7ab034050f.png",
      "src": "https://substackcdn.com/image/fetch/$s_!ezjV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608da44a-7510-4ab6-97c9-e8ab212a567d_836x388.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!zgwf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b64fce-4069-4c73-995d-c3059fda0dcc_1300x828.png",
      "bytes": 99725,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-d953a800b2692b531638.png",
      "src": "https://substackcdn.com/image/fetch/$s_!zgwf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b64fce-4069-4c73-995d-c3059fda0dcc_1300x828.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!n9BH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0b2ea60-238b-446a-ab59-503efb6ca061_1228x1232.png",
      "bytes": 174727,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-105b27d2073ed29aef48.png",
      "src": "https://substackcdn.com/image/fetch/$s_!n9BH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0b2ea60-238b-446a-ab59-503efb6ca061_1228x1232.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!7CLL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10e9721d-4b3f-4062-ad72-97ffd1049077_1160x944.png",
      "bytes": 107288,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-f8b0e1c3794a1c2b22da.png",
      "src": "https://substackcdn.com/image/fetch/$s_!7CLL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10e9721d-4b3f-4062-ad72-97ffd1049077_1160x944.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!KVXp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F219141c9-51ff-4d85-9f8a-c705c6e9ece4_1720x744.png",
      "bytes": 111673,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-3b1d5369086581e51eed.png",
      "src": "https://substackcdn.com/image/fetch/$s_!KVXp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F219141c9-51ff-4d85-9f8a-c705c6e9ece4_1720x744.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!L60n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0ef5323-4b4c-4ee7-8a53-51fbe4213283_1720x772.png",
      "bytes": 123871,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-1375f43800a1f4e3099b.png",
      "src": "https://substackcdn.com/image/fetch/$s_!L60n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0ef5323-4b4c-4ee7-8a53-51fbe4213283_1720x772.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!Jvhj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65f972b9-640b-4a76-b77d-2d2ef1b40609_1736x420.png",
      "bytes": 82199,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-7c97a0e2beabb65ab319.png",
      "src": "https://substackcdn.com/image/fetch/$s_!Jvhj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F65f972b9-640b-4a76-b77d-2d2ef1b40609_1736x420.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!VZYh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F644c0c1c-24d3-491b-a9a2-fdd9658ad589_1032x516.png",
      "bytes": 43553,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-6bd0889731769a3726fe.png",
      "src": "https://substackcdn.com/image/fetch/$s_!VZYh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F644c0c1c-24d3-491b-a9a2-fdd9658ad589_1032x516.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!XWFx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6c3187d8-5bf2-4c73-8c22-547107fe1152_1032x456.png",
      "bytes": 40037,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-dffa8feb2789b68348bd.png",
      "src": "https://substackcdn.com/image/fetch/$s_!XWFx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6c3187d8-5bf2-4c73-8c22-547107fe1152_1032x456.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!TaCn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7cfeb30a-1b04-4b9a-8f5a-d3c5d47e6499_1376x400.png",
      "bytes": 46808,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-ddb443fcace75ba005d7.png",
      "src": "https://substackcdn.com/image/fetch/$s_!TaCn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7cfeb30a-1b04-4b9a-8f5a-d3c5d47e6499_1376x400.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!cbz7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86020d75-c881-4418-82a6-a228f091abe8_808x844.png",
      "bytes": 65149,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-d00ea1d67dac2df1f8a1.png",
      "src": "https://substackcdn.com/image/fetch/$s_!cbz7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86020d75-c881-4418-82a6-a228f091abe8_808x844.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!AMdO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe1fd47bb-9ced-42e4-8f6c-536f7a65fbf7_1376x1252.png",
      "bytes": 89088,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-a126dc43f64aa051959a.png",
      "src": "https://substackcdn.com/image/fetch/$s_!AMdO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe1fd47bb-9ced-42e4-8f6c-536f7a65fbf7_1376x1252.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!j84T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc3d48d5-8afc-4477-af98-5817b1a145ae_1376x988.png",
      "bytes": 138033,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-496bded3a7cb514fe533.png",
      "src": "https://substackcdn.com/image/fetch/$s_!j84T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc3d48d5-8afc-4477-af98-5817b1a145ae_1376x988.png",
      "alt": "",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://substackcdn.com/image/fetch/$s_!824b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1dfd20b4-d3b7-433b-8072-2e67fc70afaa_1376x544.png",
      "bytes": 29422,
      "reused": false,
      "local_path": "attachments/96393521b8b8/images/body-96765ee3ed134a26e30c.png",
      "src": "https://substackcdn.com/image/fetch/$s_!824b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1dfd20b4-d3b7-433b-8072-2e67fc70afaa_1376x544.png",
      "alt": "",
      "downloaded": true
    }
  ],
  "audio": [],
  "videos": [
    {
      "url": "https://www.youtube.com/watch?v=sOPDGQjFcuM",
      "status": "ok",
      "local_path": "attachments/96393521b8b8/videos/sOPDGQjFcuM.mp4",
      "bytes": 57369134,
      "valid": true,
      "height": 1080,
      "width": 1920,
      "duration": "1183.661000"
    }
  ],
  "links": [
    {
      "href": "https://tulip-phalange-a1e.notion.site/Mixture-of-Experts-MoE-11ac32470be28055bcc6cd4a78b26243",
      "label": "Korean",
      "type": "a"
    },
    {
      "href": "https://lbourdois.github.io/blog/MoE/",
      "label": "French",
      "type": "a"
    },
    {
      "href": "https://blog.csdn.net/qq_36667170/article/details/148955499",
      "label": "Chinese",
      "type": "a"
    },
    {
      "href": "https://www.youtube.com/watch?v=sOPDGQjFcuM",
      "label": "YouTube",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!o-PE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a9eba8-8490-4959-8cda-f0855af65d67_1360x972.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://github.com/HandsOnLLM/Hands-On-Large-Language-Models",
      "label": "Hands-On Large Language Models",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!MdLW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0b260f5-da52-4186-bc06-fd22077b2737_590x768.jpeg",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://www.llm-book.com/",
      "label": "Official website",
      "type": "a"
    },
    {
      "href": "https://www.amazon.com/Hands-Large-Language-Models-Understanding/dp/1098150961",
      "label": "Amazon",
      "type": "a"
    },
    {
      "href": "https://github.com/handsOnLLM/Hands-On-Large-Language-Models",
      "label": "GitHub",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!4NiQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6a623a4-fdbc-4abf-883b-3c2679b4ad4d_1460x640.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!SOKY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4729d2a-a51a-4224-93fe-c5674b9b38eb_1460x800.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!YGa3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F091ec102-45f0-4456-9e0a-7218a49e01df_1460x732.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!fE65!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F101e8ddc-9aa7-4e24-92fc-78d25da73399_880x656.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!7R1U!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc4eeaf8-166b-419f-896c-463498af5692_880x656.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!bmV0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce63e5cc-9b82-45b4-b3dc-9db0cac47da3_880x748.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!u8o5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F04123f9e-b798-4712-bcfb-70a26438f3b9_2240x1588.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://arxiv.org/pdf/2401.04088",
      "label": "Mixtral 8x7B paper",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!guHK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd03e32b4-5830-4d98-8514-0c1a28127ed9_1028x420.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!dNL3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe51561eb-f3d6-45ca-a2f8-c71abfa7c2a9_880x748.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!Xs0T!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F89b1caad-5201-43fe-b7de-04ebe877eb2d_1196x836.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!Z27D!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcde4794d-8b3e-454d-9a1c-88c1999fdd45_1372x932.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!7Tla!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb97a8ac7-db97-497f-866d-10400729d51e_1248x764.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!K5Xp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Facc49abf-bc55-45fd-9697-99c9434087d0_864x916.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!U_7N!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa6fcabc6-78cd-477f-ac4e-2260cb06e230_1160x688.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!Ofa6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F46aadf17-3afe-4c98-b57c-83b7b38918b2_1004x720.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!rutb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58234ce0-bf96-49ab-b414-674a710a1c3c_1164x368.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!SC8j!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb888a32f-acef-4fff-9d4b-cc70e148a8f2_1164x384.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!6sXB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6e46ea4-dbd4-4cc4-aa2b-2c5474917f31_1164x464.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!7ajO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5d24a0b-2d78-4c69-b6fe-d75ba34bdd0c_2080x2240.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!wqYK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3d1122aa-7248-47d0-8e01-caa941ce0aa9_2080x2240.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!ZTBl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9233733c-c152-428a-ae99-1ed185fc3d50_1164x660.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://arxiv.org/pdf/1701.06538",
      "label": "KeepTopK",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!7VGM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1b95b020-ae34-40f0-a5c4-9542343beea9_1164x412.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!9wtR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F66bea40e-3fb0-4937-88d5-2852af456cf3_1164x488.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!MGk6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F687d2279-1d8b-4af1-b55e-55d618ee877f_1164x496.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!fl3F!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf7a9988-d4c8-4b1b-a968-073a6b3bfc6a_1004x648.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!Ps3o!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb3f283f1-c359-4baf-8d01-8ebb2a90665f_1004x720.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!9DwH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3624da0-3137-42ba-95e8-88fcbddb5f9f_1108x288.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!S63p!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab71b90c-ba29-42a9-944b-3dee52fc5c32_916x372.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!hc-d!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5cb91ac-4aab-4eb5-80bf-84e2bd4dc576_916x324.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!vU-f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4aac801-af89-44e7-aaea-c57a55ff282c_916x312.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!rZmG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F749eac8e-36e5-450f-a6fc-fbe48b7a1312_1004x484.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!44Xf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdf67563f-755a-47a7-bebc-c1ac81a01f8f_1004x568.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!CsiT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe92ce4c5-affa-454d-8fd2-4debf9a08ce2_1004x544.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!SsAV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F024d1788-9007-4953-9bf7-883da0db7f8d_1160x688.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!Lk3v!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0758a7f-e26b-44b9-9d75-80ac6caa9802_1104x384.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!FTrV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4b399c6-723b-4de6-94ca-7020cd1bb181_908x380.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!U4FT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2aea0-fddf-4a43-ac79-7c5e5194c115_1240x472.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!ezjV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608da44a-7510-4ab6-97c9-e8ab212a567d_836x388.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!zgwf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11b64fce-4069-4c73-995d-c3059fda0dcc_1300x828.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!n9BH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0b2ea60-238b-446a-ab59-503efb6ca061_1228x1232.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!7CLL!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F10e9721d-4b3f-4062-ad72-97ffd1049077_1160x944.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!KVXp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F219141c9-51ff-4d85-9f8a-c705c6e9ece4_1720x744.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!L60n!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa0ef5323-4b4c-4ee7-8a53-51fbe4213283_1720x772.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!VZYh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F644c0c1c-24d3-491b-a9a2-fdd9658ad589_1032x516.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!XWFx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6c3187d8-5bf2-4c73-8c22-547107fe1152_1032x456.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!TaCn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7cfeb30a-1b04-4b9a-8f5a-d3c5d47e6499_1376x400.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!cbz7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86020d75-c881-4418-82a6-a228f091abe8_808x844.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!AMdO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe1fd47bb-9ced-42e4-8f6c-536f7a65fbf7_1376x1252.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!j84T!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc3d48d5-8afc-4477-af98-5817b1a145ae_1376x988.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://substackcdn.com/image/fetch/$s_!824b!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1dfd20b4-d3b7-433b-8072-2e67fc70afaa_1376x544.png",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://arxiv.org/pdf/2209.01667",
      "label": "This",
      "type": "a"
    },
    {
      "href": "https://arxiv.org/pdf/2407.06204",
      "label": "this",
      "type": "a"
    },
    {
      "href": "https://arxiv.org/pdf/2202.09368",
      "label": "expert choice routing",
      "type": "a"
    },
    {
      "href": "https://cameronrwolfe.substack.com/p/conditional-computation-the-birth",
      "label": "great blog post",
      "type": "a"
    },
    {
      "href": "https://brunomaga.github.io/Mixture-of-Experts",
      "label": "blog post",
      "type": "a"
    }
  ],
  "repair_version": 2,
  "repaired_at": "2026-10-14T10:47:33Z",
  "source_url": "https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mixture-of-experts",
  "papers": [
    {
      "status": "ok",
      "url": "https://arxiv.org/pdf/2401.04088",
      "bytes": 2475990,
      "reused": true,
      "local_path": "papers/repair/041bf1008157bd282f03.pdf"
    },
    {
      "status": "ok",
      "url": "https://arxiv.org/pdf/1701.06538",
      "bytes": 544288,
      "reused": false,
      "local_path": "papers/repair/f715adc72d48cc7ef55f.pdf"
    },
    {
      "status": "ok",
      "url": "https://arxiv.org/pdf/2209.01667",
      "bytes": 3918653,
      "reused": false,
      "local_path": "papers/repair/ee0b2579a7395de9f54c.pdf"
    },
    {
      "status": "ok",
      "url": "https://arxiv.org/pdf/2407.06204",
      "bytes": 1501763,
      "reused": false,
      "local_path": "papers/repair/4b8646e5aa97363b8282.pdf"
    },
    {
      "status": "ok",
      "url": "https://arxiv.org/pdf/2202.09368",
      "bytes": 605773,
      "reused": false,
      "local_path": "papers/repair/d8e47d8172aa52a16403.pdf"
    }
  ],
  "actual_video_files": [
    {
      "local_path": "attachments/96393521b8b8/videos/sOPDGQjFcuM.mp4",
      "bytes": 57369134,
      "valid": true,
      "height": 1080,
      "width": 1920,
      "duration": "1183.661000",
      "status": "ok"
    }
  ],
  "body_chars": 18107,
  "expected_body_images": 57,
  "discovery_status": "ok",
  "delivery_status": "ok",
  "missing_reason": "",
  "raw_html": "attachments/96393521b8b8/pages/source.html",
  "local_html": "attachments/96393521b8b8/pages/article.html",
  "body_base_path": "attachments/96393521b8b8/pages/",
  "body_markdown_path": "attachments/96393521b8b8/pages/article.md"
}