{
  "source_file": "0930",
  "source_platform": "Beehiiv",
  "author": "Akshay Pachaar / ML Spring",
  "title_listed": "Attention is all you need: Self Attention Clearly explained!",
  "keywords": "",
  "domain": "大模型算法",
  "content_type": "技术教程",
  "is_paid_flag": "否",
  "url": "https://mlspring.beehiiv.com/p/attention-need-self-attention-clearly-explained",
  "publish_date": "2023-08",
  "corpus_stage": "",
  "notes": "",
  "id": "7f9e10f0c87a",
  "collected_at": "2026-10-02T14:12:23",
  "title": "Attention is all you need: Self Attention Clearly explained!",
  "body_markdown": "0\n0\nML Spring\nPosts\nAttention is all you need: Self Attention Clearly explained!\nAttention is all you need: Self Attention Clearly explained!\nAn illustrated guide! ✍️ Author: @akshay_pachaar\nAkshay Pachaar\nNovember 24, 2023\nIn 2017, a groundbreaking paper titled \"Attention is All You Need\" introduced the transformer architecture, which led to the Large Language Model (LLMs) revolution that we witness today.\nAt the heart of this architecture lies the attention mechanism.\nIn this post, I'll clearly explain self-attention & how it can be thought of as a directed graph.\nBefore we start a quick primer on\ntokenization\n!\nRaw text → Tokenization → Embedding → Model\nEmbedding is a meaningful representation of each token (roughly a word) using a bunch of numbers.\nThis embedding is what we provide as an input to our language models.\nCheck this👇\nIllustration of tokenization\nSubscribe to keep reading\nThis content is free, but you must be subscribed to ML Spring to continue reading.\nAlready a subscriber?\nSign in\n.\nNot now\nReply\nNewest first\nAdd your comment\nLogin\nLogin\nor\nSubscribe\nto participate\n.",
  "metadata": {
    "title": "Attention is all you need: Self Attention Clearly explained!",
    "description": "An illustrated guide! 🚀",
    "keywords": "data science, programming, machine learning",
    "author": "Akshay Pachaar",
    "og:type": "article",
    "og:url": "https://mlspring.beehiiv.com/p/attention-need-self-attention-clearly-explained",
    "og:title": "Attention is all you need: Self Attention Clearly explained!",
    "og:description": "An illustrated guide! 🚀",
    "og:site_name": "ML Spring",
    "og:image": "https://beehiiv-images-production.s3.amazonaws.com/uploads/asset/file/9674b20d-c1df-4b9c-8c40-b4f54da760ee/self_attention_thumbnail.png?t=1700825519",
    "og:image:width": "1200",
    "og:image:height": "630",
    "og:image:alt": "An illustrated guide! ✍️ Author:  @akshay_pachaar",
    "twitter:url": "https://mlspring.beehiiv.com/p/attention-need-self-attention-clearly-explained",
    "twitter:title": "Attention is all you need: Self Attention Clearly explained!",
    "twitter:description": "An illustrated guide! 🚀",
    "twitter:image": "https://beehiiv-images-production.s3.amazonaws.com/uploads/asset/file/9674b20d-c1df-4b9c-8c40-b4f54da760ee/self_attention_thumbnail.png?t=1700825519",
    "twitter:card": "summary_large_image",
    "article:author": "Akshay Pachaar"
  },
  "paywall": {
    "listed_paid": false,
    "detected": false,
    "marker": "",
    "public_only": false,
    "policy": "付费/会员内容只保留页面公开可见部分，不绕过付费墙"
  },
  "crawl": {
    "success": true,
    "status_code": 200,
    "error": ""
  },
  "code_blocks": [],
  "images": [
    {
      "status": "ok",
      "url": "https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/user/profile_picture/365b6afb-67c5-48c4-ade3-f57b97ccf42a/thumb_akshay.jpeg",
      "bytes": 7364,
      "reused": true,
      "local_path": "attachments/7f9e10f0c87a/images/000.jpeg",
      "src": "https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/user/profile_picture/365b6afb-67c5-48c4-ade3-f57b97ccf42a/thumb_akshay.jpeg",
      "alt": "Author",
      "downloaded": true
    },
    {
      "status": "ok",
      "url": "https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/2a1983b3-ab50-4919-969d-f28b6bf587cd/tokenization.jpeg?t=1700819126",
      "bytes": 90914,
      "reused": true,
      "local_path": "attachments/7f9e10f0c87a/images/001.jpeg",
      "src": "https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/2a1983b3-ab50-4919-969d-f28b6bf587cd/tokenization.jpeg?t=1700819126",
      "alt": "",
      "downloaded": true
    }
  ],
  "audio": [],
  "videos": [],
  "links": [
    {
      "href": "https://mlspring.beehiiv.com/",
      "label": "ML Spring",
      "type": "a"
    },
    {
      "href": "https://mlspring.beehiiv.com/authors/akshay-pachaar",
      "label": "Akshay Pachaar",
      "type": "a"
    },
    {
      "href": "https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Fmlspring.beehiiv.com%2Fp%2Fattention-need-self-attention-clearly-explained",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://twitter.com/intent/tweet?text=An+illustrated+guide%21+%E2%9C%8D%EF%B8%8F+Author%3A++%40akshay_pachaar&url=https%3A%2F%2Fmlspring.beehiiv.com%2Fp%2Fattention-need-self-attention-clearly-explained&via=akshay_pachaar",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://www.threads.net/intent/post?text=An+illustrated+guide%21+%E2%9C%8D%EF%B8%8F+Author%3A++%40akshay_pachaar+https%3A%2F%2Fmlspring.beehiiv.com%2Fp%2Fattention-need-self-attention-clearly-explained",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://www.linkedin.com/sharing/share-offsite?url=https%3A%2F%2Fmlspring.beehiiv.com%2Fp%2Fattention-need-self-attention-clearly-explained",
      "label": "",
      "type": "a"
    },
    {
      "href": "https://mlspring.beehiiv.com/p/understanding-tokenization-innlp",
      "label": "tokenization",
      "type": "a"
    },
    {
      "href": "https://mlspring.beehiiv.com/login?postSlug=attention-need-self-attention-clearly-explained",
      "label": "Sign in .",
      "type": "a"
    }
  ],
  "repair_version": 2,
  "repaired_at": "2026-10-14T10:51:10Z",
  "source_url": "https://mlspring.beehiiv.com/p/attention-need-self-attention-clearly-explained",
  "papers": [],
  "actual_video_files": [],
  "body_chars": 1101,
  "expected_body_images": 2,
  "discovery_status": "ok",
  "delivery_status": "ok",
  "missing_reason": "",
  "raw_html": "attachments/7f9e10f0c87a/pages/source.html",
  "local_html": "attachments/7f9e10f0c87a/pages/article.html",
  "body_base_path": "attachments/7f9e10f0c87a/pages/",
  "body_markdown_path": "attachments/7f9e10f0c87a/pages/article.md"
}