{
  "source_file": "0930",
  "source_platform": "Medium",
  "author": "Zijing Zhu, PhD",
  "title_listed": "What Makes A Strong AI?",
  "keywords": "",
  "domain": "机器学习",
  "content_type": "深度技术解析",
  "is_paid_flag": "否",
  "url": "https://towardsdatascience.com/what-makes-a-strong-ai-012315722793/",
  "publish_date": "2024-01-05",
  "corpus_stage": "",
  "notes": "",
  "id": "d17d5dbc26e7",
  "collected_at": "2026-10-02T08:26:23",
  "title": "What Makes A Strong AI? | Towards Data Science",
  "body_markdown": "![Revisit consent button](../images/body-df29beacd7496220cc94.svg)\nWe value your privacy\nWe use cookies to enhance your browsing experience, serve personalised ads or content, and analyse our traffic. By clicking \"Accept All\", you consent to our use of cookies.\nCustomise Reject All Accept All\nCustomise Consent Preferences ![](../images/body-2159bb67f3de8ad870eb.svg)\nWe use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.\nThe cookies that are categorised as \"Necessary\" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... Show more\nNecessaryAlways Active\nNecessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.\n  * Cookie\nBCTempID\n  * Duration\n10 minutes\n  * Description\nNo description available.\n\n\n  * Cookie\n__cf_bm\n  * Duration\n1 hour\n  * Description\nThis cookie, set by Cloudflare, is used to support Cloudflare Bot Management. \n\n\n  * Cookie\nAWSALBCORS\n  * Duration\n7 days\n  * Description\nAmazon Web Services set this cookie for load balancing.\n\n\n  * Cookie\n_cfuvid\n  * Duration\nsession\n  * Description\nCloudflare sets this cookie to track users across sessions to optimize user experience by maintaining session consistency and providing personalized services\n\n\n  * Cookie\nli_gc\n  * Duration\n6 months\n  * Description\nLinkedin set this cookie for storing visitor's consent regarding using cookies for non-essential purposes.\n\n\n  * Cookie\n__hssrc\n  * Duration\nsession\n  * Description\nThis cookie is set by Hubspot whenever it changes the session cookie. The __hssrc cookie set to 1 indicates that the user has restarted the browser, and if the cookie does not exist, it is assumed to be a new session.\n\n\n  * Cookie\n__hssc\n  * Duration\n1 hour\n  * Description\nHubSpot sets this cookie to keep track of sessions and to determine if HubSpot should increment the session number and timestamps in the __hstc cookie.\n\n\n  * Cookie\nwpEmojiSettingsSupports\n  * Duration\nsession\n  * Description\nWordPress sets this cookie when a user interacts with emojis on a WordPress site. It helps determine if the user's browser can display emojis properly.\n\n\n  * Cookie\nBCSessionID\n  * Duration\n1 year 1 month 4 days\n  * Description\nBlueconic sets this cookie as a unique identifier for the BlueConic profile.\n\n\n  * Cookie\n_octo\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\nlogged_in\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\n__Secure-YEC\n  * Duration\npast\n  * Description\nYouTube sets this cookie to stores the user's video player preferences using embedded YouTube video\n\n\n  * Cookie\n__eoi\n  * Duration\n6 months\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nAWSALBTGCORS\n  * Duration\n7 days\n  * Description\nNo description available.\n\n\n  * Cookie\nlogin-status-p\n  * Duration\npast\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nAWSALBTG\n  * Duration\n7 days\n  * Description\nNo description available.\n\n\n  * Cookie\ncsrf_token\n  * Duration\nsession\n  * Description\nNo description available.\n\n\n  * Cookie\ntoken_v2\n  * Duration\n1 day\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nD\n  * Duration\n1 year\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nPHPSESSID\n  * Duration\nsession\n  * Description\nThis cookie is native to PHP applications. The cookie stores and identifies a user's unique session ID to manage user sessions on the website. The cookie is a session cookie and will be deleted when all the browser windows are closed.\n\n\n  * Cookie\nVISITOR_PRIVACY_METADATA\n  * Duration\n6 months\n  * Description\nYouTube sets this cookie to store the user's cookie consent state for the current domain. \n\n\n  * Cookie\ncookietest\n  * Duration\nsession\n  * Description\nThe cookietest cookie is typically used to determine whether the user's browser accepts cookies, essential for website functionality and user experience.\n\n\n  * Cookie\n__Host-airtable-session\n  * Duration\n1 year\n  * Description\nThis cookie is used to enable us to integrate the services of Airtable.\n\n\n  * Cookie\n__Host-airtable-session.sig\n  * Duration\n1 year\n  * Description\nThis cookie is used to enable us to integrate the services of Airtable.\n\n\n  * Cookie\nm\n  * Duration\n1 year 1 month 4 days\n  * Description\nStripe sets this cookie for fraud prevention purposes. It identifies the device used to access the website, allowing the website to be formatted accordingly.\n\n\n  * Cookie\nBIGipServer*\n  * Duration\nsession\n  * Description\nMarketo sets this cookie to collect information about the user's online activity and build a profile about their interests to provide advertisements relevant to the user. \n\n\n  * Cookie\n__cfruid\n  * Duration\nsession\n  * Description\nCloudflare sets this cookie to identify trusted web traffic.\n\n\n  * Cookie\n_GRECAPTCHA\n  * Duration\n6 months\n  * Description\nGoogle Recaptcha service sets this cookie to identify bots to protect the website against malicious spam attacks.\n\n\n  * Cookie\n__Secure-YNID\n  * Duration\n6 months\n  * Description\nGoogle cookie used to protect user security and prevent fraud, especially during the login process.\n\n\n  * Cookie\ncookieyes-consent\n  * Duration\n1 year\n  * Description\nCookieYes sets this cookie to remember users' consent preferences so that their preferences are respected on subsequent visits to this site. It does not collect or store any personal information about the site visitors.\n\n\nFunctional\nFunctional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.\n  * Cookie\nlidc\n  * Duration\n1 day\n  * Description\nLinkedIn sets the lidc cookie to facilitate data center selection.\n\n\n  * Cookie\nbrw\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\nbrwConsent\n  * Duration\n5 minutes\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nWMF-Uniq\n  * Duration\n1 year\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nloom_anon_comment\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\nloom_referral_video\n  * Duration\nsession\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nVISITOR_INFO1_LIVE\n  * Duration\n6 months\n  * Description\nA cookie set by YouTube to measure bandwidth that determines whether the user gets the new or old player interface.\n\n\n  * Cookie\nyt-remote-connected-devices\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to store the user's video preferences using embedded YouTube videos.\n\n\n  * Cookie\nytidb::LAST_RESULT_ENTRY_KEY\n  * Duration\nNever Expires\n  * Description\nThe cookie ytidb::LAST_RESULT_ENTRY_KEY is used by YouTube to store the last search result entry that was clicked by the user. This information is used to improve the user experience by providing more relevant search results in the future.\n\n\n  * Cookie\nyt-remote-device-id\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to store the user's video preferences using embedded YouTube videos.\n\n\n  * Cookie\nyt-remote-session-name\n  * Duration\nsession\n  * Description\nThe yt-remote-session-name cookie is used by YouTube to store the user's video player preferences using embedded YouTube video.\n\n\n  * Cookie\nyt-remote-fast-check-period\n  * Duration\nsession\n  * Description\nThe yt-remote-fast-check-period cookie is used by YouTube to store the user's video player preferences for embedded YouTube videos.\n\n\n  * Cookie\nyt-remote-session-app\n  * Duration\nsession\n  * Description\nThe yt-remote-session-app cookie is used by YouTube to store user preferences and information about the interface of the embedded YouTube video player.\n\n\n  * Cookie\nyt-remote-cast-available\n  * Duration\nsession\n  * Description\nThe yt-remote-cast-available cookie is used to store the user's preferences regarding whether casting is available on their YouTube video player.\n\n\n  * Cookie\nyt-remote-cast-installed\n  * Duration\nsession\n  * Description\nThe yt-remote-cast-installed cookie is used to store the user's video player preferences using embedded YouTube video.\n\n\n  * Cookie\ncp_session\n  * Duration\n3 months\n  * Description\nCodepen sets this cookie for Help systems found in the website.\n\n\n  * Cookie\nloid\n  * Duration\n1 year 1 month 4 days\n  * Description\nThis cookie is set by the Reddit. The cookie enables the sharing of content from the website onto the social media platform.\n\n\nAnalytics\nAnalytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.\n  * Cookie\n__hstc\n  * Duration\n6 months\n  * Description\nHubspot set this main cookie for tracking visitors. It contains the domain, initial timestamp (first visit), last timestamp (last visit), current timestamp (this visit), and session number (increments for each subsequent session).\n\n\n  * Cookie\nhubspotutk\n  * Duration\n6 months\n  * Description\nHubSpot sets this cookie to keep track of the visitors to the website. This cookie is passed to HubSpot on form submission and used when deduplicating contacts.\n\n\n  * Cookie\n_ga\n  * Duration\n1 year 1 month 4 days\n  * Description\nGoogle Analytics sets this cookie to calculate visitor, session and campaign data and track site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognise unique visitors.\n\n\n  * Cookie\n_ga_*\n  * Duration\n1 year 1 month 4 days\n  * Description\nGoogle Analytics sets this cookie to store and count page views.\n\n\n  * Cookie\n__Host-psifi.analyticsTrace\n  * Duration\n6 hours\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\n__Host-psifi.analyticsTraceV2\n  * Duration\n6 hours\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\n_gh_sess\n  * Duration\nsession\n  * Description\nGitHub sets this cookie for temporary application and framework state between pages like what step the user is on in a multiple step form.\n\n\n  * Cookie\nYSC\n  * Duration\nsession\n  * Description\nYSC cookie is set by Youtube and is used to track the views of embedded videos on Youtube pages.\n\n\n  * Cookie\najs_anonymous_id\n  * Duration\n1 year\n  * Description\nThis cookie is set by Segment to count the number of people who visit a certain site by tracking if they have visited before.\n\n\n  * Cookie\nvuid\n  * Duration\n1 year 1 month 4 days\n  * Description\nVimeo installs this cookie to collect tracking information by setting a unique ID to embed videos on the website. \n\n\nPerformance\nPerformance cookies are used to understand and analyse the key performance indexes of the website which helps in delivering a better user experience for the visitors.\n  * Cookie\nAWSALB\n  * Duration\n7 days\n  * Description\nAWSALB is an application load balancer cookie set by Amazon Web Services to map the session to the target.\n\n\n  * Cookie\nacq\n  * Duration\npast\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nacq.sig\n  * Duration\npast\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nptc\n  * Duration\n2 years\n  * Description\nNo description available.\n\n\nAdvertisement\nAdvertisement cookies are used to provide visitors with customised advertisements based on the pages you visited previously and to analyse the effectiveness of the ad campaigns.\n  * Cookie\nmuc_ads\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to collect user behaviour and interaction data to optimize the website.\n\n\n  * Cookie\nguest_id_marketing\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to identify and track the website visitor.\n\n\n  * Cookie\nguest_id_ads\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to identify and track the website visitor.\n\n\n  * Cookie\npersonalization_id\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to integrate and share features for social media and also store information about how the user uses the website, for tracking and targeting.\n\n\n  * Cookie\nguest_id\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to identify and track the website visitor. It registers if a user is signed in to the Twitter platform and collects information about ad preferences.\n\n\n  * Cookie\nbcookie\n  * Duration\n1 year\n  * Description\nLinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser IDs.\n\n\n  * Cookie\n__Secure-ROLLOUT_TOKEN\n  * Duration\n6 months\n  * Description\nYouTube sets this cookie to manage feature rollout and experimentation. It helps Google control which new features or interface changes are shown to users as part of testing and staged rollouts, ensuring consistent experience for a given user during an experiment.\n\n\n  * Cookie\nyt.innertube::nextId\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to register a unique ID to store data on what videos from YouTube the user has seen.\n\n\n  * Cookie\nyt.innertube::requests\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to register a unique ID to store data on what videos from YouTube the user has seen.\n\n\n  * Cookie\nsession_tracker\n  * Duration\nsession\n  * Description\nThis cookie is set by the Reddit. This cookie is used to identify trusted web traffic. It also helps in adverstising on the website.\n\n\n  * Cookie\nedgebucket\n  * Duration\nsession\n  * Description\nReddit sets this cookie to save the information about a log-on Reddit user, for the purpose of advertisement recommendations and updating the content.\n\n\n  * Cookie\ndid\n  * Duration\n1 year\n  * Description\nArbor sets this cookie to show targeted ads to site visitors.This cookie expires after 2 months or 1 year.\n\n\nUncategorised\nOther uncategorised cookies are those that are being analysed and have not been classified into a category as yet.\nNo cookies to display.\nReject All Save My Preferences Accept All\nToggle Search[](https://towardsdatascience.com/)Toggle Mobile Navigation\n[](https://towardsdatascience.com/)\nPublish AI, ML & data-science insights to a global community of data professionals.\nSign in[Submit an Article](https://write.insightmediagroup.io)\n[Latest](https://towardsdatascience.com/latest/)[Editor's Picks](https://towardsdatascience.com/tag/editors-pick/)[Newsletter](https://towardsdatascience.com/tag/the-variable/)[ShipAI](https://towardsdatascience.com/shipai/)\n* * *\n[Write For TDS](https://towardsdatascience.com/submissions/)\n[LinkedIn](https://www.linkedin.com/company/towards-data-science/)[X](https://x.com/TDataScience)Toggle Search\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\n# What Makes A Strong AI?\n\"The Book of Why\" Chapters 9&10, a Read with Me series\n[Zijing Zhu, PhD](https://towardsdatascience.com/author/zzhu17/)\nJanuary 4, 202414 min read\n![Photo by Emmanuel Ikwuegbu on Unsplash](../images/000.jpg)\nPhoto by [Emmanuel Ikwuegbu](https://unsplash.com/@emmages?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nWhat Makes A Strong AI?\nWe are at the last article [reading Judea Pearl's inspiring \"The Book of Why,\"](https://zzhu17.medium.com/list/causality-book-club-def5f1fd00fe) and it will mostly focus on mediators and how to combine causality with big data to derive trustworthy conclusions. I will also summarize what makes a strong AI in the end based on the whole book.\n* * *\n### Mediators\nWe have briefly talked about mediation in the previous articles. We mentioned it is important to identify mediators not only because we shouldn't treat them as confounders, since conditioning on them will block the causal effect completely or partially, but also in proper cases, we can use mediators for front-door criterion when unobserved confounders exist.\n![Photo by sally crierie on Unsplash](../images/001.jpg)\nPhoto by [sally crierie](https://unsplash.com/@sallycrierie?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nIn this section, we will dive deeper into different examples of mediators and understand how to properly define direct causal effect, indirect causal effect, and total causal effect when mediators exist.\nLearn this step by step with the interactive [AI Engineer](https://roadmap.sh/ai-engineer) and [AI and Data Scientist](https://roadmap.sh/ai-data-scientist) roadmaps.\nIn history, scurvy had always been the most terrifying disease for sailors. Before vitamins were discovered and properly named, scientists struggled to figure out how to prevent sailors from getting scurvy. They first asked what is the cause - **why** did some sailors get scurvy and some don't? Having observed that citrus fruits helped reduce scurvy, they needed to explain **why** citrus fruits help prevent scurvy, which led to the discovery of Vitamin C.\n![Image by Author based on The Book of Why Chapter 9](../images/002.png)\nImage by Author based on The Book of Why Chapter 9\nMediators provide answers to the second \"why\" question. In this example, Vitamin C is the mediator for the citrus fruits to take into effect, and citrus fruits have no direct effect on scurvy. If we dry or boil these fruits, it won't help prevent scurvy anymore.\nUnlike the previous example, in many cases, there are two paths for a cause to effect. The route that connects cause to effect directly represents the direct causal effect. There may exist another route that connects the cause and effect through a mediator, which produces the indirect causal effect.\n![Image by Author based on The Book of Why Chapter 9](../images/003.png)\nImage by Author based on The Book of Why Chapter 9\nThus, a one-unit change in the cause will impact the outcome variable in two paths, and only the total effect is what we observe. In this section, we will explore some examples to see why it is important to isolate the direct and indirect effects from the total effects. To estimate the direct and indirect effects, we need to borrow the concept of counterfactuals from the last article, and we will discuss more details in the next section.\n### Algebra for All\nChicago Public School system once introduced an \"Algebra for All\" program that required all ninth graders to take college-prep math courses. To understand whether taking these courses improved students' test grades causally, we first need to remove confounders, like other curriculum changes that would also impact students' test grades. After careful consideration, researchers found no significant improvement in test scores. However, before jumping into claiming the program is not effective, the researcher examined more on how can introducing new courses impact students' grades. It turned out that \"Algebra for All\" not only changed the curriculum but also changed the teaching environment where lower-achieving students are mixed with higher-achieving students during class. Larger class size not only reduces teaching efficiency but also discourage lower-achieving students from catching up. Thus, we have the following causal graph when adding \"Environment\" as a mediator:\n![Image by Author based on The Book of Why Chapter 9](../images/004.png)\nImage by Author based on The Book of Why Chapter 9\nHere, the direct effect of \"Algebra for All\" on learning is positive, but the indirect effect through the mediator \"Environment\" is negative. Thus, the total effect without distinguishing the direct and indirect effects will more than likely be minimal.\nIn this case, the researcher estimated the direct effect and indirect effect individually. Since the results did show a positive direct effect and a negative indirect effect, the researcher concluded that \"Allegra for All\" should increase students' test scores if maintaining the pre policy classroom environment.\n### Revisit The Smoking Gene\nFrom previous articles, we might be very familiar with the debate happening when analyzing the causal effect of smoking on lung cancer. One confounder that was brought into the front stage was the smoking gene:\n![Image by Author based on The Book of Why Chapter 9](../images/005.png)\nImage by Author based on The Book of Why Chapter 9\nWith progress in medical research, genomics experts did locate the smoking gene, what they called \"Mr. Big,\" because of its strong association with lung cancer. The finding of the smoking gene shouldn't overshadow smoking as a causal factor in lung cancer. Nevertheless, even a double dose of the smoking gene doesn't double the risk of getting lung cancer.\nHow can the discovery of the smoking gene help us other than serving as a confounder? If we make a small shift on the **same** causal graph and treat smoking gene as the treatment and smoking as a mediator to lung cancer:\n![Image by Author based on The Book of Why Chapter 9](../images/006.png)\nImage by Author based on The Book of Why Chapter 9\nWith this change, as Pearl mentioned, we can estimate the smoking gene's direct effect: Does the smoking gene make lung cells more vulnerable to cancer? We can also estimate the smoking gene's indirect effect: Does the smoking gene make people smoke more and inhale harder?\nComparing whether direct or indirect is higher will give different action guidance. If the direct effect is higher, then people with the smoking gene should receive extra screening for lung cancer throughout their lives. On the contrary, if the indirect effect is higher, health professionals should pay more attention to intervening in the smoking behaviors of individuals carrying the smoking gene.\n* * *\n### Estimate Direct and Indirect Effects\nAfter demonstrating the importance of isolating direct effect and indirect effect, let's move to how to estimate the causal effect, a Rung 2&3 question, from Rung 1 data.\nFor a long period of time, the standard way of estimating direct and direct effects follows simple rules. Supposed we have the following causal diagram with the coefficients representing the causal effects:\n![Image by Author based on The Book of Why Chapter 9](../images/007.png)\nImage by Author based on The Book of Why Chapter 9\nThe direct effect would be **a** , and the indirect effect would be **b** _**c.**__****Thus, ******__ **the total effect with one unit increase in the cause is **a+b**_ c. However, there are some assumptions needed to arrive at this conclusion.\nThe first assumption is that all variables follow linear relationships. There is a simple example in Pearl's book that shows that if we change the linear relationship simply to binary conditions, this would not work. Moreover, in essence, a linear relationship would not be able to capture the case when there are interactions between the cause and the mediator.\n![Photo by Shubham Dhage on Unsplash](../images/008.jpg)\nPhoto by [Shubham Dhage](https://unsplash.com/@theshubhamdhage?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nNo interaction is a strong assumption. Take \"Algebra for All\" as an example. It is very likely that a more challenging curriculum, combined with a less supportive classroom environment, will be more discouraging for low-achieving students to get better grades. The linear system would not be able to reflect this interaction.\nAnother assumption made here is this equation:\n> Total Effect = Direct Effect + Indirect Effect\nThis sounds very logical. What's the problem with this? In the book, Pearl gives an example. Suppose we are estimating the efficiency of a drug that doesn't have a direct effect but has an indirect effect through stimulating enzymes.\n![Image by Author based on The Book of Why Chapter 9](../images/009.png)\nImage by Author based on The Book of Why Chapter 9\nWe know the total effect is positive because the drug is effective. The direct effect is zero because if we disable the enzyme, the drug will not work.\nWhen estimating the indirect effect, and we block the drug and artificially get the enzyme, the disease would not be cured because it would only work if we combine the drug and the enzyme.\nThis is another example of interaction between cause and mediator. In this case, the total effect is positive, but both direct and indirect effects are zeros.\nThe essence of the challenges, in my opinion, is how to define the quantity of mediator M when calculating indirect effect, especially when there are interactions between X and M.\nWe know the value of M when there is treatment, **what would have been the value of M without the treatment**? And **how does this value differ across individuals**?\nThese questions all point to the concept we have discussed in the previous chapter - - counterfactuals. If the direct effect is\n> The effect remaining after holding the mediator fixed\nThe definition Pearl gives for indirect effect is more complicated:\n> The indirect effect of X on Y is the increase we would see in Y while **holding X constant** and increasing M to whatever value M **would attain** under a unit increase in X.\nThe key here is we first need to know what M **would have been** when X changes before we know it's indirect impact on Y. With counterfactuals embedded, Pearl presents the two equations to estimate direct and indirect effects. The natural direct effect (NDE) is:\n![](../images/body-b0e306ff942173897e54.png)\nHere we make the mediator fixed at M0, a value that M would have been given that X takes the value 0. In the \"Algebra for All\" example, M would be the teaching environment, or specifically, the classroom size when there is no curriculum change. We are comparing the direct impact of do(X=0) and do(X=1) on outcome Y=1.\nThe natural indirect effect (NIE) is:\n![](../images/body-2d3bfc13d5921c44444d.png)\nHere we ensure _**do(X=0)**_ on both terms to ensure no direct effects. Note we make the mediator take the value of M1 in the first term, which is what M would be given that X=1. For example, what the classroom size would have been given that the \"Algebra for All\" program had launched. In the second term, however, the mediator takes the value of M0. The natural indirect effect basically calculates a difference that is only deduced by the change in the value of the mediator, and how much the mediator will change from M0 to M1 depends largely on the causal relationship between X and M.\n![Photo by Anne Nygård on Unsplash](../images/010.jpg)\nPhoto by [Anne Nygård](https://unsplash.com/@polarmermaid?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nArriving at these equations was not an easy task. There are so many more details to this journey, with generations of researchers' efforts. You can refer to Pearl's book for more.\n* * *\n### Causality and Big Data\nAll throughout the book, Pearl tries to prove that only relying on data without understanding causality is not enough to derive trustworthy results. However, data and models are never enemies. In fact, having data is the first step to arrive at any conclusion. For the last chapter of the book, Pearl explores the opportunities we have combining causality and big data:\n> Causal inference permits us to screen off the irrelevant characteristics and to recruit these individuals from diverse studies, while Big Data allows us to gather enough information about them.\nTo illustrate how we can combine causal models and data from different studies to get new insights, Pearl shows an example to analyze an online advertisement(X) on the likelihood that a consumer will purchase the product(Y). If the company already has data from different cities' previous campaigns, like in Los Angeles, Boston, Toronto, etc, and is looking for ways to generalize the results to the population in Arkansas, with the help of causal diagrams, there might be ways we can measure the effect in new population without all the new data, or any new data.\nSpecifically, let's look at the causal diagram showing how the online campaign causes sales to increase:\n![Image by Author based on The Book of Why Chapter 10](../images/011.png)\nImage by Author based on The Book of Why Chapter 10\nThere is Z representing confounders. In this case, Z could be age, showing that some products are only preferred by certain age groups, like young people, and they also happen to be more exposed to online promotions. W represents the mediator for X to affect Y. For example, it could be the click rate on a link that converts customers from seeing an advertisement to purchasing the product.\nIn the easiest case, suppose we already have survey data from Boston from their past campaigns and the only difference between Boston and Arkansas population is the rate of car ownership. Let S represent the difference between these two populations, and we can revise the causal diagram:\n![Image by Author based on The Book of Why Chapter 10](../images/012.png)\nImage by Author based on The Book of Why Chapter 10\nIf the causal diagram holds, it means the effect of the Arkansas online advertisement should be the same as in Boston since S and V will not affect the causal path X->W->Y because it's blocked by the collider Z.\nIn a more complicated case, suppose we have survey data from Los Angeles, and the difference is that the LA population might be younger. The revised causal diagram would be:\n![Image by Author based on The Book of Why Chapter 10](../images/013.png)\nImage by Author based on The Book of Why Chapter 10\nIn this case, S is impacting the X->Y causal effects through the confounder Z. Thus, we need to reweigh the data in LA to account for the different age structures.\nIf we cannot measure Z in Arkansas, we can instead look for randomized trials that might have been done in other cities and see whether we can adjust for Arkansas. For example, if we have randomized trials from Toronto, and the only difference is that Toronto has a higher click-through rate:\n![Image by Author based on The Book of Why Chapter 10](../images/body-8be753c86c1a9a94d54f.png)\nImage by Author based on The Book of Why Chapter 10\nSince this is a randomized experiment, we could remove the path between X and Z. By just collecting data on X, W, and Y in Arkansas, we can estimate the causal impact with the results from Toronto.\nEven in the case where S impacts Y directly, i.e., the product is more desirable in this city:\n![](../images/body-41dfec1c4b25618370ca.png)\nAgain, this is from experiment data so we can remove the link between X and Z. Even if the difference S directly impacts Y, we can still use this city's estimation on P(W|X) to contribute partially to the overall causal impact.\nAll these examples show that Big Data is our friend. Combining with reasonable causal structure, we know which sets of data are desired to derive trustworthy causal effects, which saves us trouble from always running randomized trials or collecting as much data as possible.\n* * *\n### What Makes A Strong AI\nIn the last two months of 2023, we have been indulging in the world of causality through reading \"The Book of Why\" by Judea Pearl. Time flies. We said goodbye to 2023 and to \"The Book of Why.\" However, this won't be the end of exploring the fascinating world of causality and pushing the boundaries of artificial intelligence. Pearl illustrates what makes a strong AI in every chapter, and I briefly talked about in my previous articles:\n  * [**Chapter1 &2: Data Tells Us 'What\" and We Always Seek for \"Why\"**](https://medium.com/towards-data-science/data-tells-us-what-and-we-always-seek-for-why-66da7dc3f24d)**:**\n\n\nA strong AI never makes decisions only based on correlations. It needs to step up from Rung 1, \"seeing,\" to Rung 2, \"intervening,\" and Rung 3, \"imagining.\" Not only do they need to know what the patterns were from the past, but they also need to understand why these patterns came up to make intelligent predictions.\n  * [**Chapter3 &4: Causal Diagram: Confronting the Achilles' Heel in Observational Data**](https://medium.com/towards-data-science/causal-diagram-confronting-the-achilles-heel-in-observational-data-a69cdb1c4818)**:**\n\n\nA strong AI never makes decisions based on rules. Instead, it draws conclusions following causal structures. In addition to having the ability to derive the probability of an outcome based on the probability of cause, it also knows to update its belief that given the outcome, what's the probability of cause. With the help of causal diagrams, a strong AI goes beyond the Bayesian network and is capable of finding causality in observational studies.\n  * [**Chapter5 &6:Why Understanding the Data-Generation Process Is More Important Than the Data Itself**](https://towardsdatascience.com/towards-data-science/why-understanding-the-data-generation-process-is-more-important-than-the-data-itself-f1b3b847e662)**:**\n\n\nA strong AI knows how to distinguish spurious correlations and true causalities. It will not mistake collider bias as causation, and will not eliminate causal impacts by conditioning on mediators.\n  * [**Chapter7 &8 You Can't Step in the Same River Twice**](https://medium.com/towards-data-science/you-cant-step-in-the-same-river-twice-cfacf7cee305)**:**\n\n\nA strong AI resembles human brains when categorizing causes into necessary causes and sufficient causes. Although multiple variables can be the causal factors for an outcome, human brains automatically \"rank\" these factors based on how rare events happen and what are the action points. A strong AI not only looks for why but also ranks the why.\n![Photo by Jason Leung on Unsplash](../images/body-2d389f1af34f7b290ef2.jpg)\nPhoto by [Jason Leung](https://unsplash.com/@ninjason?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nIn the last two chapters, Pearl also mentioned the importance of transparency in the AI decision making process. Just like we want to know the why about everything, we want to know why the AI makes this decision.\nNot all AI researchers are fans of transparency. In Pearl's book, he mentions:\n> The field at that time was divided into \"neats\" (who wanted transparent systems with guarantees of behavior) and \"scruffies\" (who just wanted something that worked)\nAlthough _**scruffies**_ could get temporary solutions, a strong AI is a transparent AI so that humans can better coach it, tailor it the way we like, and even learn from it. Ultimately, humans always long for effective communication. As Pearl said, it would be \"_**quite unfortunate**_ \" if we cannot hold meaningful conversations with AI.\n2023 was a revolutionary year. With the widespread use of Generative AI, we are hopeful and simultaneously intimidated by what AI can do, just like when we were facing any new technology in history. Pearl is optimistic, he said at the end of the book:\n> Once we have built a moral robot...... we will be able to depend on our machines for a clear-eyed and causally sound sense of justice...... Such a thinking machine would be a wonderful companion for our species and would truly qualify as AI's first and best gift to humanity.\nHowever, having data, no matter how much more, will not enable machines to resemble human-level intelligence without embedding causal models, with which, AI can \"_think about own intentions and reflect on its own mistakes_.\" The AI that climbs above Rung 1 to make Rung 2 interventions and Rung 3 counterfactuals. And this is how we make a strong AI.\n* * *\nThanks for reading. This concludes the Read with Me series. What an amazing collective learning experience! The good news is that I plan to publish a bonus article in two weeks to officially close this series.\n> [**How is Causal Inference Different in Academia and Industry?**](https://towardsdatascience.com/how-is-causal-inference-different-in-academia-and-industry-fb5afd12e2e7)\nIf interested, [subscribe to my email list](https://zzhu17.medium.com/subscribe) to get notified of my future articles. If you like this article, don't forget to:\n  * _**Check my recent articles about**_[ _**the 4Ds in data storytelling: making art out of science**_](https://medium.com/towards-data-science/the-4ds-in-data-storytelling-making-art-out-of-science-c4998ed7875e); [_**continuous learning in data science**_](https://towardsdatascience.com/continuous-learning-a-data-scientists-odyssey-8d3006c2ce01) _**;**_[_**how I become a data scientist**_](https://towardsdatascience.com/how-i-became-a-data-scientist-7f5b10606612) _**;**_\n  * _**Check my**_[ _**other articles**_](https://zzhu17.medium.com/my-blog-posts-gallery-ac6e01fe5cc3) _**on different topics like**_[ _**data science interview preparation**_](https://zzhu17.medium.com/list/data-science-interview-preparation-bfb0986a61a3) _**;**_[_**causal inference**_](https://towardsdatascience.com/causal-inference-what-why-and-how-d7336b0081ec) _**;**_\n  * [_**Subscribe**_](https://zzhu17.medium.com/subscribe) _**to my email list;**_\n  * [_**Sign up for medium membership**_](https://zzhu17.medium.com/membership) _**;**_\n  * _**Or follow me on**_[ _**YouTube**_](https://youtube.com/channel/UCMs6go1pvY5OOy1DXVtMo5A) _**and watch my most recent YouTube videos:**_\n\n\nPlease accept cookies to access this content\n## Register Now to Continue Reading\n### Unlock Towards Data Science with a Free Account\nAll articles on Towards Data Science are available to registered users. Create a free account today to access this article and thousands more.\nRegister for freeSign in to your account\n* * *\n![](../images/body-6091039d5533a6240825.png)\nWritten By\n## [Zijing Zhu, PhD](https://towardsdatascience.com/author/zzhu17/)\n[See all from Zijing Zhu, PhD](https://towardsdatascience.com/author/zzhu17/)\n[Deep Dives](https://towardsdatascience.com/tag/deep-dives/)[Artificial Intelligence](https://towardsdatascience.com/tag/artificial-intelligence/)[Causal Inference](https://towardsdatascience.com/tag/causal-inference/)[Causality](https://towardsdatascience.com/tag/causality/)[Data Science](https://towardsdatascience.com/tag/data-science/)\nShare This Article\n  * [](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Ftowardsdatascience.com%2Fwhat-makes-a-strong-ai-012315722793%2F&title=What%20Makes%20A%20Strong%20AI%3F)\n  * [](https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Ftowardsdatascience.com%2Fwhat-makes-a-strong-ai-012315722793%2F&title=What%20Makes%20A%20Strong%20AI%3F)\n  * [](https://x.com/share?url=https%3A%2F%2Ftowardsdatascience.com%2Fwhat-makes-a-strong-ai-012315722793%2F&text=What%20Makes%20A%20Strong%20AI%3F)\n\n\nTowards Data Science is a community publication. Submit your insights to reach our global audience and earn through the TDS Author Payment Program.\n[Write for TDS](https://towardsdatascience.com/submissions/)\n## Related Articles\n  * [![](../images/014.jpg)](https://towardsdatascience.com/plotting-time-series-boxplots-5a21f2b76cfe/)\n## [Plotting Time Series Boxplots](https://towardsdatascience.com/plotting-time-series-boxplots-5a21f2b76cfe/)\n[Data Science](https://towardsdatascience.com/category/data-science/)\nLearn how to plot time series boxplots using matplotlib and Seaborn\n[Wei-Meng Lee](https://towardsdatascience.com/author/weimenglee/)\nMarch 25, 20225 min read\n  * [![](../images/015.jpg)](https://towardsdatascience.com/the-ai-bubble-will-pop-and-why-that-doesnt-matter/)\n## [The AI Bubble Will Pop — And Why That Doesn’t Matter](https://towardsdatascience.com/the-ai-bubble-will-pop-and-why-that-doesnt-matter/)\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\nHow history’s biggest tech bubble explains where AI is headed next\n[Michael Malin](https://towardsdatascience.com/author/michael-malin/)\nDecember 8, 20257 min read\n  * [![](../images/016.jpg)](https://towardsdatascience.com/interview-preparation-causal-inference-44fbb8b0a5c6/)\n## [Interview Preparation: Causal Inference](https://towardsdatascience.com/interview-preparation-causal-inference-44fbb8b0a5c6/)\n[Data Science](https://towardsdatascience.com/category/data-science/)\nLearn how to tackle interview questions related to causal inference, gaining insights into the core concepts and applications.\n[Julie Zhang](https://towardsdatascience.com/author/juliezhang0826/)\nAugust 11, 20236 min read\n  * [![](../images/017.jpg)](https://towardsdatascience.com/make-your-data-move-creating-animations-in-python-for-science-and-machine-learning/)\n## [Make Your Data Move: Creating Animations in Python for Science and Machine Learning](https://towardsdatascience.com/make-your-data-move-creating-animations-in-python-for-science-and-machine-learning/)\n[Data Visualization](https://towardsdatascience.com/category/data-science/data-visualization/)\nGo beyond static plots with matplotlib.\n[MARCUS SENA](https://towardsdatascience.com/author/marcusmvls-vinicius/)\nMay 6, 20256 min read\n  * [![](../images/018.jpeg)](https://towardsdatascience.com/pandas-vs-tidyverse-on-textual-data-23c6a7c2df8c/)\n## [Pandas vs Tidyverse on Textual Data](https://towardsdatascience.com/pandas-vs-tidyverse-on-textual-data-23c6a7c2df8c/)\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\nHow to manipulate strings in both libraries\n[Soner Yıldırım](https://towardsdatascience.com/author/sonery/)\nFebruary 6, 20215 min read\n  * [![](../images/019.png)](https://towardsdatascience.com/hey-siri-what-does-it-mean-to-be-human-f06fa6e251ce/)\n## [Hey Siri, what does it mean to be human?](https://towardsdatascience.com/hey-siri-what-does-it-mean-to-be-human-f06fa6e251ce/)\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\nBefore suggesting that AI can enhance human potential, it can be useful to ask what separates humanity from the progress of technology\n[Lee Schlenker](https://towardsdatascience.com/author/leeschlenker/)\nJanuary 10, 20204 min read\n  * [![](../images/020.jpg)](https://towardsdatascience.com/why-stem-is-important-for-any-data-scientist-45b8ec1d445d/)\n## [Why STEM Is Important for Any Data Scientist](https://towardsdatascience.com/why-stem-is-important-for-any-data-scientist-45b8ec1d445d/)\n[Machine Learning](https://towardsdatascience.com/category/artificial-intelligence/machine-learning/)\n3 cases to prove this from my own experience\n[Radmila Mandzhieva](https://towardsdatascience.com/author/radmilamandzhi/)\nNovember 14, 20247 min read\n  * [![](../images/021.jpg)](https://towardsdatascience.com/version-control-your-large-datasets-using-google-drive-dd42211ab740/)\n## [Version Control your Large Datasets using Google Drive](https://towardsdatascience.com/version-control-your-large-datasets-using-google-drive-dd42211ab740/)\n[Data Science](https://towardsdatascience.com/category/data-science/)\nMaking reproducible datasets possible\n[Pratik Gandhi](https://towardsdatascience.com/author/pratikkgandhi/)\nOctober 18, 20214 min read\n  * [![](../images/022.jpg)](https://towardsdatascience.com/introduction-to-semi-supervised-learning/)\n## [Introduction to Semi-Supervised Learning](https://towardsdatascience.com/introduction-to-semi-supervised-learning/)\n[Machine Learning](https://towardsdatascience.com/category/artificial-intelligence/machine-learning/)\nA primer about Semi-Supervised Learning, the approaches taken with different algorithms and the limitations of using unlabelled data.\n[Carolina Bento](https://towardsdatascience.com/author/carolina%20bento/)\nAugust 5, 20267 min read\n\n\n  * [YouTube](https://www.youtube.com/c/TowardsDataScience)\n  * [X](https://x.com/TDataScience)\n  * [LinkedIn](https://www.linkedin.com/company/towards-data-science/)\n  * [Threads](https://www.threads.net/@towardsdatascience)\n  * [Bluesky](https://bsky.app/profile/towardsdatascience.com)\n\n\n[](https://towardsdatascience.com/)\nYour home for data science and AI. The world's leading publication for data science, data analytics, data engineering, machine learning, and artificial intelligence professionals.\nSubscribe to Our Newsletter[Write For TDS](https://towardsdatascience.com/submissions/)•[About](https://towardsdatascience.com/about-towards-data-science-d691af11cc2f/)•[Advertise](https://contact.towardsdatascience.com/advertise-with-towards-data-science)•[Privacy Policy](https://towardsdatascience.com/privacy-policy/)•[Terms of Use](https://towardsdatascience.com/website-terms-of-use/)\n© Insight Media Group, LLC 2026•[The New Stack](https://thenewstack.io)•[roadmap.sh](https://roadmap.sh)•[Creator Network](https://insightmediagroup.io/creator-network)\n####  Recommended Articles \nClose\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607686/image?etag=1782161464448&width=500&height=500) How Relevance Models Foreshadowed Transformers for NLP ](https://towardsdatascience.com/how-relevance-models-foreshadowed-transformers-for-nlp/ \"How Relevance Models Foreshadowed Transformers for NLP\")\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607639/image?etag=1781250125848&width=500&height=500) Javascript Fatigue: HTMX Is All You Need to Build ChatGPT — Part 1 ](https://towardsdatascience.com/javascript-fatigue-you-dont-need-js-to-build-chatgpt/ \"Javascript Fatigue: HTMX Is All You Need to Build ChatGPT — Part 1\")\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607930/image?etag=1782124566054&width=500&height=500) The Subset Sum Problem Solved in Linear Time for Dense Enough Inputs ](https://towardsdatascience.com/subset-sum-problem-solved-in-linear-time-for-dense-enough-inputs/ \"The Subset Sum Problem Solved in Linear Time for Dense Enough Inputs\")\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/3660/image?etag=1780176246070&width=500&height=500) Does Your Company Have a Data Strategy? ](https://towardsdatascience.com/does-your-company-have-a-data-strategy-e8944dbec4ae/ \"Does Your Company Have a Data Strategy?\")\n\n\n",
  "metadata": {
    "title": "What Makes A Strong AI? | Towards Data Science",
    "description": "\"The Book of Why\" Chapters 9&10, a Read with Me series",
    "keywords": null,
    "author": "Zijing Zhu, PhD",
    "og:locale": "en_US",
    "og:type": "article",
    "og:title": "What Makes A Strong AI?",
    "og:description": "\"The Book of Why\" Chapters 9&10, a Read with Me series",
    "og:url": "https://towardsdatascience.com/what-makes-a-strong-ai-012315722793/",
    "og:site_name": "Towards Data Science",
    "og:image": "https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/00rRe682n9Ao_5ukJ-scaled.jpg",
    "og:image:width": "2050",
    "og:image:height": "2560",
    "og:image:type": "image/jpeg",
    "twitter:card": "summary_large_image",
    "twitter:site": "@TDataScience",
    "twitter:creator": "@TDataScience",
    "twitter:label1": "Written by",
    "twitter:data1": "Zijing Zhu, PhD",
    "twitter:label2": "Est. reading time",
    "twitter:data2": "14 min read",
    "article:published_time": "2024-01-04T17:55:05.000Z",
    "article:modified_time": "2024-01-04T17:55:05.000Z",
    "article:author": "https://towardsdatascience.com/author/zzhu17/"
  },
  "paywall": {
    "listed_paid": false,
    "detected": false,
    "marker": "",
    "public_only": false,
    "policy": "付费/会员内容只保留页面公开可见部分，不绕过付费墙"
  },
  "crawl": {
    "success": true,
    "status_code": 202,
    "error": ""
  },
  "code_blocks": [],
  "images": [
    {
      "status": "http_404",
      "url": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607686/image?etag=1782161464448&width=500&height=500",
      "src": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607686/image?etag=1782161464448&width=500&height=500",
      "alt": "",
      "downloaded": false,
      "discovery": "saved_markdown",
      "retried_at": "2026-10-20T18:10:56Z"
    },
    {
      "status": "http_404",
      "url": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607639/image?etag=1781250125848&width=500&height=500",
      "src": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607639/image?etag=1781250125848&width=500&height=500",
      "alt": "",
      "downloaded": false,
      "discovery": "saved_markdown",
      "retried_at": "2026-10-20T18:11:35Z"
    },
    {
      "status": "http_404",
      "url": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607930/image?etag=1782124566054&width=500&height=500",
      "src": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607930/image?etag=1782124566054&width=500&height=500",
      "alt": "",
      "downloaded": false,
      "discovery": "saved_markdown",
      "retried_at": "2026-10-20T18:11:35Z"
    },
    {
      "status": "http_404",
      "url": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/3660/image?etag=1780176246070&width=500&height=500",
      "src": "https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/3660/image?etag=1780176246070&width=500&height=500",
      "alt": "",
      "downloaded": false,
      "discovery": "saved_markdown",
      "retried_at": "2026-10-20T18:11:35Z"
    }
  ],
  "audio": [],
  "videos": [
    {
      "url": "https://youtube.com/channel/UCMs6go1pvY5OOy1DXVtMo5A",
      "kind": "channel_reference",
      "status": "reference_only"
    },
    {
      "url": "https://www.youtube.com/c/TowardsDataScience",
      "kind": "channel_reference",
      "status": "reference_only"
    }
  ],
  "links": [
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/latest/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/editors-pick/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/the-variable/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/shipai/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/submissions/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/category/artificial-intelligence/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/author/zzhu17/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/towards-data-science/why-understanding-the-data-generation-process-is-more-important-than-the-data-itself-f1b3b847e662"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/how-is-causal-inference-different-in-academia-and-industry-fb5afd12e2e7"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/continuous-learning-a-data-scientists-odyssey-8d3006c2ce01"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/how-i-became-a-data-scientist-7f5b10606612"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/causal-inference-what-why-and-how-d7336b0081ec"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/deep-dives/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/artificial-intelligence/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/causal-inference/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/causality/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/tag/data-science/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/plotting-time-series-boxplots-5a21f2b76cfe/"
    },
    {
      "type": "internal",
      "href": "https://towardsdatascience.com/category/data-science/"
    },
    {
      "type": "external",
      "href": "https://write.insightmediagroup.io"
    },
    {
      "type": "external",
      "href": "https://www.linkedin.com/company/towards-data-science/"
    },
    {
      "type": "external",
      "href": "https://x.com/TDataScience"
    },
    {
      "type": "external",
      "href": "https://unsplash.com/@emmages"
    },
    {
      "type": "external",
      "href": "https://unsplash.com"
    },
    {
      "type": "external",
      "href": "https://zzhu17.medium.com/list/causality-book-club-def5f1fd00fe"
    },
    {
      "type": "external",
      "href": "https://unsplash.com/@sallycrierie"
    },
    {
      "type": "external",
      "href": "https://roadmap.sh/ai-engineer"
    },
    {
      "type": "external",
      "href": "https://roadmap.sh/ai-data-scientist"
    },
    {
      "type": "external",
      "href": "https://unsplash.com/@theshubhamdhage"
    },
    {
      "type": "external",
      "href": "https://unsplash.com/@polarmermaid"
    },
    {
      "type": "external",
      "href": "https://medium.com/towards-data-science/data-tells-us-what-and-we-always-seek-for-why-66da7dc3f24d"
    },
    {
      "type": "external",
      "href": "https://medium.com/towards-data-science/causal-diagram-confronting-the-achilles-heel-in-observational-data-a69cdb1c4818"
    },
    {
      "type": "external",
      "href": "https://medium.com/towards-data-science/you-cant-step-in-the-same-river-twice-cfacf7cee305"
    },
    {
      "type": "external",
      "href": "https://unsplash.com/@ninjason"
    },
    {
      "type": "external",
      "href": "https://zzhu17.medium.com/subscribe"
    },
    {
      "type": "external",
      "href": "https://medium.com/towards-data-science/the-4ds-in-data-storytelling-making-art-out-of-science-c4998ed7875e"
    },
    {
      "type": "external",
      "href": "https://zzhu17.medium.com/my-blog-posts-gallery-ac6e01fe5cc3"
    },
    {
      "type": "external",
      "href": "https://zzhu17.medium.com/list/data-science-interview-preparation-bfb0986a61a3"
    },
    {
      "type": "external",
      "href": "https://zzhu17.medium.com/membership"
    }
  ],
  "repair_version": 2,
  "repaired_at": "2026-10-20T17:34:51Z",
  "source_url": "https://towardsdatascience.com/what-makes-a-strong-ai-012315722793/",
  "delivery_status": "unverified",
  "discovery_status": "http_403",
  "missing_reason": "源页面未重新核验:http_403；已按保留正文补采图片",
  "repair_error": "",
  "actual_video_files": [],
  "expected_saved_body_images": 4,
  "image_discovery": "saved_markdown",
  "source_body_markdown": "![Revisit consent button](https://cdn-cookieyes.com/assets/images/revisit.svg)\nWe value your privacy\nWe use cookies to enhance your browsing experience, serve personalised ads or content, and analyse our traffic. By clicking \"Accept All\", you consent to our use of cookies.\nCustomise Reject All Accept All\nCustomise Consent Preferences ![](https://cdn-cookieyes.com/assets/images/close.svg)\nWe use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.\nThe cookies that are categorised as \"Necessary\" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... Show more\nNecessaryAlways Active\nNecessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.\n  * Cookie\nBCTempID\n  * Duration\n10 minutes\n  * Description\nNo description available.\n\n\n  * Cookie\n__cf_bm\n  * Duration\n1 hour\n  * Description\nThis cookie, set by Cloudflare, is used to support Cloudflare Bot Management. \n\n\n  * Cookie\nAWSALBCORS\n  * Duration\n7 days\n  * Description\nAmazon Web Services set this cookie for load balancing.\n\n\n  * Cookie\n_cfuvid\n  * Duration\nsession\n  * Description\nCloudflare sets this cookie to track users across sessions to optimize user experience by maintaining session consistency and providing personalized services\n\n\n  * Cookie\nli_gc\n  * Duration\n6 months\n  * Description\nLinkedin set this cookie for storing visitor's consent regarding using cookies for non-essential purposes.\n\n\n  * Cookie\n__hssrc\n  * Duration\nsession\n  * Description\nThis cookie is set by Hubspot whenever it changes the session cookie. The __hssrc cookie set to 1 indicates that the user has restarted the browser, and if the cookie does not exist, it is assumed to be a new session.\n\n\n  * Cookie\n__hssc\n  * Duration\n1 hour\n  * Description\nHubSpot sets this cookie to keep track of sessions and to determine if HubSpot should increment the session number and timestamps in the __hstc cookie.\n\n\n  * Cookie\nwpEmojiSettingsSupports\n  * Duration\nsession\n  * Description\nWordPress sets this cookie when a user interacts with emojis on a WordPress site. It helps determine if the user's browser can display emojis properly.\n\n\n  * Cookie\nBCSessionID\n  * Duration\n1 year 1 month 4 days\n  * Description\nBlueconic sets this cookie as a unique identifier for the BlueConic profile.\n\n\n  * Cookie\n_octo\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\nlogged_in\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\n__Secure-YEC\n  * Duration\npast\n  * Description\nYouTube sets this cookie to stores the user's video player preferences using embedded YouTube video\n\n\n  * Cookie\n__eoi\n  * Duration\n6 months\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nAWSALBTGCORS\n  * Duration\n7 days\n  * Description\nNo description available.\n\n\n  * Cookie\nlogin-status-p\n  * Duration\npast\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nAWSALBTG\n  * Duration\n7 days\n  * Description\nNo description available.\n\n\n  * Cookie\ncsrf_token\n  * Duration\nsession\n  * Description\nNo description available.\n\n\n  * Cookie\ntoken_v2\n  * Duration\n1 day\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nD\n  * Duration\n1 year\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nPHPSESSID\n  * Duration\nsession\n  * Description\nThis cookie is native to PHP applications. The cookie stores and identifies a user's unique session ID to manage user sessions on the website. The cookie is a session cookie and will be deleted when all the browser windows are closed.\n\n\n  * Cookie\nVISITOR_PRIVACY_METADATA\n  * Duration\n6 months\n  * Description\nYouTube sets this cookie to store the user's cookie consent state for the current domain. \n\n\n  * Cookie\ncookietest\n  * Duration\nsession\n  * Description\nThe cookietest cookie is typically used to determine whether the user's browser accepts cookies, essential for website functionality and user experience.\n\n\n  * Cookie\n__Host-airtable-session\n  * Duration\n1 year\n  * Description\nThis cookie is used to enable us to integrate the services of Airtable.\n\n\n  * Cookie\n__Host-airtable-session.sig\n  * Duration\n1 year\n  * Description\nThis cookie is used to enable us to integrate the services of Airtable.\n\n\n  * Cookie\nm\n  * Duration\n1 year 1 month 4 days\n  * Description\nStripe sets this cookie for fraud prevention purposes. It identifies the device used to access the website, allowing the website to be formatted accordingly.\n\n\n  * Cookie\nBIGipServer*\n  * Duration\nsession\n  * Description\nMarketo sets this cookie to collect information about the user's online activity and build a profile about their interests to provide advertisements relevant to the user. \n\n\n  * Cookie\n__cfruid\n  * Duration\nsession\n  * Description\nCloudflare sets this cookie to identify trusted web traffic.\n\n\n  * Cookie\n_GRECAPTCHA\n  * Duration\n6 months\n  * Description\nGoogle Recaptcha service sets this cookie to identify bots to protect the website against malicious spam attacks.\n\n\n  * Cookie\n__Secure-YNID\n  * Duration\n6 months\n  * Description\nGoogle cookie used to protect user security and prevent fraud, especially during the login process.\n\n\n  * Cookie\ncookieyes-consent\n  * Duration\n1 year\n  * Description\nCookieYes sets this cookie to remember users' consent preferences so that their preferences are respected on subsequent visits to this site. It does not collect or store any personal information about the site visitors.\n\n\nFunctional\nFunctional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.\n  * Cookie\nlidc\n  * Duration\n1 day\n  * Description\nLinkedIn sets the lidc cookie to facilitate data center selection.\n\n\n  * Cookie\nbrw\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\nbrwConsent\n  * Duration\n5 minutes\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nWMF-Uniq\n  * Duration\n1 year\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nloom_anon_comment\n  * Duration\n1 year\n  * Description\nNo description available.\n\n\n  * Cookie\nloom_referral_video\n  * Duration\nsession\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nVISITOR_INFO1_LIVE\n  * Duration\n6 months\n  * Description\nA cookie set by YouTube to measure bandwidth that determines whether the user gets the new or old player interface.\n\n\n  * Cookie\nyt-remote-connected-devices\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to store the user's video preferences using embedded YouTube videos.\n\n\n  * Cookie\nytidb::LAST_RESULT_ENTRY_KEY\n  * Duration\nNever Expires\n  * Description\nThe cookie ytidb::LAST_RESULT_ENTRY_KEY is used by YouTube to store the last search result entry that was clicked by the user. This information is used to improve the user experience by providing more relevant search results in the future.\n\n\n  * Cookie\nyt-remote-device-id\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to store the user's video preferences using embedded YouTube videos.\n\n\n  * Cookie\nyt-remote-session-name\n  * Duration\nsession\n  * Description\nThe yt-remote-session-name cookie is used by YouTube to store the user's video player preferences using embedded YouTube video.\n\n\n  * Cookie\nyt-remote-fast-check-period\n  * Duration\nsession\n  * Description\nThe yt-remote-fast-check-period cookie is used by YouTube to store the user's video player preferences for embedded YouTube videos.\n\n\n  * Cookie\nyt-remote-session-app\n  * Duration\nsession\n  * Description\nThe yt-remote-session-app cookie is used by YouTube to store user preferences and information about the interface of the embedded YouTube video player.\n\n\n  * Cookie\nyt-remote-cast-available\n  * Duration\nsession\n  * Description\nThe yt-remote-cast-available cookie is used to store the user's preferences regarding whether casting is available on their YouTube video player.\n\n\n  * Cookie\nyt-remote-cast-installed\n  * Duration\nsession\n  * Description\nThe yt-remote-cast-installed cookie is used to store the user's video player preferences using embedded YouTube video.\n\n\n  * Cookie\ncp_session\n  * Duration\n3 months\n  * Description\nCodepen sets this cookie for Help systems found in the website.\n\n\n  * Cookie\nloid\n  * Duration\n1 year 1 month 4 days\n  * Description\nThis cookie is set by the Reddit. The cookie enables the sharing of content from the website onto the social media platform.\n\n\nAnalytics\nAnalytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.\n  * Cookie\n__hstc\n  * Duration\n6 months\n  * Description\nHubspot set this main cookie for tracking visitors. It contains the domain, initial timestamp (first visit), last timestamp (last visit), current timestamp (this visit), and session number (increments for each subsequent session).\n\n\n  * Cookie\nhubspotutk\n  * Duration\n6 months\n  * Description\nHubSpot sets this cookie to keep track of the visitors to the website. This cookie is passed to HubSpot on form submission and used when deduplicating contacts.\n\n\n  * Cookie\n_ga\n  * Duration\n1 year 1 month 4 days\n  * Description\nGoogle Analytics sets this cookie to calculate visitor, session and campaign data and track site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognise unique visitors.\n\n\n  * Cookie\n_ga_*\n  * Duration\n1 year 1 month 4 days\n  * Description\nGoogle Analytics sets this cookie to store and count page views.\n\n\n  * Cookie\n__Host-psifi.analyticsTrace\n  * Duration\n6 hours\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\n__Host-psifi.analyticsTraceV2\n  * Duration\n6 hours\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\n_gh_sess\n  * Duration\nsession\n  * Description\nGitHub sets this cookie for temporary application and framework state between pages like what step the user is on in a multiple step form.\n\n\n  * Cookie\nYSC\n  * Duration\nsession\n  * Description\nYSC cookie is set by Youtube and is used to track the views of embedded videos on Youtube pages.\n\n\n  * Cookie\najs_anonymous_id\n  * Duration\n1 year\n  * Description\nThis cookie is set by Segment to count the number of people who visit a certain site by tracking if they have visited before.\n\n\n  * Cookie\nvuid\n  * Duration\n1 year 1 month 4 days\n  * Description\nVimeo installs this cookie to collect tracking information by setting a unique ID to embed videos on the website. \n\n\nPerformance\nPerformance cookies are used to understand and analyse the key performance indexes of the website which helps in delivering a better user experience for the visitors.\n  * Cookie\nAWSALB\n  * Duration\n7 days\n  * Description\nAWSALB is an application load balancer cookie set by Amazon Web Services to map the session to the target.\n\n\n  * Cookie\nacq\n  * Duration\npast\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nacq.sig\n  * Duration\npast\n  * Description\nDescription is currently not available.\n\n\n  * Cookie\nptc\n  * Duration\n2 years\n  * Description\nNo description available.\n\n\nAdvertisement\nAdvertisement cookies are used to provide visitors with customised advertisements based on the pages you visited previously and to analyse the effectiveness of the ad campaigns.\n  * Cookie\nmuc_ads\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to collect user behaviour and interaction data to optimize the website.\n\n\n  * Cookie\nguest_id_marketing\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to identify and track the website visitor.\n\n\n  * Cookie\nguest_id_ads\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to identify and track the website visitor.\n\n\n  * Cookie\npersonalization_id\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to integrate and share features for social media and also store information about how the user uses the website, for tracking and targeting.\n\n\n  * Cookie\nguest_id\n  * Duration\n1 year 1 month 4 days\n  * Description\nTwitter sets this cookie to identify and track the website visitor. It registers if a user is signed in to the Twitter platform and collects information about ad preferences.\n\n\n  * Cookie\nbcookie\n  * Duration\n1 year\n  * Description\nLinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser IDs.\n\n\n  * Cookie\n__Secure-ROLLOUT_TOKEN\n  * Duration\n6 months\n  * Description\nYouTube sets this cookie to manage feature rollout and experimentation. It helps Google control which new features or interface changes are shown to users as part of testing and staged rollouts, ensuring consistent experience for a given user during an experiment.\n\n\n  * Cookie\nyt.innertube::nextId\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to register a unique ID to store data on what videos from YouTube the user has seen.\n\n\n  * Cookie\nyt.innertube::requests\n  * Duration\nNever Expires\n  * Description\nYouTube sets this cookie to register a unique ID to store data on what videos from YouTube the user has seen.\n\n\n  * Cookie\nsession_tracker\n  * Duration\nsession\n  * Description\nThis cookie is set by the Reddit. This cookie is used to identify trusted web traffic. It also helps in adverstising on the website.\n\n\n  * Cookie\nedgebucket\n  * Duration\nsession\n  * Description\nReddit sets this cookie to save the information about a log-on Reddit user, for the purpose of advertisement recommendations and updating the content.\n\n\n  * Cookie\ndid\n  * Duration\n1 year\n  * Description\nArbor sets this cookie to show targeted ads to site visitors.This cookie expires after 2 months or 1 year.\n\n\nUncategorised\nOther uncategorised cookies are those that are being analysed and have not been classified into a category as yet.\nNo cookies to display.\nReject All Save My Preferences Accept All\nToggle Search[](https://towardsdatascience.com/)Toggle Mobile Navigation\n[](https://towardsdatascience.com/)\nPublish AI, ML & data-science insights to a global community of data professionals.\nSign in[Submit an Article](https://write.insightmediagroup.io)\n[Latest](https://towardsdatascience.com/latest/)[Editor's Picks](https://towardsdatascience.com/tag/editors-pick/)[Newsletter](https://towardsdatascience.com/tag/the-variable/)[ShipAI](https://towardsdatascience.com/shipai/)\n* * *\n[Write For TDS](https://towardsdatascience.com/submissions/)\n[LinkedIn](https://www.linkedin.com/company/towards-data-science/)[X](https://x.com/TDataScience)Toggle Search\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\n# What Makes A Strong AI?\n\"The Book of Why\" Chapters 9&10, a Read with Me series\n[Zijing Zhu, PhD](https://towardsdatascience.com/author/zzhu17/)\nJanuary 4, 202414 min read\n![Photo by Emmanuel Ikwuegbu on Unsplash](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/00rRe682n9Ao_5ukJ-scaled.jpg)\nPhoto by [Emmanuel Ikwuegbu](https://unsplash.com/@emmages?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nWhat Makes A Strong AI?\nWe are at the last article [reading Judea Pearl's inspiring \"The Book of Why,\"](https://zzhu17.medium.com/list/causality-book-club-def5f1fd00fe) and it will mostly focus on mediators and how to combine causality with big data to derive trustworthy conclusions. I will also summarize what makes a strong AI in the end based on the whole book.\n* * *\n### Mediators\nWe have briefly talked about mediation in the previous articles. We mentioned it is important to identify mediators not only because we shouldn't treat them as confounders, since conditioning on them will block the causal effect completely or partially, but also in proper cases, we can use mediators for front-door criterion when unobserved confounders exist.\n![Photo by sally crierie on Unsplash](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/0bY9tQkw1-lYwu2kR-scaled.jpg)\nPhoto by [sally crierie](https://unsplash.com/@sallycrierie?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nIn this section, we will dive deeper into different examples of mediators and understand how to properly define direct causal effect, indirect causal effect, and total causal effect when mediators exist.\nLearn this step by step with the interactive [AI Engineer](https://roadmap.sh/ai-engineer) and [AI and Data Scientist](https://roadmap.sh/ai-data-scientist) roadmaps.\nIn history, scurvy had always been the most terrifying disease for sailors. Before vitamins were discovered and properly named, scientists struggled to figure out how to prevent sailors from getting scurvy. They first asked what is the cause - **why** did some sailors get scurvy and some don't? Having observed that citrus fruits helped reduce scurvy, they needed to explain **why** citrus fruits help prevent scurvy, which led to the discovery of Vitamin C.\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1Hu1ZbMM9Z44rK8pX7-X0NA.png)\nImage by Author based on The Book of Why Chapter 9\nMediators provide answers to the second \"why\" question. In this example, Vitamin C is the mediator for the citrus fruits to take into effect, and citrus fruits have no direct effect on scurvy. If we dry or boil these fruits, it won't help prevent scurvy anymore.\nUnlike the previous example, in many cases, there are two paths for a cause to effect. The route that connects cause to effect directly represents the direct causal effect. There may exist another route that connects the cause and effect through a mediator, which produces the indirect causal effect.\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1D9Adko4dDsMAyByOwXrGUA.png)\nImage by Author based on The Book of Why Chapter 9\nThus, a one-unit change in the cause will impact the outcome variable in two paths, and only the total effect is what we observe. In this section, we will explore some examples to see why it is important to isolate the direct and indirect effects from the total effects. To estimate the direct and indirect effects, we need to borrow the concept of counterfactuals from the last article, and we will discuss more details in the next section.\n### Algebra for All\nChicago Public School system once introduced an \"Algebra for All\" program that required all ninth graders to take college-prep math courses. To understand whether taking these courses improved students' test grades causally, we first need to remove confounders, like other curriculum changes that would also impact students' test grades. After careful consideration, researchers found no significant improvement in test scores. However, before jumping into claiming the program is not effective, the researcher examined more on how can introducing new courses impact students' grades. It turned out that \"Algebra for All\" not only changed the curriculum but also changed the teaching environment where lower-achieving students are mixed with higher-achieving students during class. Larger class size not only reduces teaching efficiency but also discourage lower-achieving students from catching up. Thus, we have the following causal graph when adding \"Environment\" as a mediator:\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1G7lapIZIBd3lSkt2bWj5yw.png)\nImage by Author based on The Book of Why Chapter 9\nHere, the direct effect of \"Algebra for All\" on learning is positive, but the indirect effect through the mediator \"Environment\" is negative. Thus, the total effect without distinguishing the direct and indirect effects will more than likely be minimal.\nIn this case, the researcher estimated the direct effect and indirect effect individually. Since the results did show a positive direct effect and a negative indirect effect, the researcher concluded that \"Allegra for All\" should increase students' test scores if maintaining the pre policy classroom environment.\n### Revisit The Smoking Gene\nFrom previous articles, we might be very familiar with the debate happening when analyzing the causal effect of smoking on lung cancer. One confounder that was brought into the front stage was the smoking gene:\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1C_MjWMBTOs2CpQ98AtAMsA.png)\nImage by Author based on The Book of Why Chapter 9\nWith progress in medical research, genomics experts did locate the smoking gene, what they called \"Mr. Big,\" because of its strong association with lung cancer. The finding of the smoking gene shouldn't overshadow smoking as a causal factor in lung cancer. Nevertheless, even a double dose of the smoking gene doesn't double the risk of getting lung cancer.\nHow can the discovery of the smoking gene help us other than serving as a confounder? If we make a small shift on the **same** causal graph and treat smoking gene as the treatment and smoking as a mediator to lung cancer:\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1rk3RlHkBoocNjWb1lXx7Mw.png)\nImage by Author based on The Book of Why Chapter 9\nWith this change, as Pearl mentioned, we can estimate the smoking gene's direct effect: Does the smoking gene make lung cells more vulnerable to cancer? We can also estimate the smoking gene's indirect effect: Does the smoking gene make people smoke more and inhale harder?\nComparing whether direct or indirect is higher will give different action guidance. If the direct effect is higher, then people with the smoking gene should receive extra screening for lung cancer throughout their lives. On the contrary, if the indirect effect is higher, health professionals should pay more attention to intervening in the smoking behaviors of individuals carrying the smoking gene.\n* * *\n### Estimate Direct and Indirect Effects\nAfter demonstrating the importance of isolating direct effect and indirect effect, let's move to how to estimate the causal effect, a Rung 2&3 question, from Rung 1 data.\nFor a long period of time, the standard way of estimating direct and direct effects follows simple rules. Supposed we have the following causal diagram with the coefficients representing the causal effects:\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/18E_yje7GGTlJhiJxICGz2Q.png)\nImage by Author based on The Book of Why Chapter 9\nThe direct effect would be **a** , and the indirect effect would be **b** _**c.**__****Thus, ******__ **the total effect with one unit increase in the cause is **a+b**_ c. However, there are some assumptions needed to arrive at this conclusion.\nThe first assumption is that all variables follow linear relationships. There is a simple example in Pearl's book that shows that if we change the linear relationship simply to binary conditions, this would not work. Moreover, in essence, a linear relationship would not be able to capture the case when there are interactions between the cause and the mediator.\n![Photo by Shubham Dhage on Unsplash](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/0nSecwi8Y8RFbU8go-scaled.jpg)\nPhoto by [Shubham Dhage](https://unsplash.com/@theshubhamdhage?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nNo interaction is a strong assumption. Take \"Algebra for All\" as an example. It is very likely that a more challenging curriculum, combined with a less supportive classroom environment, will be more discouraging for low-achieving students to get better grades. The linear system would not be able to reflect this interaction.\nAnother assumption made here is this equation:\n> Total Effect = Direct Effect + Indirect Effect\nThis sounds very logical. What's the problem with this? In the book, Pearl gives an example. Suppose we are estimating the efficiency of a drug that doesn't have a direct effect but has an indirect effect through stimulating enzymes.\n![Image by Author based on The Book of Why Chapter 9](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1NqTyjtsHmgfV2zdKmXWdQg.png)\nImage by Author based on The Book of Why Chapter 9\nWe know the total effect is positive because the drug is effective. The direct effect is zero because if we disable the enzyme, the drug will not work.\nWhen estimating the indirect effect, and we block the drug and artificially get the enzyme, the disease would not be cured because it would only work if we combine the drug and the enzyme.\nThis is another example of interaction between cause and mediator. In this case, the total effect is positive, but both direct and indirect effects are zeros.\nThe essence of the challenges, in my opinion, is how to define the quantity of mediator M when calculating indirect effect, especially when there are interactions between X and M.\nWe know the value of M when there is treatment, **what would have been the value of M without the treatment**? And **how does this value differ across individuals**?\nThese questions all point to the concept we have discussed in the previous chapter - - counterfactuals. If the direct effect is\n> The effect remaining after holding the mediator fixed\nThe definition Pearl gives for indirect effect is more complicated:\n> The indirect effect of X on Y is the increase we would see in Y while **holding X constant** and increasing M to whatever value M **would attain** under a unit increase in X.\nThe key here is we first need to know what M **would have been** when X changes before we know it's indirect impact on Y. With counterfactuals embedded, Pearl presents the two equations to estimate direct and indirect effects. The natural direct effect (NDE) is:\n![](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1Sv22bKxPHWEGnYT1KxBwpA.png)\nHere we make the mediator fixed at M0, a value that M would have been given that X takes the value 0. In the \"Algebra for All\" example, M would be the teaching environment, or specifically, the classroom size when there is no curriculum change. We are comparing the direct impact of do(X=0) and do(X=1) on outcome Y=1.\nThe natural indirect effect (NIE) is:\n![](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1oBcG9DZ4lD-2QgP5pYtIMw.png)\nHere we ensure _**do(X=0)**_ on both terms to ensure no direct effects. Note we make the mediator take the value of M1 in the first term, which is what M would be given that X=1. For example, what the classroom size would have been given that the \"Algebra for All\" program had launched. In the second term, however, the mediator takes the value of M0. The natural indirect effect basically calculates a difference that is only deduced by the change in the value of the mediator, and how much the mediator will change from M0 to M1 depends largely on the causal relationship between X and M.\n![Photo by Anne Nygård on Unsplash](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/0PxIdBY93IoytJNKn-scaled.jpg)\nPhoto by [Anne Nygård](https://unsplash.com/@polarmermaid?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nArriving at these equations was not an easy task. There are so many more details to this journey, with generations of researchers' efforts. You can refer to Pearl's book for more.\n* * *\n### Causality and Big Data\nAll throughout the book, Pearl tries to prove that only relying on data without understanding causality is not enough to derive trustworthy results. However, data and models are never enemies. In fact, having data is the first step to arrive at any conclusion. For the last chapter of the book, Pearl explores the opportunities we have combining causality and big data:\n> Causal inference permits us to screen off the irrelevant characteristics and to recruit these individuals from diverse studies, while Big Data allows us to gather enough information about them.\nTo illustrate how we can combine causal models and data from different studies to get new insights, Pearl shows an example to analyze an online advertisement(X) on the likelihood that a consumer will purchase the product(Y). If the company already has data from different cities' previous campaigns, like in Los Angeles, Boston, Toronto, etc, and is looking for ways to generalize the results to the population in Arkansas, with the help of causal diagrams, there might be ways we can measure the effect in new population without all the new data, or any new data.\nSpecifically, let's look at the causal diagram showing how the online campaign causes sales to increase:\n![Image by Author based on The Book of Why Chapter 10](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1OAf2Imvn89klWWdsSVWjCQ.png)\nImage by Author based on The Book of Why Chapter 10\nThere is Z representing confounders. In this case, Z could be age, showing that some products are only preferred by certain age groups, like young people, and they also happen to be more exposed to online promotions. W represents the mediator for X to affect Y. For example, it could be the click rate on a link that converts customers from seeing an advertisement to purchasing the product.\nIn the easiest case, suppose we already have survey data from Boston from their past campaigns and the only difference between Boston and Arkansas population is the rate of car ownership. Let S represent the difference between these two populations, and we can revise the causal diagram:\n![Image by Author based on The Book of Why Chapter 10](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1oeYRi2JLdedDVKksR4bzGw.png)\nImage by Author based on The Book of Why Chapter 10\nIf the causal diagram holds, it means the effect of the Arkansas online advertisement should be the same as in Boston since S and V will not affect the causal path X->W->Y because it's blocked by the collider Z.\nIn a more complicated case, suppose we have survey data from Los Angeles, and the difference is that the LA population might be younger. The revised causal diagram would be:\n![Image by Author based on The Book of Why Chapter 10](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1TKG1m_cbael-FjW-Ijexdg.png)\nImage by Author based on The Book of Why Chapter 10\nIn this case, S is impacting the X->Y causal effects through the confounder Z. Thus, we need to reweigh the data in LA to account for the different age structures.\nIf we cannot measure Z in Arkansas, we can instead look for randomized trials that might have been done in other cities and see whether we can adjust for Arkansas. For example, if we have randomized trials from Toronto, and the only difference is that Toronto has a higher click-through rate:\n![Image by Author based on The Book of Why Chapter 10](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1LLmHMATKOblJI4p9sULE9g.png)\nImage by Author based on The Book of Why Chapter 10\nSince this is a randomized experiment, we could remove the path between X and Z. By just collecting data on X, W, and Y in Arkansas, we can estimate the causal impact with the results from Toronto.\nEven in the case where S impacts Y directly, i.e., the product is more desirable in this city:\n![](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/1RBdRI8Gld7MfngUQ393KBA.png)\nAgain, this is from experiment data so we can remove the link between X and Z. Even if the difference S directly impacts Y, we can still use this city's estimation on P(W|X) to contribute partially to the overall causal impact.\nAll these examples show that Big Data is our friend. Combining with reasonable causal structure, we know which sets of data are desired to derive trustworthy causal effects, which saves us trouble from always running randomized trials or collecting as much data as possible.\n* * *\n### What Makes A Strong AI\nIn the last two months of 2023, we have been indulging in the world of causality through reading \"The Book of Why\" by Judea Pearl. Time flies. We said goodbye to 2023 and to \"The Book of Why.\" However, this won't be the end of exploring the fascinating world of causality and pushing the boundaries of artificial intelligence. Pearl illustrates what makes a strong AI in every chapter, and I briefly talked about in my previous articles:\n  * [**Chapter1 &2: Data Tells Us 'What\" and We Always Seek for \"Why\"**](https://medium.com/towards-data-science/data-tells-us-what-and-we-always-seek-for-why-66da7dc3f24d)**:**\n\n\nA strong AI never makes decisions only based on correlations. It needs to step up from Rung 1, \"seeing,\" to Rung 2, \"intervening,\" and Rung 3, \"imagining.\" Not only do they need to know what the patterns were from the past, but they also need to understand why these patterns came up to make intelligent predictions.\n  * [**Chapter3 &4: Causal Diagram: Confronting the Achilles' Heel in Observational Data**](https://medium.com/towards-data-science/causal-diagram-confronting-the-achilles-heel-in-observational-data-a69cdb1c4818)**:**\n\n\nA strong AI never makes decisions based on rules. Instead, it draws conclusions following causal structures. In addition to having the ability to derive the probability of an outcome based on the probability of cause, it also knows to update its belief that given the outcome, what's the probability of cause. With the help of causal diagrams, a strong AI goes beyond the Bayesian network and is capable of finding causality in observational studies.\n  * [**Chapter5 &6:Why Understanding the Data-Generation Process Is More Important Than the Data Itself**](https://towardsdatascience.com/towards-data-science/why-understanding-the-data-generation-process-is-more-important-than-the-data-itself-f1b3b847e662)**:**\n\n\nA strong AI knows how to distinguish spurious correlations and true causalities. It will not mistake collider bias as causation, and will not eliminate causal impacts by conditioning on mediators.\n  * [**Chapter7 &8 You Can't Step in the Same River Twice**](https://medium.com/towards-data-science/you-cant-step-in-the-same-river-twice-cfacf7cee305)**:**\n\n\nA strong AI resembles human brains when categorizing causes into necessary causes and sufficient causes. Although multiple variables can be the causal factors for an outcome, human brains automatically \"rank\" these factors based on how rare events happen and what are the action points. A strong AI not only looks for why but also ranks the why.\n![Photo by Jason Leung on Unsplash](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/01/0Lv4H8AAV1XgLh3D0-scaled.jpg)\nPhoto by [Jason Leung](https://unsplash.com/@ninjason?utm_source=medium&utm_medium=referral) on [Unsplash](https://unsplash.com?utm_source=medium&utm_medium=referral)\nIn the last two chapters, Pearl also mentioned the importance of transparency in the AI decision making process. Just like we want to know the why about everything, we want to know why the AI makes this decision.\nNot all AI researchers are fans of transparency. In Pearl's book, he mentions:\n> The field at that time was divided into \"neats\" (who wanted transparent systems with guarantees of behavior) and \"scruffies\" (who just wanted something that worked)\nAlthough _**scruffies**_ could get temporary solutions, a strong AI is a transparent AI so that humans can better coach it, tailor it the way we like, and even learn from it. Ultimately, humans always long for effective communication. As Pearl said, it would be \"_**quite unfortunate**_ \" if we cannot hold meaningful conversations with AI.\n2023 was a revolutionary year. With the widespread use of Generative AI, we are hopeful and simultaneously intimidated by what AI can do, just like when we were facing any new technology in history. Pearl is optimistic, he said at the end of the book:\n> Once we have built a moral robot...... we will be able to depend on our machines for a clear-eyed and causally sound sense of justice...... Such a thinking machine would be a wonderful companion for our species and would truly qualify as AI's first and best gift to humanity.\nHowever, having data, no matter how much more, will not enable machines to resemble human-level intelligence without embedding causal models, with which, AI can \"_think about own intentions and reflect on its own mistakes_.\" The AI that climbs above Rung 1 to make Rung 2 interventions and Rung 3 counterfactuals. And this is how we make a strong AI.\n* * *\nThanks for reading. This concludes the Read with Me series. What an amazing collective learning experience! The good news is that I plan to publish a bonus article in two weeks to officially close this series.\n> [**How is Causal Inference Different in Academia and Industry?**](https://towardsdatascience.com/how-is-causal-inference-different-in-academia-and-industry-fb5afd12e2e7)\nIf interested, [subscribe to my email list](https://zzhu17.medium.com/subscribe) to get notified of my future articles. If you like this article, don't forget to:\n  * _**Check my recent articles about**_[ _**the 4Ds in data storytelling: making art out of science**_](https://medium.com/towards-data-science/the-4ds-in-data-storytelling-making-art-out-of-science-c4998ed7875e); [_**continuous learning in data science**_](https://towardsdatascience.com/continuous-learning-a-data-scientists-odyssey-8d3006c2ce01) _**;**_[_**how I become a data scientist**_](https://towardsdatascience.com/how-i-became-a-data-scientist-7f5b10606612) _**;**_\n  * _**Check my**_[ _**other articles**_](https://zzhu17.medium.com/my-blog-posts-gallery-ac6e01fe5cc3) _**on different topics like**_[ _**data science interview preparation**_](https://zzhu17.medium.com/list/data-science-interview-preparation-bfb0986a61a3) _**;**_[_**causal inference**_](https://towardsdatascience.com/causal-inference-what-why-and-how-d7336b0081ec) _**;**_\n  * [_**Subscribe**_](https://zzhu17.medium.com/subscribe) _**to my email list;**_\n  * [_**Sign up for medium membership**_](https://zzhu17.medium.com/membership) _**;**_\n  * _**Or follow me on**_[ _**YouTube**_](https://youtube.com/channel/UCMs6go1pvY5OOy1DXVtMo5A) _**and watch my most recent YouTube videos:**_\n\n\nPlease accept cookies to access this content\n## Register Now to Continue Reading\n### Unlock Towards Data Science with a Free Account\nAll articles on Towards Data Science are available to registered users. Create a free account today to access this article and thousands more.\nRegister for freeSign in to your account\n* * *\n![](https://assets.insightmediagroup.io/media/1787657091723_tdcxmv.png)\nWritten By\n## [Zijing Zhu, PhD](https://towardsdatascience.com/author/zzhu17/)\n[See all from Zijing Zhu, PhD](https://towardsdatascience.com/author/zzhu17/)\n[Deep Dives](https://towardsdatascience.com/tag/deep-dives/)[Artificial Intelligence](https://towardsdatascience.com/tag/artificial-intelligence/)[Causal Inference](https://towardsdatascience.com/tag/causal-inference/)[Causality](https://towardsdatascience.com/tag/causality/)[Data Science](https://towardsdatascience.com/tag/data-science/)\nShare This Article\n  * [](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Ftowardsdatascience.com%2Fwhat-makes-a-strong-ai-012315722793%2F&title=What%20Makes%20A%20Strong%20AI%3F)\n  * [](https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Ftowardsdatascience.com%2Fwhat-makes-a-strong-ai-012315722793%2F&title=What%20Makes%20A%20Strong%20AI%3F)\n  * [](https://x.com/share?url=https%3A%2F%2Ftowardsdatascience.com%2Fwhat-makes-a-strong-ai-012315722793%2F&text=What%20Makes%20A%20Strong%20AI%3F)\n\n\nTowards Data Science is a community publication. Submit your insights to reach our global audience and earn through the TDS Author Payment Program.\n[Write for TDS](https://towardsdatascience.com/submissions/)\n## Related Articles\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2022/03/0UfMCmtHO2hUCBb5m-scaled.jpg)](https://towardsdatascience.com/plotting-time-series-boxplots-5a21f2b76cfe/)\n## [Plotting Time Series Boxplots](https://towardsdatascience.com/plotting-time-series-boxplots-5a21f2b76cfe/)\n[Data Science](https://towardsdatascience.com/category/data-science/)\nLearn how to plot time series boxplots using matplotlib and Seaborn\n[Wei-Meng Lee](https://towardsdatascience.com/author/weimenglee/)\nMarch 25, 20225 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2025/12/ai-bubble.jpg)](https://towardsdatascience.com/the-ai-bubble-will-pop-and-why-that-doesnt-matter/)\n## [The AI Bubble Will Pop — And Why That Doesn’t Matter](https://towardsdatascience.com/the-ai-bubble-will-pop-and-why-that-doesnt-matter/)\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\nHow history’s biggest tech bubble explains where AI is headed next\n[Michael Malin](https://towardsdatascience.com/author/michael-malin/)\nDecember 8, 20257 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2023/08/0r7QumwU6SiHNGTw5-scaled.jpg)](https://towardsdatascience.com/interview-preparation-causal-inference-44fbb8b0a5c6/)\n## [Interview Preparation: Causal Inference](https://towardsdatascience.com/interview-preparation-causal-inference-44fbb8b0a5c6/)\n[Data Science](https://towardsdatascience.com/category/data-science/)\nLearn how to tackle interview questions related to causal inference, gaining insights into the core concepts and applications.\n[Julie Zhang](https://towardsdatascience.com/author/juliezhang0826/)\nAugust 11, 20236 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2025/05/planet-volumes-Xs09fW9Y3kw-unsplash-scaled-1.jpg)](https://towardsdatascience.com/make-your-data-move-creating-animations-in-python-for-science-and-machine-learning/)\n## [Make Your Data Move: Creating Animations in Python for Science and Machine Learning](https://towardsdatascience.com/make-your-data-move-creating-animations-in-python-for-science-and-machine-learning/)\n[Data Visualization](https://towardsdatascience.com/category/data-science/data-visualization/)\nGo beyond static plots with matplotlib.\n[MARCUS SENA](https://towardsdatascience.com/author/marcusmvls-vinicius/)\nMay 6, 20256 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2021/02/0kEjSv_NaU5kEArhh-scaled.jpeg)](https://towardsdatascience.com/pandas-vs-tidyverse-on-textual-data-23c6a7c2df8c/)\n## [Pandas vs Tidyverse on Textual Data](https://towardsdatascience.com/pandas-vs-tidyverse-on-textual-data-23c6a7c2df8c/)\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\nHow to manipulate strings in both libraries\n[Soner Yıldırım](https://towardsdatascience.com/author/sonery/)\nFebruary 6, 20215 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2020/01/1hVdLJhi_4as7kvzAiT7-JA.png)](https://towardsdatascience.com/hey-siri-what-does-it-mean-to-be-human-f06fa6e251ce/)\n## [Hey Siri, what does it mean to be human?](https://towardsdatascience.com/hey-siri-what-does-it-mean-to-be-human-f06fa6e251ce/)\n[Artificial Intelligence](https://towardsdatascience.com/category/artificial-intelligence/)\nBefore suggesting that AI can enhance human potential, it can be useful to ask what separates humanity from the progress of technology\n[Lee Schlenker](https://towardsdatascience.com/author/leeschlenker/)\nJanuary 10, 20204 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2024/11/05le5TfjYK4R593Uf-scaled.jpg)](https://towardsdatascience.com/why-stem-is-important-for-any-data-scientist-45b8ec1d445d/)\n## [Why STEM Is Important for Any Data Scientist](https://towardsdatascience.com/why-stem-is-important-for-any-data-scientist-45b8ec1d445d/)\n[Machine Learning](https://towardsdatascience.com/category/artificial-intelligence/machine-learning/)\n3 cases to prove this from my own experience\n[Radmila Mandzhieva](https://towardsdatascience.com/author/radmilamandzhi/)\nNovember 14, 20247 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2021/10/0nXgGjLQLF9UwHfJc-scaled.jpg)](https://towardsdatascience.com/version-control-your-large-datasets-using-google-drive-dd42211ab740/)\n## [Version Control your Large Datasets using Google Drive](https://towardsdatascience.com/version-control-your-large-datasets-using-google-drive-dd42211ab740/)\n[Data Science](https://towardsdatascience.com/category/data-science/)\nMaking reproducible datasets possible\n[Pratik Gandhi](https://towardsdatascience.com/author/pratikkgandhi/)\nOctober 18, 20214 min read\n  * [![](https://assets.insightmediagroup.io/media/wp-content/uploads/2026/08/00-cover.jpg)](https://towardsdatascience.com/introduction-to-semi-supervised-learning/)\n## [Introduction to Semi-Supervised Learning](https://towardsdatascience.com/introduction-to-semi-supervised-learning/)\n[Machine Learning](https://towardsdatascience.com/category/artificial-intelligence/machine-learning/)\nA primer about Semi-Supervised Learning, the approaches taken with different algorithms and the limitations of using unlabelled data.\n[Carolina Bento](https://towardsdatascience.com/author/carolina%20bento/)\nAugust 5, 20267 min read\n\n\n  * [YouTube](https://www.youtube.com/c/TowardsDataScience)\n  * [X](https://x.com/TDataScience)\n  * [LinkedIn](https://www.linkedin.com/company/towards-data-science/)\n  * [Threads](https://www.threads.net/@towardsdatascience)\n  * [Bluesky](https://bsky.app/profile/towardsdatascience.com)\n\n\n[](https://towardsdatascience.com/)\nYour home for data science and AI. The world's leading publication for data science, data analytics, data engineering, machine learning, and artificial intelligence professionals.\nSubscribe to Our Newsletter[Write For TDS](https://towardsdatascience.com/submissions/)•[About](https://towardsdatascience.com/about-towards-data-science-d691af11cc2f/)•[Advertise](https://contact.towardsdatascience.com/advertise-with-towards-data-science)•[Privacy Policy](https://towardsdatascience.com/privacy-policy/)•[Terms of Use](https://towardsdatascience.com/website-terms-of-use/)\n© Insight Media Group, LLC 2026•[The New Stack](https://thenewstack.io)•[roadmap.sh](https://roadmap.sh)•[Creator Network](https://insightmediagroup.io/creator-network)\n####  Recommended Articles \nClose\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607686/image?etag=1782161464448&width=500&height=500) How Relevance Models Foreshadowed Transformers for NLP ](https://towardsdatascience.com/how-relevance-models-foreshadowed-transformers-for-nlp/ \"How Relevance Models Foreshadowed Transformers for NLP\")\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607639/image?etag=1781250125848&width=500&height=500) Javascript Fatigue: HTMX Is All You Need to Build ChatGPT — Part 1 ](https://towardsdatascience.com/javascript-fatigue-you-dont-need-js-to-build-chatgpt/ \"Javascript Fatigue: HTMX Is All You Need to Build ChatGPT — Part 1\")\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/607930/image?etag=1782124566054&width=500&height=500) The Subset Sum Problem Solved in Linear Time for Dense Enough Inputs ](https://towardsdatascience.com/subset-sum-problem-solved-in-linear-time-for-dense-enough-inputs/ \"The Subset Sum Problem Solved in Linear Time for Dense Enough Inputs\")\n  * [ ![](https://h030.towardsdatascience.com/rest/v2/contentStores/d7d3a4ab-7caf-4383-bbd2-fbf7fb4f1787/items/3660/image?etag=1780176246070&width=500&height=500) Does Your Company Have a Data Strategy? ](https://towardsdatascience.com/does-your-company-have-a-data-strategy-e8944dbec4ae/ \"Does Your Company Have a Data Strategy?\")\n\n\n",
  "body_base_path": "attachments/d17d5dbc26e7/pages/",
  "body_markdown_path": "attachments/d17d5dbc26e7/pages/archived-body.md",
  "local_html": "attachments/d17d5dbc26e7/pages/archived-body.html",
  "body_source": "prior_capture"
}