{ "source_file": "0930", "source_platform": "个人博客", "author": "Sebastian Ruder", "title_listed": "ACL 2022 Highlights", "keywords": "ACL,NLP,亮点", "domain": "文本处理", "content_type": "行业分析", "is_paid_flag": "否", "url": "https://www.ruder.io/acl2022/", "publish_date": "2022-06", "corpus_stage": "预训练/SFT", "notes": "ACL 2022亮点回顾", "id": "1b98909faa67", "collected_at": "2026-10-02T14:16:33", "title": "ACL 2022 Highlights", "body_markdown": "events\nACL 2022 Highlights\nThis post discusses my highlights of ACL 2022, including language diversity and multimodality, prompting, the next big ideas and keynotes, my favorite papers, and the hybrid conference experience.\nSebastian Ruder\n06 Jun 2022\n•\n16 min read\nShare\nACL 2022\ntook place in Dublin from 22nd–27th May 2022. This was my first in-person conference since ACL 2019. This is also my first conference highlights post since\nNAACL 2019\n. With 1032 accepted papers (604 long, 97 short, 331 in Findings), this post can only offer a glimpse of the diverse research presented at the conference—biased towards my research interests.\nHere are the themes that were most noticeable for me across the conference program:\nLanguage Diversity and Multimodality\nPrompting\nNext Big Ideas\nFavorite Papers\nThe Dark Matter of Language and Intelligence\nHybrid Conference Experience\nHere are highlights of other conference attendees:\nMultimodality at ACL 2022\nby Mubashara Akhtar\nNotes from ACL 2022\nby Jindřich Libovický\nMy First In-Person NLP Conference\nby Yong Zheng-Xin\nIf you attended ACL, I encourage you to reflect on and write up your impressions of the conference (send me a message and I will link them here).\nLanguage diversity and multimodality\nPanelists and their spoken languages at the ACL 2022 keynote panel on supporting linguistic diversity.\nACL 2022 had a theme track on the topic of “Language Diversity: from Low-Resource to Endangered Languages”. Beyond the excellent papers in the track, language diversity also permeated other parts of the conference. Steven Bird hosted a panel on language diversity featuring researchers speaking and studying under-represented languages (\nslides\n). The panelists shared their experiences and discussed interlingual power dynamics, among other topics. They also made practical suggestions to encourage more work on such languages: creating data resources; establishing a conference track for work on low-resource and endangered languages; and encouraging researchers to apply their systems to low-resource language data. They also mentioned a positive development, that researchers are becoming more aware of the value of high-quality datasets. Overall, the panelists emphasised that working with such languages requires respect—towards the speakers, the culture, and the languages themselves.\nEndangered languages were also the focus of the\nCompute-EL workshop\n. In the awards ceremony, the\nbest linguistic insight paper\nproposed KinyaBERT, a pre-trained model for Kinyarwanda that leverages a morphological analyzer. The\nbest theme paper\ndeveloped speech synthesis models for three Canadian indigenous languages. The latter is an example of how multimodal approaches can benefit language diversity.\nOther multimodal papers leveraged phone representations to improve NER performance in Swahili and Kinyarwanda (\nLeong & Whitenack\n). For low-resource text-to-speech,\nLux & Vu\nemploy articulatory features such as position (e.g., frontness of the tongue) and category (e.g., voicedness), which generalize better to unseen phonemes. Some work also explored new multimodal applications such as detecting fingerspelling in American sign language (\nShi et al.\n) or translating songs for tonal languages (\nGuo et al.\n).\nThe\nMultilingual Multimodal workshop\nhosted a shared task on multilingual visually grounded reasoning on the\nMaRVL dataset\n. Seeing the emergence of such multilingual multimodal approaches is particularly encouraging as it is an improvement over the previous year’s ACL where multimodal approaches mainly dealt with English (based on an analysis of “multi-dimensional” NLP research we did for an\nACL 2022 Findings paper\n).\nMy invited talk on scaling NLP systems to the next 1000 languages.\nIn an invited talk (\nslides\n), I emphasized multimodality in addition to three other challenges towards scaling NLP systems to the next 1,000 languages: computational efficiency, real-world evaluation, and language varieties. Multimodality is also at the heart of the\nACL 2022 D&I Special Initiative “60-60 Globalization via localisation”\nannounced by Mona Diab. The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. Another useful aspect of the initiative is the curation of the most common CL terms and their translation into 60 languages. The unavailability of accurate scientific expressions poses a barrier to entry in many languages (see\nthis related Masakhane project\nto decolonise science). The CL community is well positioned to advance the accessibility of scientific content and I am excited to see the progress of this grassroots initiative.\nUnder-represented languages typically have little text data available. Two tutorials focused on applying models to such low-resource settings. The\ntutorial on learning with limited text data\ndiscussed data augmentation, semi-supervised learning, and applications to multilinguality while the tutorial on\nzero-shot and few-shot NLP with pre-trained language models\ncovered prompting, in-context learning, gradient-based LM task adaptation, among others.\nThe KinyaBERT model architecture. The morphological analyzer produces morphemes for each word. Embeddings of POS tags (red), affix set (purple), affixes (green), and stems (yellow) are fed into a shallow transformer encoder. The output is then processed by a standard transformer encoder (\nNzeyimana & Rubungo\n).\nHow to optimally represent tokens across different languages is an open problem. The conference program featured several new approaches to overcome this challenge. KinyaBERT (\nNzeyimana & Rubungo\n) leveraged a morphological word segmentation approach. Similarly,\nHofmann et al.\npropose a method that aims to preserve the morphological structure of words during tokenization. The algorithm tokenizes a word by determining its longest substring in the vocabulary and then recursing on the remaining string until a certain number of recursive calls.\nRather than choosing subwords that occur frequently in the multilingual pre-training data (which biases the model towards high-resource languages),\nPatil et al.\npropose a method that prefers subwords that are shared across multiple languages. Both CANINE (\nClark et al.\n) and ByT5 (\nXue et al.\n) do away with tokenization completely and operate directly on bytes.\nFour dimensions along which cultures vary, and for which NLP can be culturally biased (\nHershcovich et al.\n).\nLanguages naturally do not only differ in their linguistic form but also in their culture, which includes the shared knowledge, values, and goals of speakers, among other things.\nHershcovich et al.\nprovide a great overview of what is important for cross-cultural NLP. A particular form of cultural-specific knowledge relates to time and temporal expressions such as morning, which may refer to different hours in different languages (\nSchwartz\n).\nHere are some of my favorite papers, beyond the ones already mentioned above:\nTowards Afrocentric NLP for African Languages: Where We Are and Where We Can Go\n(Adebara & Abdul-Mageed). This paper discusses challenges of NLP for African languages and makes practical recommendations on how to address each. It highlights both linguistic phenomena (handling tone, vowel harmony, and serial verb constructions) and other challenges on the continent (low literacy, non-standardized orthographies, lack of language use in official contexts).\nQuality at a Glance: An Audit of Web-Crawled Multilingual Datasets\n(Kreutzer et al.). I\nwrote about this paper\nwhen it first came out. It conducts a careful audit of large-scale multilingual datasets covering 70 languages and identifies many data quality issues that have previously gone unnoticed. It highlights that many low-resource language datasets have low quality and that some datasets are even completely mislabeled.\nMulti Task Learning For Zero Shot Performance Prediction of Multilingual Models\n(Ahuja et al.). We would like to know how well a model does if we apply it to data in a new language, which can inform how many examples we need to annotate. This paper makes performance prediction more robust by jointly learning to predict performance across multiple tasks. This also enables an analysis of features that affect zero-shot transfer across all tasks.\nI had the chance to collaborate on a couple of papers in this space:\nOne Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia\n(Aji et al.). We provide an overview of NLP challenges for Indonesia’s 700+ languages (Indonesia is the world’s second most linguistically diverse country). Among these are dialectal and style differences, code-mixing, and orthographic variation. We make practical recommendations such as documenting dialect, style, and register information in datasets.\nExpanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation\n(Wang et al.). We analyze different strategies using bilingual lexicons (which are available in around 5000 languages) to synthesize data for training models for extremely low-resource languages and how such data can be combined with existing data, if available. In particular, we find that this works much better than translation (as the performance of an NMT model for such languages is often poor).\nSquare One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold\n(Ruder et al.). We identify the current prototypical NLP experiment (the “square one”) and assess the dimensions along which NLP papers make contributions that go beyond this prototype by annotating the 461 ACL 2021 oral papers. We find that almost 70% of papers evaluate only in English and almost 40% of papers only evaluate performance. Only 6.3% of papers evaluate the bias or fairness of a method and only 6.1% of papers are “multi-dimensional”, i.e., they make a contribution along two or more of our investigated dimensions.\nPrompting\nThe interplay of prompt-related components in\nOpenPrompt\n.\nPrompting was another area that received a lot of attention. The\nbest demo paper\nwas\nOpenPrompt\n, an open-source framework for learning with prompts that allows to easily define templates and verbalizers and to combine them with pre-trained models.\nA common thread of research was to incorporate external knowledge into learning.\nHu et al.\npropose to expand the verbalizer with words from a knowledge base.\nLiu et al.\nuse an LM to generate relevant knowledge statements in a few-shot setting. A second LM then uses these to answer commonsense questions. We can also incorporate additional knowledge by modifying the training data, e.g., by inserting metadata strings (e.g., entity types and descriptions) after entities (\nArora et al.\n).\nFine-tuning a Transformer encoder-decoder to predict a target summary and entity chain (\nNarayan et al.\n).\nOther papers proposed prompts particularly suited for specific applications.\nReif et al.\npropose to provide a model with examples of multiple styles for style transfer while\nTabasi et al.\ncompare independently obtained embeddings of [MASK] tokens using a similarity function for semantic similarity tasks.\nNarayan et al.\nsteer a summarization model by training it to predict a chain of entities before the target summary (e.g., “[ENTITYCHAIN] Frozen | Disney“).\nSchick et al.\nprompt a model with questions containing an attribute (e.g., “Does the above text contain a threat?”) to diagnose if a model’s generated text is offensive.\nBen-David et al.\ngenerate the domain name and domain-related features as a prompt for domain adaptation.\nGenerating prompts using T5 for image-text-alignment with CLIP (\nSong et al.\n).\nPrompting in a multimodal setting also received some attention.\nJin et al.\nanalyze the effect of diverse prompts in a few-shot setting.\nSong et al.\ninvestigate prompting for vision-and-language few-shot learning with\nCLIP\n. They generate prompts based on VQA questions using T5 and filter out impossible answers with the LM. Prompts are then paired with the target image and used to calculate image-text alignment scores with CLIP.\nFinally, there were a few papers seeking to obtain a better understanding of prompting.\nMishra et al.\nexplore different ways of reformulating instructions such as decomposing a complex task into several simpler tasks or itemizing instructions.\nLu et al.\nanalyze the sensitivity of models to the order of few-shot examples. As the best permutation cannot be identified without additional development data, they generate a synthetic dev set using the LM itself and determine the best example order via entropy.\nThe following papers on which I collaborated relate to few-shot learning:\nFewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding\n(Zheng et al.). We introduce an evaluation framework to make few-shot evaluation more reliable, including a new data split strategy. We re-evaluate state-of-the-art few-shot learning methods under this framework. We observe that the absolute and relative performance of some methods was overestimated and that improvements of some methods decrease with a larger pre-trained model, among other things.\nMemorisation versus Generalisation in Pre-trained Language Models\n(Tänzer et al.). We study the memorisation and generalisation behaviour of state-of-the-art pre-trained models. We observe that current models are resistant even to high degrees of label noise and that training can be separated into three distinct phases. We also observe that pre-trained models forget drastically less than non-pre-trained models. Finally, we propose an extension to make models more resilient to low-frequency patterns.\nNext Big Ideas\nThe next big ideas panel featuring (from left to right) Dan Roth, Heng Ji, Thamar Solorio, Mirella Lapata and Iryna Gurevych (moderator). Not pictured: Marco Baroni, Eduard Hovy, and Hang Li who participated virtually.\nOne of my favorite sessions of the conference was the\nNext Big Ideas session\n, a new format pioneered by the conference organizers. The session featured senior researchers providing opinionated takes on important research directions.\nTwo themes stuck out for me during this session: structure and modularity. Researchers stressed the need for extracting and representing structured information such as relations, events, and narratives. They also emphasised the importance of putting thought into\nhow\nthese are represented—through human definitions and the design of appropriate schemas. Many topics required dealing with multiple interdependent tasks, whether for story understanding, reasoning, or schema learning. This will require multiple models or components interfacing with each other. If you want to learn more about modular approaches, we will be teaching a tutorial on modular and parameter-efficient fine-tuning for NLP models at EMNLP 2022. As a whole, these research proposals sketched a compelling vision of NLP models extracting, representing, and reasoning with complex knowledge in a structured, multi-agent manner.\nHeng Ji\nstarted off the session with a passionate plea for more structure in NLP models. She emphasized moving towards corpus-level IE (from current sentence-level and document-level IE) and noted the extraction of relations and structures from other types of text such as scientific articles and relation and event extraction for low-resource languages. In the multimodal setting, images and videos can be converted into visual tokens, organized into structures, and described with structured templates. Extracted structures can be further generalized into patterns and event schemas. We can represent structure by embedding it in pre-trained models, encoding it via a graph neural network or via global constraints.\nMirella Lapata\ndiscussed stories and why we should pay attention to them. Stories have shape, structure, and recurrent themes and are at the heart of NLU. They are also relevant for many practical applications such as question answering and summarization. To process stories, we need to do semi-supervised learning and train models that can process very long inputs and deal with multiple, interdependent tasks (such as modeling characters, events, temporality, etc). This requires modular models as well as including humans in the loop.\nDan Roth\nstressed the importance of reasoning for making decisions based on NLU. In light of the diverse set of reasoning processes, this requires multiple interdependent models and a planning process that determines what modules are relevant. We also need to be able to reason about time and other quantities. To this end, we need to be able to extract, contextualize, and scope relevant information and provide explanations for the reasoning process. To supervise models, we can use incidental supervision such as comparable texts (\nRoth, 2017\n).\nThamar Solorio\ndiscussed how to serve the half of the world’s population that is multilingual and frequently employs\ncode-switching\n. In contrast, current language technology mainly caters to monolingual speakers. Informal settings where code-switching is commonly used are becoming increasingly relevant such as in the context of chatbots, voice assistants, and social media. She noted challenges such as limited resources, “noise” in conversational data, and issues with transliterated data. We also need to identify relevant uses as code-switching is not relevant in all NLP scenarios. Ultimately, “we need language models that are representative of the actual ways in which people use language” (\nDingemanse & Liesenfeld\n). For more on code-switching, check out\nthis excellent ACL 2021 survey\n.\nMarco Baroni\nfocused on modularity. He laid out a research vision where frozen pre-trained networks autonomously interact by interfacing with each other to solve new tasks together. He suggested that models should communicate through a learned interface protocol that is easily generalizable.\nEduard Hovy\nurged us to rediscover the need for representation and knowledge. When knowledge is rare or never appears in the training data such as implicit knowledge, it is not learned by our models. To fill these gaps, we need to define the set of human goals that we care about and schemas that capture what was not said or what is going to be said. This requires evolving schema learning to a set of inter-related schemas such as schemas of patient, epidemiologist, and pathogen in the context of a pandemic. Similarly, to capture roles of people in groups, we need human definitions and guidance. Overall, he encouraged the community to put thought into building topologies that can be learned by models.\nFinally,\nHang Li\nemphasized the need for symbolic reasoning. He suggested a neuro-symbolic architecture for NLU that combines analogical reasoning via a pre-trained model and logical reasoning via symbolic components.\nIn addition to the Next Big Ideas session, the conference also featured\nspotlight talks by early-career researchers\n. I had the honor to speak next to amazing young researchers such as\nEunsol Choi\n,\nDiyi Yang\n,\nRyan Cotterell\n, and\nSwabha Swayamdipta\n. I hope that future conferences will continue with these formats and experiment with others as they bring a fresh perspective and enable a broader view of research.\nFavorite Papers\nExample narratives containing an idiom (top) or a simile (bottom), along with human-written plausible and implausible continuations (\nChakrabarty et al.\n).\nFinally, here are some of my favorite papers on less mainstream topics. Quite a few of these are in\nTACL\n, highlighting the usefulness of TACL as a venue for publishing nuanced research. Many of these also emphasize the human side of NLP:\nIt’s not Rocket Science: Interpreting Figurative Language in Narratives\n(Chakrabarty et al.). This paper focuses on understanding figurative language (idioms and similes). They evaluate whether models can interpret such figurative expressions by framing the task in an LM setting: they generate plausible and implausible continuations using crowd workers, which rely on the correct interpretation of the expression. They find that state-of-the-art models perform poorly on this task but performance can be improved by providing additional context or knowledge-based inferences (e.g., “The narrator sweats from nerves”, “Run is used for exercise”) as input.\nWord Acquisition in Neural Language Models\n(Chang & Bergen). This paper investigates when individual words are acquired during training in neural models, compared to word acquisition in humans. They find that LMs rely far more on word frequency than children (who rely more on interaction and sensorimotor experience). Like children, LMs also exhibit slower learning of words in longer utterances. Early in training, models predict based on unigram token frequencies, later on bigram probabilities, and eventually converge to more nuanced predictions.\nThe Moral Debater: A Study on the Computational Generation of Morally Framed Arguments\n(Alshomary et al.). This paper studies the automatic generation of morally framed arguments. The system takes a controversial topic (e.g., globalization), a stance (e.g., pro), and a set of morals (e.g., loyalty, authority, and purity) as input, retrieves and filters relevant texts based on the morals, and phrases an argument. They employ a Reddit dataset annotated with aspects (e.g., respect, obedience), which they map to morals. They evaluate the effectiveness of morally framed arguments in a user study with liberals and conservatives.\nHuman Language Modeling\n(Soni et al.). This paper extends the language modeling task with a dependence on a human state in which the text was generated. To this end, they process all utterances of a user sequentially and condition a Transformer’s self-attention on a recurrently computed user state. The model is pre-trained on Facebook posts and tweets with user information where it achieves a dramatic reduction in perplexity and improvements on downstream stance and sentiment tasks.\nInducing Positive Perspectives with Text Reframing\n(Ziems et al.). This paper introduces the task of positive reframing, which neutralizes a negative point of view and generates a more positive perspective without contradicting the meaning (e.g., “I absolutely hate making decisions” → “It’ll become easier once I start to get used to it”). They create a new dataset for this task, annotated with different reframing strategies. Overall, the task is an interesting and challenging application of style transfer—and who is not in need of positive reframing sometimes?\nThe Dark Matter of Language and Intelligence\nYejin Choi speculates on what ACL 2082 may be like, highlighting possible applications for contemporary research areas.\nYejin Choi gave an inspiring keynote. Among other things, it is the first talk I have seen that uses\nDALL-E 2\nfor illustrating slides. She highlighted three important research areas in NLP by drawing analogies to physics: ambiguity, reasoning, and implicit information.\nIn modern physics, a greater understanding often leads to increased ambiguity (see, for instance,\nSchrödinger’s cat\nor the\nwave–particle duality\n). Yejin similarly encouraged the ACL community to embrace ambiguity. In the past, there was pressure not to work on tasks that did not achieve high inter-annotator agreement; similarly, in traditional sentiment analysis, the neutral class is often discarded. Understanding cannot just be crammed into simple categories. Annotator opinions bias language models (\nSap et al., 2021\n) and ambiguous examples improve generalization (\nSwayamdipta et al., 2020\n).\nSimilar in spirit to the notion of\nspacetime\n, Yejin argued that language, knowledge, and reasoning are also not separate areas but exist on a continuum. Reasoning methods such as maieutic prompting (\nJung et al., 2022\n) allow us to investigate the continuum of a model’s knowledge by recursively generating explanations.\nFinally, analogous to the central role of dark matter in modern physics, future research in NLP should focus on the “dark matter” of language, the unspoken rules of how the world works, which influence the way people use language. We should aspire to try to teach our models such as tacit rules, values, and objectives (\nJiang et al., 2021\n).\nYejin concluded her talk with a candid take of factors that led to her success: being humble, learning from others, taking risks; but also being lucky and working in an inclusive environment.\nHybrid conference experience\nThe Convention Centre Dublin, the venue of ACL 2022 (right) and the view of Samuel Beckett Bridge from the venue (right).\nI personally really enjoyed the in-person conference experience. There was a\nstrict mask wearing requirement\n, which everyone adhered to and which did not otherwise impede the flow of the conference. The only issues were some technical problems that occurred during plenary and keynote talks.\nOn the other hand, I found it difficult to reconcile the in-person with the virtual conference experience. Virtual poster sessions overlapped with breakfast or dinner, which made attending them difficult. From what I have heard, many virtual poster sessions were almost empty. It seems we need to rethink how to conduct virtual poster sessions in a hybrid setting. As an alternative, it may be more effective to create asynchronous per-poster chat rooms in\nrocket.chat\nor a similar platform, with the ability to set up impromptu video calls for deeper conversations.\nThe experience was better for oral presentations and workshops, which had a reasonable number of virtual participants. I particularly appreciate being able to rewatch the recordings of keynotes and other invited talks.\nOverall, we still have some way to go to create a great experience for virtual participants. However, it was a blast being able to interact with people in-person again. Thanks to all the organizers, volunteers, and to the community for putting together a great conference!", "metadata": { "title": "ACL 2022 Highlights", "description": "This post discusses my highlights of ACL 2022, including language diversity and multimodality, prompting, the next big ideas and keynotes, my favorite papers, and the hybrid conference experience.", "keywords": null, "author": null, "og:site_name": "ruder.io", "og:type": "article", "og:title": "ACL 2022 Highlights", "og:description": "This post discusses my highlights of ACL 2022, including language diversity and multimodality, prompting, the next big ideas and keynotes, my favorite papers, and the hybrid conference experience.", "og:url": "https://www.ruder.io/acl2022/", "og:image": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/acl_dublin_logo.png", "og:image:width": "1001", "og:image:height": "438", "twitter:card": "summary_large_image", "twitter:title": "ACL 2022 Highlights", "twitter:description": "This post discusses my highlights of ACL 2022, including language diversity and multimodality, prompting, the next big ideas and keynotes, my favorite papers, and the hybrid conference experience.", "twitter:url": "https://www.ruder.io/acl2022/", "twitter:image": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/acl_dublin_logo.png", "twitter:label1": "Written by", "twitter:data1": "Sebastian Ruder", "twitter:label2": "Filed under", "twitter:data2": "events, natural language processing", "twitter:site": "@seb_ruder", "article:published_time": "2022-06-06T10:33:47.000Z", "article:modified_time": "2022-06-07T07:10:38.000Z", "article:tag": "natural language processing" }, "paywall": { "listed_paid": false, "detected": false, "marker": "", "public_only": false, "policy": "付费/会员内容只保留页面公开可见部分，不绕过付费墙" }, "crawl": { "success": true, "status_code": 200, "error": "" }, "code_blocks": [], "images": [ { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/size/w2000/2022/06/acl_dublin_logo.png", "bytes": 16595, "reused": false, "local_path": "attachments/1b98909faa67/images/body-8b748359133e3b1741b7.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/size/w2000/2022/06/acl_dublin_logo.png", "alt": "ACL 2022 Highlights", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/acl_2022_keynote_panel.png", "bytes": 1454370, "reused": true, "local_path": "attachments/1b98909faa67/images/001.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/acl_2022_keynote_panel.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/IMG_8540.JPG", "bytes": 96744, "reused": true, "local_path": "attachments/1b98909faa67/images/002.jpg", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/IMG_8540.JPG", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/kinyabert.png", "bytes": 244615, "reused": true, "local_path": "attachments/1b98909faa67/images/003.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/kinyabert.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/cultural_nlp.png", "bytes": 204312, "reused": false, "local_path": "attachments/1b98909faa67/images/body-187cda3d6df01cb58532.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/cultural_nlp.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/open_prompt.png", "bytes": 357571, "reused": false, "local_path": "attachments/1b98909faa67/images/body-44ec90023568b36ff53c.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/open_prompt.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/summarization_entity_chain.png", "bytes": 1081738, "reused": false, "local_path": "attachments/1b98909faa67/images/body-2688154932b77f6baa08.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/summarization_entity_chain.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/clip_prompts.png", "bytes": 577158, "reused": false, "local_path": "attachments/1b98909faa67/images/body-9a567a6248545f9a9c14.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/clip_prompts.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/next_big_ideas_panel.png", "bytes": 1444252, "reused": false, "local_path": "attachments/1b98909faa67/images/body-d41841208c55514e80ad.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/next_big_ideas_panel.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/tacl_a_00478_f001.png", "bytes": 378342, "reused": false, "local_path": "attachments/1b98909faa67/images/body-064982a0d6a77d373dfc.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/tacl_a_00478_f001.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/yejin_choi_keynote.png", "bytes": 2396625, "reused": false, "local_path": "attachments/1b98909faa67/images/body-e9d28caa922e8bfc7f72.png", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/yejin_choi_keynote.png", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/PXL_20220522_120522679.MP.jpg", "bytes": 479790, "reused": true, "local_path": "attachments/1b98909faa67/images/004.jpg", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/PXL_20220522_120522679.MP.jpg", "alt": "", "downloaded": true }, { "status": "ok", "url": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/PXL_20220524_092733061.MP.jpg", "bytes": 635226, "reused": true, "local_path": "attachments/1b98909faa67/images/009.jpg", "src": "https://storage.ghost.io/c/bd/89/bd89d480-b8e0-47e6-8bae-dcb0d061b8d7/content/images/2022/06/PXL_20220524_092733061.MP.jpg", "alt": "", "downloaded": true } ], "audio": [], "videos": [], "links": [ { "href": "https://www.ruder.io/tag/events/", "label": "events", "type": "a" }, { "href": "https://www.ruder.io/author/sebastian/", "label": "", "type": "a" }, { "href": "https://www.2022.aclweb.org/?ref=ruder.io", "label": "ACL 2022", "type": "a" }, { "href": "https://ruder.io/naacl2019/?ref=ruder.io", "label": "NAACL 2019", "type": "a" }, { "href": "https://www.mubasharaakhtar.com/post/multimodality-at-acl-2022?ref=ruder.io", "label": "Multimodality at ACL 2022", "type": "a" }, { "href": "https://jlibovicky.github.io/2022/06/02/Notes-from-ACL-2022.html?ref=ruder.io", "label": "Notes from ACL 2022", "type": "a" }, { "href": "https://yongzx.github.io/blog/articles/22/ACL22?ref=ruder.io", "label": "My First In-Person NLP Conference", "type": "a" }, { "href": "https://docs.google.com/presentation/d/1GfrtGnw-bfWWk7jltYeDyVuY9QIlTbW9lqW9IlgHOHs?ref=ruder.io", "label": "slides", "type": "a" }, { "href": "https://computel-workshop.org/computel-5/?ref=ruder.io", "label": "Compute-EL workshop", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.367/?ref=ruder.io", "label": "best linguistic insight paper", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.507/?ref=ruder.io", "label": "best theme paper", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.364/?ref=ruder.io", "label": "Leong & Whitenack", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.472/?ref=ruder.io", "label": "Lux & Vu", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.119/?ref=ruder.io", "label": "Shi et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.findings-acl.60/?ref=ruder.io", "label": "Guo et al.", "type": "a" }, { "href": "https://mml-workshop.github.io/?ref=ruder.io", "label": "Multilingual Multimodal workshop", "type": "a" }, { "href": "https://marvl-challenge.github.io/?ref=ruder.io", "label": "MaRVL dataset", "type": "a" }, { "href": "https://aclanthology.org/2022.findings-acl.184/?ref=ruder.io", "label": "ACL 2022 Findings paper", "type": "a" }, { "href": "https://drive.google.com/file/d/16YfD5Dh4PJwB-h_NOk4xLJYbgEL-tF7w/view?ref=ruder.io", "label": "slides", "type": "a" }, { "href": "https://www.2022.aclweb.org/dispecialinitiative?ref=ruder.io", "label": "ACL 2022 D&I Special Initiative “60-60 Globalization via localisation”", "type": "a" }, { "href": "https://www.masakhane.io/ongoing-projects/masakhane-mt-decolonise-science?ref=ruder.io", "label": "this related Masakhane project", "type": "a" }, { "href": "https://github.com/diyiy/ACL2022_Limited_Data_Learning_Tutorial?ref=ruder.io", "label": "tutorial on learning with limited text data", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-short.43/?ref=ruder.io", "label": "Hofmann et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.18/?ref=ruder.io", "label": "Patil et al.", "type": "a" }, { "href": "https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00448/109284/Canine-Pre-training-an-Efficient-Tokenization-Free?ref=ruder.io", "label": "Clark et al.", "type": "a" }, { "href": "https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00461/110049/ByT5-Towards-a-Token-Free-Future-with-Pre-trained?ref=ruder.io", "label": "Xue et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.482/?ref=ruder.io", "label": "Hershcovich et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.findings-acl.224/?ref=ruder.io", "label": "Schwartz", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.265/?ref=ruder.io", "label": "Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Go", "type": "a" }, { "href": "https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00447/109285/Quality-at-a-Glance-An-Audit-of-Web-Crawled?ref=ruder.io", "label": "Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets", "type": "a" }, { "href": "https://newsletter.ruder.io/issues/qa-how-did-we-get-here-adapting-to-time-data-detectives-379447?ref=ruder.io", "label": "wrote about this paper", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.374/?ref=ruder.io", "label": "Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.500/?ref=ruder.io", "label": "One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.61/?ref=ruder.io", "label": "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation", "type": "a" }, { "href": "https://github.com/thunlp/OpenPrompt?ref=ruder.io", "label": "OpenPrompt", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-demo.10/?ref=ruder.io", "label": "best demo paper", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.158/?ref=ruder.io", "label": "Hu et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.225/?ref=ruder.io", "label": "Liu et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.findings-acl.137/?ref=ruder.io", "label": "Arora et al.", "type": "a" }, { "href": "https://aclanthology.org/2021.tacl-1.88/?ref=ruder.io", "label": "Narayan et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-short.94/?ref=ruder.io", "label": "Reif et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-short.36/?ref=ruder.io", "label": "Tabasi et al.", "type": "a" }, { "href": "https://arxiv.org/abs/2103.00453?ref=ruder.io", "label": "Schick et al.", "type": "a" }, { "href": "https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00468/110538/PADA-Example-based-Prompt-Learning-for-on-the-fly?ref=ruder.io", "label": "Ben-David et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.421/?ref=ruder.io", "label": "Song et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.197/?ref=ruder.io", "label": "Jin et al.", "type": "a" }, { "href": "https://openai.com/blog/clip/?ref=ruder.io", "label": "CLIP", "type": "a" }, { "href": "https://aclanthology.org/2022.findings-acl.50/?ref=ruder.io", "label": "Mishra et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.556/?ref=ruder.io", "label": "Lu et al.", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.38/?ref=ruder.io", "label": "FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.521/?ref=ruder.io", "label": "Memorisation versus Generalisation in Pre-trained Language Models", "type": "a" }, { "href": "https://www.2022.aclweb.org/invited-talks?ref=ruder.io", "label": "Next Big Ideas session", "type": "a" }, { "href": "http://blender.cs.illinois.edu/hengji.html?ref=ruder.io", "label": "Heng Ji", "type": "a" }, { "href": "https://homepages.inf.ed.ac.uk/mlap/index.php?page=index&ref=ruder.io", "label": "Mirella Lapata", "type": "a" }, { "href": "https://www.cis.upenn.edu/~danroth/?ref=ruder.io", "label": "Dan Roth", "type": "a" }, { "href": "https://arxiv.org/abs/2005.12339?ref=ruder.io", "label": "Roth, 2017", "type": "a" }, { "href": "http://solorio.uh.edu/?ref=ruder.io", "label": "Thamar Solorio", "type": "a" }, { "href": "https://en.wikipedia.org/wiki/Code-switching?ref=ruder.io", "label": "code-switching", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.385/?ref=ruder.io", "label": "Dingemanse & Liesenfeld", "type": "a" }, { "href": "https://aclanthology.org/2021.acl-long.131/?ref=ruder.io", "label": "this excellent ACL 2021 survey", "type": "a" }, { "href": "https://marcobaroni.org/?ref=ruder.io", "label": "Marco Baroni", "type": "a" }, { "href": "https://www.cs.cmu.edu/~hovy/?ref=ruder.io", "label": "Eduard Hovy", "type": "a" }, { "href": "https://scholar.google.com/citations?user=nTl5mSwAAAAJ&hl=en&ref=ruder.io", "label": "Hang Li", "type": "a" }, { "href": "https://www.cs.utexas.edu/~eunsol/?ref=ruder.io", "label": "Eunsol Choi", "type": "a" }, { "href": "https://faculty.cc.gatech.edu/~dyang888/?ref=ruder.io", "label": "Diyi Yang", "type": "a" }, { "href": "https://rycolab.io/authors/ryan/?ref=ruder.io", "label": "Ryan Cotterell", "type": "a" }, { "href": "https://swabhs.com/?ref=ruder.io", "label": "Swabha Swayamdipta", "type": "a" }, { "href": "https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00478/111221/It-s-not-Rocket-Science-Interpreting-Figurative?ref=ruder.io", "label": "Chakrabarty et al.", "type": "a" }, { "href": "https://transacl.org/index.php/tacl?ref=ruder.io", "label": "TACL", "type": "a" }, { "href": "https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00444/109271/Word-Acquisition-in-Neural-Language-Models?ref=ruder.io", "label": "Word Acquisition in Neural Language Models", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.601/?ref=ruder.io", "label": "The Moral Debater: A Study on the Computational Generation of Morally Framed Arguments", "type": "a" }, { "href": "https://aclanthology.org/2022.findings-acl.52/?ref=ruder.io", "label": "Human Language Modeling", "type": "a" }, { "href": "https://aclanthology.org/2022.acl-long.257/?ref=ruder.io", "label": "Inducing Positive Perspectives with Text Reframing", "type": "a" }, { "href": "https://openai.com/dall-e-2/?ref=ruder.io", "label": "DALL-E 2", "type": "a" }, { "href": "https://en.wikipedia.org/wiki/Schr%C3%B6dinger%27s_cat?ref=ruder.io", "label": "Schrödinger’s cat", "type": "a" }, { "href": "https://en.wikipedia.org/wiki/Wave%E2%80%93particle_duality?ref=ruder.io", "label": "wave–particle duality", "type": "a" }, { "href": "https://arxiv.org/abs/2111.07997?ref=ruder.io", "label": "Sap et al., 2021", "type": "a" }, { "href": "https://arxiv.org/abs/2009.10795?ref=ruder.io", "label": "Swayamdipta et al., 2020", "type": "a" }, { "href": "https://en.wikipedia.org/wiki/Spacetime?ref=ruder.io", "label": "spacetime", "type": "a" }, { "href": "https://arxiv.org/abs/2205.11822?ref=ruder.io", "label": "Jung et al., 2022", "type": "a" }, { "href": "https://arxiv.org/abs/2110.07574?ref=ruder.io", "label": "Jiang et al., 2021", "type": "a" }, { "href": "https://www.2022.aclweb.org/covid-19-safety?ref=ruder.io", "label": "strict mask wearing requirement", "type": "a" }, { "href": "https://rocket.chat/?ref=ruder.io", "label": "rocket.chat", "type": "a" } ], "repair_version": 2, "repaired_at": "2026-10-14T10:52:08Z", "source_url": "https://www.ruder.io/acl2022/", "papers": [ { "status": "ok", "url": "https://arxiv.org/pdf/2103.00453", "bytes": 458920, "reused": true, "local_path": "papers/repair/6367e717da882e46264d.pdf" }, { "status": "ok", "url": "https://arxiv.org/pdf/2005.12339", "bytes": 264394, "reused": false, "local_path": "papers/repair/c590b93e1b1d524cc545.pdf" }, { "status": "ok", "url": "https://arxiv.org/pdf/2111.07997", "bytes": 1794074, "reused": false, "local_path": "papers/repair/6583b937bdb414816f0a.pdf" }, { "status": "ok", "url": "https://arxiv.org/pdf/2009.10795", "bytes": 12902449, "reused": true, "local_path": "papers/repair/d2ff857dbbf48769840b.pdf" }, { "status": "ok", "url": "https://arxiv.org/pdf/2205.11822", "bytes": 2591164, "reused": false, "local_path": "papers/repair/d73c9008b798ef7af9d9.pdf" }, { "status": "ok", "url": "https://arxiv.org/pdf/2110.07574", "bytes": 29096279, "reused": false, "local_path": "papers/repair/5c42c5a0c6e7b430293a.pdf" } ], "actual_video_files": [], "body_chars": 26093, "expected_body_images": 13, "discovery_status": "ok", "delivery_status": "ok", "missing_reason": "", "raw_html": "attachments/1b98909faa67/pages/source.html", "local_html": "attachments/1b98909faa67/pages/article.html", "body_base_path": "attachments/1b98909faa67/pages/", "body_markdown_path": "attachments/1b98909faa67/pages/article.md" }