Open Problems

Language Model Interpretability & In-Context Learning

Cross-Linguistic Robustness of Interpretability and Cognitive Alignment in Language Models

Scope to testOpen
Strong candidate · 5/5 runs9 papers report this33% from 2025+

Generated automatically from the limitations stated in 9 papers (ACL, EMNLP, NAACL), listed under Evidence. It is not a paper, and it does not come from papers submitted to CSPaper.

The problem

Mechanistic interpretability claims and brain-to-LM alignment results currently rest almost entirely on English-only stimuli, English-trained models, and English-speaking participant data. Because cross-linguistic evaluation has not been conducted across these methods, it remains unknown whether identified circuits, induction heads, and representational alignments reflect general linguistic processing or are artifacts of English syntax and data abundance. Consequently, researchers cannot rely on existing interpretability mechanisms when analyzing multilingual models or studying cognitive language processing across typologically diverse languages.

Why it matters

Validates whether mechanistic interpretability and cognitive alignment findings generalize across language families, providing a baseline for multilingual model auditing and cross-lingual cognitive modeling.

Ways to approach it

Prior-work checks are free with an account. Results someone already ran are shown to everyone.

  1. 1

    Replicate standard in-context learning and circuit-probing pipelines (e.g., induction head tracking, indirect object identification) across multilingual language models (such as mGPT or BLOOM) on parallel multi-language datasets covering diverse syntactic typologies (SOV, VSO, agglutinative), measuring circuit consistency and layer localization across languages.

  2. 2

    Evaluate brain-score and electrophysiological response alignment (e.g., N400 and fMRI prediction) using existing multilingual cognitive datasets (such as ZuCo or multilingual 'The Little Prince' neuroimaging corpora), measuring regression accuracy and alignment degradation when testing non-English native readers against corresponding multilingual model activations.

Have a different approach?

Describe how you would tackle this problem and we'll look for papers that already do it. Free; your text stays private.

Free · 3 checks per day

Why it might fail

If cross-lingual stimulus differences introduce overwhelming confounds in tokenization and subword segmentation that obscure underlying representation shifts, preventing clear attribution of interpretability failures.

Evidence

Each paper's own statement of the limitation, verbatim.

Show all 9 papers

Nearest existing work

Related open problems

Language Model Interpretability & In-Context Learning

Barrier to removeOpen

Benchmarking Whether LLM-Based Methods Survive a Change of Model: A Transfer Study Across Access Levels and Model Families

Methods built on one LLM — whether they depend on its logits, its instruction-following behavior, its pretraining data, or its annotation quality — are currently reported on one or two models and simply assumed to generalize. Because the assumptions are implicit, a follow-up researcher cannot tell whether a failure on a new model is a flaw of the method or an unexamined dependency on the original model's scale, data, or API surface. This blocks cumulative progress: every new model release forces methods to be silently re-validated or abandoned, and conclusions attributed to "LLMs" are really conclusions about a single backbone.

Strong candidate · 5/5 runs7 papers report this50% from 2025+

Language Model Interpretability & In-Context Learning

UnclassifiedOpen

A benchmark of naturally occurring hallucinations with model-generated ground truth, replacing synthetic entity-swap surrogates for detection evaluation

Today, hallucination detection methods are trained and evaluated against synthetic artifacts — entity-swapped summaries, outputs from a different model than the one under test — rather than hallucinations that actually arise during generation. This means reported detection numbers do not measure whether a method works on the failure mode that matters, and the modest predictive results (e.g., R² ≈ 0.27 on hallucination scores) may partly reflect this distribution mismatch. Detection validated only on 7B–13B open-weight models with synthetic data cannot be trusted as evidence about frontier-model behavior. Without a natural-hallucination benchmark, every detection paper inherits the same unquantified gap between "detects injected errors" and "detects real hallucinations."

Weak candidate · 1/3 runs6 papers report this33% from 2025+

Language Model Interpretability & In-Context Learning

Scope to testPartly addressed

Benchmarking Interpretability and In-Context Learning Mechanisms Beyond Toy Synthetic PCFGs

Mechanistic interpretability and in-context learning findings in formal linguistic settings currently rely on tiny, unambiguous PCFGs with vocabularies of fewer than 100 words and corpora of only ~20K sentences evaluated on toy models like nanoGPT. It remains completely unknown whether the specific internal circuits, parsing behaviors, and induction mechanisms documented in these toy studies survive when evaluated on richer formal grammars, ambiguous grammars, larger vocabularies, or natural syntax. Without systematic robustness evaluations across these broader settings, interpretability claims cannot be reliably extrapolated beyond the micro-benchmarks on which they were discovered.

Possible candidate · 3/5 runs5 papers report this60% from 2025+

Language Model Interpretability & In-Context Learning

Scope to testOpen

Testing the Transferability of Toy-Model Theoretical Guarantees to Deep Transformer Architectures

Theoretical analyses of in-context learning and mechanistic interpretability rely almost entirely on heavily idealized architectures, such as single-layer or two-layer transformers with linear attention, orthogonal embeddings, and no residual connections or normalization. Because these proofs make structural assumptions that diverge substantially from production models, it is currently unknown whether their theoretical guarantees hold in real large language models or function purely as loose analogies. Without empirical validation across the gap between toy settings and deep models, downstream interpretability methods risk relying on mechanistic claims that fail in standard architectures.

Possible candidate · 3/5 runs5 papers report this60% from 2025+
Generated automatically, not curated by hand. Automated prior-work checks catch about a third of existing work, so treat this problem as a lead to investigate.