Sondre Wold

About

Hi! I'm a researcher at the The Norwegian Water Resources and Energy Directorate (NVE) working on remote sensing. Before joining NVE, I was a PhD student at the University of Oslo, where I researched compositionality and systematic generalization in neural networks as part of the Language Technology Group (LTG). I'm also the subject specialist for language technology at the Great Norwegian Encyclopedia.

Recent Publications

Measuring Idiomaticity in Text Embedding Models with 𝜀-compositionality, Sondre Wold, Étienne Simon, Erik Velldal, Lilja Øvrelid, EACL Main 2026
Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models, Philipp Mondorf, Sondre Wold, Barbara Plank, Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
Systematic Generalization in Language Models Scales with Information Entropy, Sondre Wold, Lucas Georges Gabriel Charpentier, Étienne Simon, Findings of the Association for Computational Linguistics: ACL 2025
Compositional Generalization with Grounded Language Models, Sondre Wold, Étienne Simon, Lucas Georges Gabriel Charpentier, Egor V. Kostylev, Erik Velldal, Lilja Øvrelid, Findings of the Association for Computational Linguistics: ACL 2024
More room for language: Investigating the effect of retrieval on language models, David Samuel, Lucas Charpentier, Sondre Wold , Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers)
Estimating Lexical Complexity from Document-Level Distributions, Sondre Wold, Petter Mæhlum, Oddbjørn Hove, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

Teaching

I'm involved in the teaching of the following courses at the University of Oslo, in addition to MSc supervision: