The Language Technologies and Digital Humanities (JTDH) 2026 conference opened with the panel Benchmarking Large Language Models for Slovenian: Methods, Challenges and Perspectives. Moderated by Dr. Ajda Pretnar Žagar, the session featured Dr. Nikola Ljubešić from our department, alongside Dr. Simon Krek and Dr. Špela Vintar.
The discussion focused on replacing anglocentric LLM evaluation benchmarks—which inject foreign values, biases, and cultural contexts—with continuous, language-specific testing. The panelists underscored that evaluation frameworks must be treated as essential linguistic infrastructure, tailored directly to Slovenian cultural and societal values.
