About Me

I am a Ph.D. student under the supervision of Michael Hahn (Saarland University) and Jilles Vreeken (CISPA). I am affiliated with the Research Training Group on Neuroexplicit Models of Language, Vision, and Action, where I work on long-context reasoning and working memory in Large Language Models (LLMs). Previously, I worked as a Research Assistant at the Max Planck Institute for Informatics, completing my master's thesis under the guidance of Simon Razniewski and Gerhard Weikum. My thesis focused on Knowledge Base Completion using LLMs.

Research Interests

  • Memory
  • Transformers
  • Mechanistic Interpretability

Publications

Positional Biases Shift as Inputs Approach Context Window Limits

Blerta Veseli, Julian Chibane, Mariya Toneva, Alexander Koller
COLM 2025

Evaluating Knowledge Base Completion Potential of GPT

Blerta Veseli, Simon Razniewski, Jan-Christoph Kalo, Gehard Weikum
EMNLP 2023 Findings

Evaluating Language Models for Knowledge Base Completion

Blerta Veseli, Sneha Singhania, Simon Razniewski, Gehard Weikum
ESWC 2023

Personal

Hiking Hiking

I am passionate about backpacking and traveling, especially when it allows me to discover new and exciting cuisines.

Some of my all-time favorite dishes include Thailand's sweet and spicy massaman curry, and Morocco's lamb tagine with prunes (tajine d'agneau aux pruneaux), among many others. I often visit the same restaurant and order the same dish multiple times - which turned out to be a great way to make friends even when traveling.

I have a deep love for freshly baked goods, from German bread to flaky msemmen, roti, naan, and French pastries. And when it comes to dessert, there’s always room! In fact, I once spent two days of my vacation hunting down a particular ice cream truck.

Hiking Hiking
Running

I love adventures. I really enjoy tackling new challenges and being confronted with problems that are different from those in my daily Ph.D. life.

In my free time, I am passionate about exploring fashion and seeking out unique pieces. To me, fashion sometimes is wearable art. Clothes can be incredibly creative and showcase cultural heritage. That’s why I love bringing something special back from my travels — it feels like collecting a piece of the culture itself.

Running
Running

Beyond my interest in fashion, I also enjoy playing video games like Alan Wake, Half-Life: Alyx, Sekiro or The Evil Within. I’m also an anime fan, with favorites like Attack on Titan, Jujutsu Kaisen, Noragami, Cowboy Bebop, and Banana Fish, but also the classics like Bleach and Naruto. I have a particular love for thriller, mystery, and horror films - Mike Flanagan is one of my favorite directors in the mystery/horror genre.

Blerta Veseli