Frank Keller
Professor
Works on natural language processing and cognitive science, especially language and vision tasks such as image description, visual grounding and video summarization.
Frank Keller's lab at Edinburgh works on multimodal & grounded language, dialogue, generation & summarization and computational neuroscience & cognition. 26 papers since 2023, 9 at top venues, mostly Findings of ACL and Findings of EMNLP. 6 PhD students. 30 alumni, most often to Google DeepMind and Amazon.
At a glance
- papers, 2023–2026
- 7/ year
- at T1 venues
- 35%
- PhD students
- 6
- MS students
- 0
- alumni listed
- 30
Papers by yearfrom the lab homepage, 2023–2026
- 5 papers2026 · T1 1 · collecting
- 6 papers2025 · T1 2
- 8 papers2024 · T1 2
- 7 papers2023 · T1 4
T1 venuesOtherVenues: Findings of ACL, Findings of EMNLP, TACL, AAAI, ACL
Research focuspaper titles that use each topic's words
- Dialogue, generation & summarization6 papers
- Multimodal & grounded language4 papers
- summarization4 papers
- grounding1 paper
- Computational neuroscience & cognition0 papers
Paper list
From the lab homepage.
20265 papers
- EACLContrastive Learning with Narrative Twins for Modeling Story Salience (opens in a new tab)
- TACL (T1)Generating Visual Stories with Grounded and Coreferent Characters (opens in a new tab)
- Proceedings of the Annual Conference on Language ModelingREFRAMED: Towards Realistic Audio Description Generation for Movies (opens in a new tab)
- Cognitive ScienceThe Crosslinguistic Coordination of Overt Attention and Speech Production as Evidence for a Language of Vision (opens in a new tab)
- Findings of ACLThink Before you Write: QA-Guided Reasoning for Character Descriptions in Books (opens in a new tab)
20256 papers
- TACL (T1)End-to-End Long Document Summarization using Gradient Caching (opens in a new tab)
- Cognitive ScienceLeveraging Context for Perceptual Prediction using Word Embeddings (opens in a new tab)
- Proceedings of the Annual Conference of the Cognitive Science SocietyPath encoding and manner salience in motion event descriptions: the case of Bulgarian and English (opens in a new tab)
- Proceedings of the Conference on Language ModelingPlancraft: An Evaluation Dataset for Planning with LLM Agents (opens in a new tab)
- Proceedings of the International Joint Conference on Natural Language Processing and Asia-Pacific Chapter of the Association for Computational LinguisticsPosterSum: A Multimodal Benchmark for Scientific Poster Summarization (opens in a new tab)
- ACL (T1)Predicting Implicit Arguments in Procedural Video Instructions (opens in a new tab)
20248 papers
- Findings of EMNLPBookWorm: A Dataset for Character Description and Analysis (opens in a new tab)
- Proceedings of the Annual Conference of the Cognitive Science SocietyEffects of Context on the Use of Descriptive Verbs (opens in a new tab)
- ECCV (T1)Efficient Pre-training for Localized Instruction Generation of Procedural Videos (opens in a new tab)
- TPAMI (T1)Finding the Right Moment: Human-Assisted Trailer Creation via Task Composition (opens in a new tab)
- PLOS ONEFlexibility in Conceptual Combinations: A Neural Network Model of Gradable Adjective Modification (opens in a new tab)
- Findings of ACLMovieSum: An Abstractive Summarization Dataset for Movie Scripts (opens in a new tab)
- Findings of NAACLSelect and Summarize: Scene Saliency for Movie Script Summarization (opens in a new tab)
- Frontiers in EductionTracking E-reading Behavior: Uncovering the Effects of Task Context, Electronic Experience, and Motivation (opens in a new tab)
20237 papers
- AAAI (T1)Detecting and grounding important characters in visual stories (opens in a new tab)
- CVPR (T1)Learning Action Changes by Measuring Verb-Adverb Textual Relationships (opens in a new tab)
- Findings of EACLLearning the Effects of Physical Actions in a Multi-modal Environment (opens in a new tab)
- CognitionModeling Task Effects in Human Reading with Neural Network-based Attention (opens in a new tab)
- EMNLP (T1)Semi-supervised Multimodal Coreference Resolution in Image Narrations (opens in a new tab)
- Findings of EMNLPVisual Storytelling with Question-Answer Plans (opens in a new tab)
- ICCV (T1)Who are you referring to? Coreference resolution in image narrations (opens in a new tab)
Where alumni went30 listed, 28% to industry
Industry 7Academia 18
Most often to
- Google DeepMind
- Amazon
- Anthropic
Also to
- University of Edinburgh
- University of Copenhagen
- Heriot-Watt University
Apply to EdinburghFall 2027
Not announced yet
Informatics PhD
- Round
- Rolling (funding consideration)
- Opens
- —
- GRE
- See program page
- English
- See program page
- Fee
- none
Not yet confirmed for this intake.
Similar labsnearest by research summary
- CHETH Zurich
Helmut Bölcskei
- Learning theory & optimization
- CNTsinghua
Tianxing He
- Large language models
- CNPeking
Xu Sun
- Dialogue, generation & summarization
- USUCSD
Alon Orlitsky
- Learning theory & optimization
- GBCambridge
Andreas Vlachos
- Multilingual, translation & linguistics
- CHETH Zurich
Ryan Cotterell
- Multilingual, translation & linguistics
Your notes
Save this lab to keep notes.
Data
Checked against the lab homepage.
- Collected
- Verified
- Papers
- The lab homepage
- Members
- Lab homepage
- Alumni
- Lab homepage
Tiers are venue classifications, not lab rankings.