Almut Sophia Koepke

I am a junior research group leader at the Technical University of Munich and the University of Tübingen. My research focusses on multi-modal learning problems with sound, vision, and text.

I completed my DPhil in the Visual Geometry Group (VGG) at the University of Oxford, supervised by Andrew Zisserman. I spent a summer at Reichman University working with Yael Moses. Following my DPhil, I was a post-doctoral researcher with Zeynep Akata at the University of Tübingen. Furthermore, I was a visiting scholar at UC Berkeley, advised by Alexei (Alyosha) Efros.

Publications

teaser-image Dissecting temporal understanding in text-to-audio retrieval
Andreea-Maria Oncescu, João F. Henriques, A. Sophia Koepke
ACM Multimedia (ACMMM), 2024
paper / project page / code
teaser-image Audio-visual generalized zero-shot learning using pre-trained large multi-modal models
David Kurzendörfer, Otniel-Bogdan Mercea, A. Sophia Koepke, Zeynep Akata
Workshop on Learning with Limited Labelled Data for Image and Video Understanding at the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
paper / code
teaser-image A sound approach: Using large language models to generate audio descriptions for egocentric text-audio retrieval
Andreea-Maria Oncescu, João F. Henriques, Andrew Zisserman, Samuel Albanie, A. Sophia Koepke
The International Conference on Acoustics, Speech, & Signal Processing (ICASSP), 2024
paper / project page / code
teaser-image Zero-shot audio captioning with audio-language model guidance and audio context keywords
Leonard Salewski, Stefan Fauth, A. Sophia Koepke, Zeynep Akata
NeurIPS Workshop on Machine Learning for Audio, 2023
paper / code
teaser-image Text-to-feature diffusion for audio-visual few-shot learning
Otniel-Bogdan Mercea, Thomas Hummel, A. Sophia Koepke, Zeynep Akata
DAGM German Conference on Pattern Recognition (GCPR), 2023
paper / code
teaser-image Zero-shot translation of attention patterns in VQA models to natural language
Leonard Salewski, A. Sophia Koepke, Hendrik Lensch, Zeynep Akata
DAGM German Conference on Pattern Recognition (GCPR), 2023
paper / code
teaser-image Exposing and mitigating spurious correlations for cross-modal retrieval
Jae Myung Kim, A. Sophia Koepke, Cordelia Schmid, Zeynep Akata
Multimodal Learning and Applications Workshop at the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPRW), 2023
paper / code
teaser-image PlanT: Explainable planning transformers via object-level representations
Katrin Renz, Kashyap Chitta, Otniel-Bogdan Mercea, A. Sophia Koepke, Zeynep Akata, Andreas Geiger
Conference on Robot Learning (CoRL), 2022
paper / project page / code
teaser-image CLEVR-X: A visual reasoning dataset for natural language explanations
Leonard Salewski, A. Sophia Koepke, Hendrik Lensch, Zeynep Akata
Springer Lecture Notes on Artificial Intelligence, 2022
paper / project page / code
This was also presented at the CVPR 2022 Workshop on Explainable AI for Computer Vision (XAI4CV).
teaser-image Distilling audio-visual knowledge by compositional contrastive learning
Yanbei Chen, Yongqin Xian, A. Sophia Koepke, Ying Shan, Zeynep Akata
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
paper / code
teaser-image Self-supervised learning of class embeddings from video
Olivia Wiles, A. Sophia Koepke, Andrew Zisserman
Compact and Efficient Feature Representation and Learning in Computer Vision Workshop at the IEEE/CVF International Conference on Computer Vision (ICCV Workshop), 2019
paper
teaser-image Visual pitch estimation
A. Sophia Koepke, Olivia Wiles, Andrew Zisserman
Sound and Music Computation Conference (SMC), 2019
paper / project page
* denotes equal contribution
Teaching

Introduction to Machine Learning (University of Tübingen, Summer semester 2023)

Community service

Area chair:


Outstanding reviewer:
Reviewer:
  • ICCV (2023)
  • NeurIPS (2023)
  • ECCV (2022)
  • CVPR (2021, 2022)
  • ACCV (2020)
  • CVPR workshop: Learning with Limited Labelled Data for Image and Video Understanding (2022)
  • ICCV workshop: Closing the loop between Vision and Language (2021)
  • NeurIPS workshop: The preregistration experiment: an alternative publication model for machine learning research (2020)
  • CVPR workshop: Women in Computer Vision (2019, 2020)
  • ICCV workshop: Neural Architects (2019)
  • IJCV
  • TPAMI
  • IEEE Access
  • Eurographics

Workshop organisation:
Misc

Tübingen AI Center
KI macht Schule (AI education for pupils)