Junwei Zheng

Junwei Zheng

Karlsruhe Institute of Technology ETH Zurich Guangdong University of Technology
Ph.D. Student
Google Scholar LinkedIn GitHub ORCID RGResearchGate

Welcome! I am a Ph.D. student at Computer Vision for Human-Computer Interaction Lab (CV:HCI), Karlsruhe Institute of Technology (KIT), Germany, under the supervision of Prof. Rainer Stiefelhagen. I was also a visiting Ph.D. student at CVG at ETH Zurich, supervised by Prof. Marc Pollefeys. Before my Ph.D. journey, I received my M.Sc. degree from KIT and B.Sc. degree from GDUT.

Education

  • Ph.D. in Computer Science2026
    KIT, Germany
  • Visiting Ph.D.2026
    ETH Zurich, Switzerland
  • M.Sc. in Mechatronics2022
    KIT, Germany
  • B.Sc. in Mechanical Engineering2016
    GDUT, China

Experience

  • Research Assistant2023–2026
    CV:HCI, KIT, Germany
  • Research Intern2020
    Fraunhofer AISEC, Germany

Interests

Embodied AI
Autonomous Driving
News
Jun 2026Two papers (WanderDream, InterEdit) have been accepted by ECCV 2026.
Jun 2026One paper (OccNL) has been accepted by IROS 2026.
Feb 2026Two papers (RHO, PanoVQA) have been accepted by CVPR 2026.
Jan 2026A paper (MICA) has been accepted by ICRA 2026.
Nov 2025A paper (HybriDLA) has been selected as Oral by AAAI 2026.
Nov 2025A paper (HybriDLA) has been accepted by AAAI 2026.
Oct 2025A paper (HyProMeta) has been accepted by IJCV.
Oct 2025I will join CVG at ETH Zurich as a visiting Ph.D. student, working closely with Prof. Marc Pollefeys.
Show rest 15 news →Hide rest 15 news ↑
Sep 2025A paper (HopaDIFF) has been selected as Spotlight by NeurIPS 2025.
Sep 2025Two papers (HopaDIFF, Situat3DChange) have been accepted by NeurIPS 2025.
Jun 2025We are organizing the 1st iCARE Workshop at CoRL 2025.
Feb 2025Two papers (SPR, SAMBLE) have been accepted by CVPR 2025.
Jan 2025A paper (GraphDoc) has been accepted by ICLR 2025.
Nov 2024A paper (OneBev) has been selected as Best Paper Finalist by ACCV 2024.
Oct 2024A paper (@Bench) has been accepted by WACV 2025.
Jul 2024Two papers (OPS, RAVAR) have been accepted by ECCV 2024.
Jun 2024A paper (NoiseEraSAR) has been accepted by IROS 2024.
Apr 2024A paper (MATERobot) has been selected as Best Paper Finalist on Human-Robot Interaction by ICRA 2024.
Feb 2024A paper (RoDLA) has been accepted by CVPR 2024.
Jan 2024A paper (MATERobot) has been accepted by ICRA 2024.
Dec 2023A paper (OS-SAR) has been accepted by AAAI 2024.
Mar 2023A paper (APES) has been selected as Highlight by CVPR 2023.
Feb 2023A paper (APES) has been accepted by CVPR 2023.
Selected Publications
* Equal contribution · † Corresponding authorFull publication list on Google Scholar →

What if? Emulative Simulation with World Models for Situated Reasoning

R. Liu, Y. Chen, Y. Zhang, J. Zheng, K. Peng, C. Wu, C. Huang, D. Wen, J. Zhang, K. Yang†, R. Stiefelhagen
ECCV 2026 Paper

RHO: Robust Holistic OSM-Based Metric Cross-View Geo-Localization

J. Zheng*,†, R. Dai*, R. Liu, Z. Zeng, Y. Chen, F. Wang, K. Peng, K. Yang, J. Zhang†, R. Stiefelhagen
CVPR 2026 Homepage Paper Code Video

More than the Sum: Panorama-Language Models for Adverse Omni-Scenes

W. Fan, R. Liu, J. Wei, Y, Chen, J. Zheng†, Z. Zeng, J. Zhang†, Q. Li, L. Shen, R. Stiefelhagen

MICA: Multi-Agent Industrial Coordination Assistant

D. Wen, K. Peng†, J. Zheng, Y. Chen, Y. Shi, J. Wei, R. Liu, K. Yang, R. Stiefelhagen
ICRA 2026 Paper Code

Situat3DChange: Situated 3D Change Understanding Dataset for Multimodal Large Language Model

R. Liu, J. Zheng, Y. Chen, Z. Wang, K. Peng, K. Yang, J. Zhang†, M. Pollefeys, R. Stiefelhagen
NeurIPS 2025 Paper Code Dataset

Scene-agnostic Pose Regression for Visual Localization

J. Zheng, R. Liu, Y. Chen, Z. Chen, K. Yang, J. Zhang†, R. Stiefelhagen

SAMBLE: Shape-Specific Point Cloud Sampling for an Optimal Trade-Off Between Local Detail and Global Uniformity

C. Wu, Y. Wan*, H. Fu*, J. Pfrommer, Z. Zhong, J. Zheng†, J. Zhang, J. Beyerer
CVPR 2025 Homepage Paper Code Video

@BENCH: Benchmarking Vision-Language Models for Human-centered Assistive Technology

X. Jiang*, J. Zheng*, R. Liu, J. Li, S. Matthiesen, J. Zhang†, R. Stiefelhagen
WACV 2025 Homepage Paper Code

OneBEV: Using One Panoramic Image for Bird’s-Eye-View Semantic Mapping

J. Wei, J. Zheng, R. Liu, J. Hu, J. Zhang†, R. Stiefelhagen
ACCV 2024 ★ Best Paper Finalist Paper Code

Open Panoramic Segmentation

J. Zheng, R. Liu, Y. Chen, K. Peng, C. Wu, K. Yang, J. Zhang†, R. Stiefelhagen
ECCV 2024 Homepage Paper Code Video

MateRobot: Material Recognition in Wearable Robotics for People with Visual Impairments

J. Zheng*, J. Zhang*, K. Yang†, K. Peng, R. Stiefelhagen
ICRA 2024 ★ Best Paper Finalist on HRI Homepage Paper Code Video

Attention-Based Point Cloud Edge Sampling

C. Wu, J. Zheng, J. Pfrommer, J. Beyerer
CVPR 2023 ★ Highlight, Top 10% Homepage Paper Code Video
Projects

Vision4Blind

Apr 2023 – Oct 2026

In this project, the focus is to develop a Vision-Language Navigation (VLN) system and a Visual-Question-Answering (VQA) user interface that aligns with the needs of visually impaired and blind people, and examines their preferences, needs and concerns with respect to the technology. Given a natural language interactive question by users, a mobile agent answers based on scene understanding or suggests a series of instructions to support the orientation and navigation of blind users.

Project page →

Accessible Maps

Sep 2019 – Dec 2022

The project Accessible Maps aims to make indoor mobility more accessible for people with disabilities in the occupational context through the providence of accessible, individual building and floor plans, enriched with accessibility information.

Project page →

Awards
Doctoral Scholarship
Ministry of Science, Research and the Arts Baden-Württemberg (MWK)
May 2026
Doctoral Scholarship
Ministry of Science, Research and the Arts Baden-Württemberg (MWK)
May 2025
Best Paper Finalist
Asian Conference on Computer Vision (ACCV)
Dec. 2024
Best Paper Finalist on Human Robot Interaction
IEEE International Conference on Robotics and Automation (ICRA)
May 2024
Doctoral Scholarship
Ministry of Science, Research and the Arts Baden-Württemberg (MWK)
May 2024
Doctoral Scholarship
Ministry of Science, Research and the Arts Baden-Württemberg (MWK)
May 2023
Grand Prize in “Challenge Cup” AVIC national academic, scientific Competition for College Students
Ministry of Education of the People's Republic of China
Nov. 2015
National Scholarship
Ministry of Education of the People's Republic of China
Nov. 2015
First Prize Scholarship
Guangdong University of Technology
Sep. 2015
Second Prize Scholarship
Guangdong University of Technology
Sep. 2014
Second Prize Scholarship
Guangdong University of Technology
Sep. 2013
Teaching
Open Panoramic Instance Segmentation
Bachelor thesis · Supervisor
May 2026
Towards Robust Cartographic Cross-View Geo-Localization
Master thesis · Supervisor
Nov 2025
Floorplan-based Indoor Navigation for People with Visual Impairments
Bachelor thesis · Supervisor
Apr 2025
Deformable MAMBA for Wide Field of View Segmentation
Master thesis · Supervisor
Jan 2025
Multimodal Large Language Models
Seminar · Teaching Assistant, SS 26, KIT
SS 2026
Computer Vision for Human-Computer Interaction
Practical Course · Teaching Assistant, SS 25, KIT
SS 2025
Computer Vision for Human-Computer Interaction
Seminar · Teaching Assistant, WS 24/25, KIT
WS 2024/25
Multimodal Large Language Models
Seminar · Teaching Assistant, SS 24, KIT
SS 2024
Computer Vision for Human-Computer Interaction
Practical Course · Teaching Assistant, SS 23, KIT
SS 2023
Talks
SPR: Scene-agnostic Pose Regression for Visual Localization
WeChat Official Account of 3D Vision Workshop
May 2025
MateRobot: Material Recognition in Wearable Robotics for People with Visual Impairments
IEEE International Conference on Robotics and Automation (ICRA) 2024
May 2024
Services

Workshop Co-organizer

1st iCARE @ CoRL 2025

Journal Reviewer

IJCV, T-ITS, RA-L, Robot Learning, ESWA

Conference Reviewer

CVPR, ICCV, ECCV, ICLR, AAAI, NeurIPS, ACMMM, WACV, ICRA, IROS, IV, BMVC

© 2026 Junwei Zheng