Feed-forward 3D reconstruction models can recover scene geometry directly from images or videos without costly scene-specific optimization. By combining large-scale pre-training, multi-view reasoning, and strong geometric priors, these models provide an efficient alternative to traditional reconstruction pipelines such as Structure-from-Motion, NeRF, and optimization-based 3D Gaussian Splatting.
Despite recent progress, current models remain sensitive to challenging real-world conditions. Occlusions, moving objects, illumination changes, nighttime scenes, reflections, rain, fog, and snow can result in incomplete geometry, unreliable correspondences, and temporally inconsistent predictions. Improving robustness under such conditions is essential for autonomous driving and robotic perception.
As a working student, you will support the development of robust feed-forward reconstruction models for dynamic scenes. You will investigate methods for handling occlusion, changing illumination, and adverse weather, and explore how large reconstruction models can serve as general-purpose geometric backbones for downstream 3D scene understanding, particularly semantic occupancy prediction and 4D occupancy forecasting.
Working Student (all genders) – Robust Feed-Forward 3D Reconstruction for Dynamic Scene
Augsburg, Karlsruhe, München
Part-time
Working Student
Abstract
These tasks interest you
- Develop and evaluate feed-forward 3D reconstruction models for dynamic scenes using monocular or multi-view image sequences.
- Investigate reconstruction robustness under partial and long-term occlusions, moving objects, and incomplete observations.
- Develop methods to improve geometric consistency under illumination changes, low-light conditions, shadows, and reflections.
- Evaluate and improve model performance under adverse weather conditions such as rain, fog, snow, and reduced visibility.
- Compare the developed methods with relevant baselines and document technical and experimental results.
That makes you stand out
- You are currently pursuing a degree in computer science, artificial intelligence, robotics, electrical engineering, data science, or a related field.
- You have excellent programming skills in Python as well as hands-on experience with PyTorch.
- You have a good understanding of computer vision, deep learning, 3D geometry, or multi-view vision.
- Experience with depth estimation, optical flow, point clouds, camera pose estimation, NeRF, 3D Gaussian Splatting, or 3D reconstruction is highly beneficial.
- Your language skills enable you to perform your role in English (at least C1 level). Knowledge of German is desirable but not required.
Salary information
Within our standardized and transparent salary framework, the pay for this position ranges from €15.50 to €19.50 per hour and is based on various factors, such as qualifications and experience.
Your contact person
Daniela
+49 821 885882-0
work@xitaso.com
+49 821 885882-0
work@xitaso.com