Jonas Schult
I am a Ph.D. student at RWTH Aachen University, working with Prof. Dr. Bastian Leibe, focusing on 3D Scene Understanding. I received my B.Sc. and M.Sc. with distinction in Computer Science from RWTH Aachen University, where I worked as a student research assistant under the supervision of Francis Engelmann.
News
- Feb 2024: ControlRoom3D was accepted to CVPR 2024.
- Jan 2024: AGILE3D was accepted at ICLR and MASK4D was accepted at ICRA. Congrats to both Yuanwen Yue and Kadir Yilmaz on their successful master theses.
- Dec 2023: The second iteration of our workshop OpenSun3D on Open-Vocabulary 3D Scene Understanding will be held in conjunction with CVPR in Seattle.
- Aug 2023: Point2Vec was accepted at GCPR 2023.
- Jul 2023: Human3D was accepted at ICCV 2023. This was a great collaboration with Ayça Takmaz, Irem Kaftan, Mertcan Akçay, Bastian Leibe, Robert Sumner, Francis Engelmann and Siyu Tang!
- Jun-Nov 2023: I will intern at Meta Gen AI, looking forward to working with Sam Tsai!
- Mar 2023: Our workshop OpenSun3D on Open-Vocabulary 3D Scene Understanding will be held in conjunction with ICCV'23 in Paris.
- Jan 2023: Mask3D was accepted at ICRA 2023.
- Oct 2022: I gave a talk about our recent work Mask3D at the Urban3D Workshop at ECCV 2022. You can find the recording here.
- Sep 2022: Our Mask3D method ranks 2nd on the Instance Segmentation Challenge hosted by the Urban3D Workshop at ECCV 2022.
- Sep 2022: Mask3D achieves SOTA on the challenging ScanNet, ScanNet200, S3DIS and STPLS3D dataset.
- Jun 2022: Mix3D won first place on the ScanNet 3D Semantic Segmentation challenge. This was a great team effort with Alexey Nekrasov, Francis Engelmann, Or Litany and Bastian Leibe!
Selected Publications
ControlRoom3D: Room Generation using Semantic Proxy Rooms Jonas Schult, Sam Tsai, Lukas Höllein, Bichen Wu, Jialiang Wang, Chih-Yao Ma, Kunpeng Li, Xiaofang Wang, Felix Wimbauer, Zijian He, Peizhao Zhang, Bastian Leibe, Peter Vajda, Ji Hou IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024. Project Page Paper BibTex Code
@inproceedings{schult24controlroom3d,
author = {Schult, Jonas and Tsai, Sam and H\"ollein, Lukas and Wu, Bichen and Wang, Jialiang and Ma, Chih-Yao and Li, Kunpeng and Wang, Xiaofang and Wimbauer, Felix and He, Zijian and Zhang, Peizhao and Leibe, Bastian and Vajda, Peter and Hou, Ji},
title = {ControlRoom3D: Room Generation using Semantic Proxy Rooms},
booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2024},
}
@article{yilmaz24mask4d,
title = {{MASK4D: Mask Transformer for 4D Panoptic Segmentation}},
author = {Yilmaz, Kadir and Schult, Jonas and Nekrasov, Alexey and Leibe, Bastian},
booktitle = {International Conference on Robotics and Automation (ICRA)},
year = {2024}
}
@article{yue2024agile3d,
title = {{AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation}},
author = {Yue, Yuanwen and Mahadevan, Sabarinath and Schult, Jonas and Engelmann, Francis and Leibe, Bastian and Schindler, Konrad and Kontogianni, Theodora},
booktitle = {International Conference on Learning Representations (ICLR)},
year = {2024}
}
@article{abouzeid2023point2vec,
title={Point2Vec for Self-Supervised Representation Learning on Point Clouds},
author={Abou Zeid, Karim and Schult, Jonas and Hermans, Alexander and Leibe, Bastian},
journal={arXiv preprint arXiv:2303.16570},
year={2023},
}
@article{Takmaz22,
title = {{3D Segmentation of Humans in Point Clouds with Synthetic Data}},
author = {Takmaz, Ay\c{c}a and Schult, Jonas and Kaftan, Irem and Ak\c{c}ay, Mertcan
and Leibe, Bastian and Sumner, Robert and Engelmann, Francis and Tang, Siyu},
booktitle = {{arXiv:2212.00786}},
year = {2022}
}
Mask Transformer for 3D Semantic Instance Segmentation Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe International Conference on Robotics and Automation (ICRA), 2023. 1st Place ScanNet Challenge Project Page Paper BibTex Code Demo
@article{Schult23,
title = {{Mask3D for 3D Semantic Instance Segmentation}},
author = {Schult, Jonas and Engelmann, Francis and Hermans, Alexander and Litany, Or and Tang, Siyu and Leibe, Bastian},
booktitle = {{International Conference on Robotics and Automation (ICRA)}},
year = {2023}
}
@inproceedings{Nekrasov213DV,
title = {{Mix3D: Out-of-Context Data Augmentation for 3D Scenes}},
author = {Nekrasov, Alexey and Schult, Jonas and Litany, Or and Leibe, Bastian and Engelmann, Francis},
booktitle = {{International Conference on 3D Vision (3DV)}},
year = {2021}
}
@inproceedings{Schult20CVPR,
author = {Schult, Jonas and Engelmann, Francis and Kontogianni, Theodora and Leibe, Bastian},
title = {{DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes}},
booktitle = {{IEEE Conference on Computer Vision and Pattern Recognition (CVPR)}},
year = {2020}
}
Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds Francis Engelmann, Theodora Kontogianni, Jonas Schult, Bastian Leibe Proc. European Conference on Computer Vision Workshops (ECCVW), 2018. Paper BibTex
@inproceedings{Engelmann18ECCVW,
author = {Francis Engelmann and Theodora Kontogianni and Jonas Schult and Bastian Leibe},
title = {Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds},
booktitle = {{European Conference on Computer Vision Workshops (ECCVW)}},
year = {2018}
}