Jonas Schult
I am a Ph.D. student at RWTH Aachen University, working with Prof. Dr. Bastian Leibe, focusing on 3D Scene Understanding. I received my B.Sc. and M.Sc. with distinction in Computer Science from RWTH Aachen University, where I worked as a student research assistant under the supervision of Francis Engelmann.
News
- Aug 2023: Point2Vec was accepted at GCPR 2023.
- Jul 2023: Human3D was accepted at ICCV 2023. This was a great collaboration with Ayça Takmaz, Irem Kaftan, Mertcan Akçay, Bastian Leibe, Robert Sumner, Francis Engelmann and Siyu Tang!
- Jun-Nov 2023: I will intern at Meta Gen AI, looking forward to working with Sam Tsai!
- Mar 2023: Our workshop OpenSun3D on Open-Vocabulary 3D Scene Understanding will be held in conjunction with ICCV'23 in Paris.
- Jan 2023: Mask3D was accepted at ICRA 2023.
- Oct 2022: I gave a talk about our recent work Mask3D at the Urban3D Workshop at ECCV 2022. You can find the recording here.
- Sep 2022: Our Mask3D method ranks 2nd on the Instance Segmentation Challenge hosted by the Urban3D Workshop at ECCV 2022.
- Sep 2022: Mask3D achieves SOTA on the challenging ScanNet, ScanNet200, S3DIS and STPLS3D dataset.
- Jun 2022: Mix3D won first place on the ScanNet 3D Semantic Segmentation challenge. This was a great team effort with Alexey Nekrasov, Francis Engelmann, Or Litany and Bastian Leibe!
Selected Publications
ControlRoom3D: Room Generation using Semantic Proxy Rooms Jonas Schult, Sam Tsai, Lukas Höllein, Bichen Wu, Jialiang Wang, Chih-Yao Ma, Kunpeng Li, Xiaofang Wang, Felix Wimbauer, Zijian He, Peizhao Zhang, Bastian Leibe, Peter Vajda, Ji Hou arXiv, 2023. Project Page Paper BibTex Code
@article{schult23controlroom3d, author = {Schult, Jonas and Tsai, Sam and H\"ollein, Lukas and Wu, Bichen and Wang, Jialiang and Ma, Chih-Yao and Li, Kunpeng and Wang, Xiaofang and Wimbauer, Felix and He, Zijian and Zhang, Peizhao and Leibe, Bastian and Vajda, Peter and Hou, Ji}, title = {ControlRoom3D: Room Generation using Semantic Proxy Rooms}, journal = {arXiv}, year = {2023}, }
MASK4D: Mask Transformer for 4D Panoptic Segmentation Kadir Yilmaz, Jonas Schult, Alexey Nekrasov, Bastian Leibe arXiv, 2023. Project Page Paper BibTex Code
@article{yilmaz23mask4d, title = {{MASK4D: Mask Transformer for 4D Panoptic Segmentation}}, author = {Yilmaz, Kadir and Schult, Jonas and Nekrasov, Alexey and Leibe, Bastian}, booktitle = {arXiv preprint arXiv:2309.16133}, year = {2023} }
AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation Yuanwen Yue, Sabarinath Mahadevan, Jonas Schult, Francis Engelmann, Bastian Leibe, Konrad Schindler, Theodora Kontogianni arXiv, 2023. Project Page Paper BibTex Code
@article{yue2023agile3d, title = {{AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation}}, author = {Yue, Yuanwen and Mahadevan, Sabarinath and Schult, Jonas and Engelmann, Francis and Leibe, Bastian and Schindler, Konrad and Kontogianni, Theodora}, booktitle = {arXiv preprint arXiv:2306.00977}, year = {2023} }
Point2Vec for Self-Supervised Representation Learning on Point Clouds Karim Abou Zeid*, Jonas Schult*, Alexander Hermans, Bastian Leibe DAGM German Conference on Pattern Recognition (GCPR), 2023. Project Page Paper BibTex Code
@article{abouzeid2023point2vec, title={Point2Vec for Self-Supervised Representation Learning on Point Clouds}, author={Abou Zeid, Karim and Schult, Jonas and Hermans, Alexander and Leibe, Bastian}, journal={arXiv preprint arXiv:2303.16570}, year={2023}, }
3D Segmentation of Humans in Point Clouds with Synthetic Data Ayça Takmaz*, Jonas Schult*, Irem Kaftan, Cafer Mertcan Akçay, Bastian Leibe, Robert Sumner, Francis Engelmann, Siyu Tang International Conference on Computer Vision (ICCV), 2023. Project Page Paper BibTex Code
@article{Takmaz22, title = {{3D Segmentation of Humans in Point Clouds with Synthetic Data}}, author = {Takmaz, Ay\c{c}a and Schult, Jonas and Kaftan, Irem and Ak\c{c}ay, Mertcan and Leibe, Bastian and Sumner, Robert and Engelmann, Francis and Tang, Siyu}, booktitle = {{arXiv:2212.00786}}, year = {2022} }
Mask Transformer for 3D Semantic Instance Segmentation Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe International Conference on Robotics and Automation (ICRA), 2023. 1st Place ScanNet Challenge Project Page Paper BibTex Code Demo
@article{Schult23, title = {{Mask3D for 3D Semantic Instance Segmentation}}, author = {Schult, Jonas and Engelmann, Francis and Hermans, Alexander and Litany, Or and Tang, Siyu and Leibe, Bastian}, booktitle = {{International Conference on Robotics and Automation (ICRA)}}, year = {2023} }
Mix3D: Out-of-context Data Augmentation for 3D Scenes Alexey Nekrasov*, Jonas Schult*, Or Litany, Bastian Leibe, Francis Engelmann International Conference on 3D Vision (3DV), 2021. Oral Presentation 1st Place ScanNet Challenge Project Page Paper BibTex Code Demo
@inproceedings{Nekrasov213DV, title = {{Mix3D: Out-of-Context Data Augmentation for 3D Scenes}}, author = {Nekrasov, Alexey and Schult, Jonas and Litany, Or and Leibe, Bastian and Engelmann, Francis}, booktitle = {{International Conference on 3D Vision (3DV)}}, year = {2021} }
DCM-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes Jonas Schult*, Francis Engelmann*, Theodora Kontogianni, Bastian Leibe Proc. Computer Vision and Pattern Recognition (CVPR), 2020. Oral Presentation Project Page Paper BibTex Code
@inproceedings{Schult20CVPR, author = {Schult, Jonas and Engelmann, Francis and Kontogianni, Theodora and Leibe, Bastian}, title = {{DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes}}, booktitle = {{IEEE Conference on Computer Vision and Pattern Recognition (CVPR)}}, year = {2020} }
Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds Francis Engelmann, Theodora Kontogianni, Jonas Schult, Bastian Leibe Proc. European Conference on Computer Vision Workshops (ECCVW), 2018. Paper BibTex
@inproceedings{Engelmann18ECCVW, author = {Francis Engelmann and Theodora Kontogianni and Jonas Schult and Bastian Leibe}, title = {Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds}, booktitle = {{European Conference on Computer Vision Workshops (ECCVW)}}, year = {2018} }