Jonas Schult

I am a Ph.D. student at RWTH Aachen University, working with Prof. Dr. Bastian Leibe, focusing on 3D Scene Understanding. I received my B.Sc. and M.Sc. with distinction in Computer Science from RWTH Aachen University, where I worked as a student research assistant under the supervision of Francis Engelmann.

News

Aug 2023: Point2Vec was accepted at GCPR 2023.
Jul 2023: Human3D was accepted at ICCV 2023. This was a great collaboration with Ayça Takmaz, Irem Kaftan, Mertcan Akçay, Bastian Leibe, Robert Sumner, Francis Engelmann and Siyu Tang!
Jun-Nov 2023: I will intern at Meta Gen AI, looking forward to working with Sam Tsai!
Mar 2023: Our workshop OpenSun3D on Open-Vocabulary 3D Scene Understanding will be held in conjunction with ICCV'23 in Paris.
Jan 2023: Mask3D was accepted at ICRA 2023.
Oct 2022: I gave a talk about our recent work Mask3D at the Urban3D Workshop at ECCV 2022. You can find the recording here.
Sep 2022: Our Mask3D method ranks 2nd on the Instance Segmentation Challenge hosted by the Urban3D Workshop at ECCV 2022.
Sep 2022: Mask3D achieves SOTA on the challenging ScanNet, ScanNet200, S3DIS and STPLS3D dataset.
Jun 2022: Mix3D won first place on the ScanNet 3D Semantic Segmentation challenge. This was a great team effort with Alexey Nekrasov, Francis Engelmann, Or Litany and Bastian Leibe!

Selected Publications

ControlRoom3D: Room Generation using Semantic Proxy Rooms
Jonas Schult, Sam Tsai, Lukas Höllein, Bichen Wu, Jialiang Wang, Chih-Yao Ma, Kunpeng Li, Xiaofang Wang, Felix Wimbauer, Zijian He, Peizhao Zhang, Bastian Leibe, Peter Vajda, Ji Hou
arXiv, 2023.
Project Page Paper BibTex Code


@article{schult23controlroom3d,
  author    = {Schult, Jonas and Tsai, Sam and H\"ollein, Lukas and Wu, Bichen and Wang, Jialiang and Ma, Chih-Yao and Li, Kunpeng and Wang, Xiaofang and Wimbauer, Felix and He, Zijian and Zhang, Peizhao and Leibe, Bastian and Vajda, Peter and Hou, Ji},
  title     = {ControlRoom3D: Room Generation using Semantic Proxy Rooms},
  journal   = {arXiv},
  year      = {2023},
}

MASK4D: Mask Transformer for 4D Panoptic Segmentation
Kadir Yilmaz, Jonas Schult, Alexey Nekrasov, Bastian Leibe
arXiv, 2023.
Project Page Paper BibTex Code


@article{yilmaz23mask4d,
  title     = {{MASK4D: Mask Transformer for 4D Panoptic Segmentation}},
  author    = {Yilmaz, Kadir and Schult, Jonas and Nekrasov, Alexey and Leibe, Bastian},
  booktitle = {arXiv preprint arXiv:2309.16133},
  year      = {2023}
}

AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation
Yuanwen Yue, Sabarinath Mahadevan, Jonas Schult, Francis Engelmann, Bastian Leibe, Konrad Schindler, Theodora Kontogianni
arXiv, 2023.
Project Page Paper BibTex Code


@article{yue2023agile3d,
  title     = {{AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation}},
  author    = {Yue, Yuanwen and Mahadevan, Sabarinath and Schult, Jonas and Engelmann, Francis and Leibe, Bastian and Schindler, Konrad and Kontogianni, Theodora},
  booktitle = {arXiv preprint arXiv:2306.00977},
  year      = {2023}
}

Point2Vec for Self-Supervised Representation Learning on Point Clouds
Karim Abou Zeid*, Jonas Schult*, Alexander Hermans, Bastian Leibe
DAGM German Conference on Pattern Recognition (GCPR), 2023.
Project Page Paper BibTex Code


@article{abouzeid2023point2vec,
  title={Point2Vec for Self-Supervised Representation Learning on Point Clouds},
  author={Abou Zeid, Karim and Schult, Jonas and Hermans, Alexander and Leibe, Bastian},
  journal={arXiv preprint arXiv:2303.16570},
  year={2023},
}

3D Segmentation of Humans in Point Clouds with Synthetic Data
Ayça Takmaz*, Jonas Schult*, Irem Kaftan, Cafer Mertcan Akçay, Bastian Leibe, Robert Sumner, Francis Engelmann, Siyu Tang
International Conference on Computer Vision (ICCV), 2023.
Project Page Paper BibTex Code


@article{Takmaz22,
  title     = {{3D Segmentation of Humans in Point Clouds with Synthetic Data}},
  author    = {Takmaz, Ay\c{c}a and Schult, Jonas and Kaftan, Irem and Ak\c{c}ay, Mertcan 
                and Leibe, Bastian and Sumner, Robert and Engelmann, Francis and Tang, Siyu},
  booktitle = {{arXiv:2212.00786}},
  year      = {2022}
}

Mask Transformer for 3D Semantic Instance Segmentation
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe
International Conference on Robotics and Automation (ICRA), 2023. 1st Place ScanNet Challenge
Project Page Paper BibTex Code Demo


@article{Schult23,
  title     = {{Mask3D for 3D Semantic Instance Segmentation}},
  author    = {Schult, Jonas and Engelmann, Francis and Hermans, Alexander and Litany, Or and Tang, Siyu and Leibe, Bastian},
  booktitle = {{International Conference on Robotics and Automation (ICRA)}},
  year      = {2023}
}

Mix3D: Out-of-context Data Augmentation for 3D Scenes
Alexey Nekrasov*, Jonas Schult*, Or Litany, Bastian Leibe, Francis Engelmann
International Conference on 3D Vision (3DV), 2021.
Oral Presentation
1st Place ScanNet Challenge
Project Page Paper BibTex Code Demo


@inproceedings{Nekrasov213DV,
  title     = {{Mix3D: Out-of-Context Data Augmentation for 3D Scenes}},
  author    = {Nekrasov, Alexey and Schult, Jonas and Litany, Or and Leibe, Bastian and Engelmann, Francis},
  booktitle = {{International Conference on 3D Vision (3DV)}},
  year      = {2021}
}

DCM-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes
Jonas Schult*, Francis Engelmann*, Theodora Kontogianni, Bastian Leibe
Proc. Computer Vision and Pattern Recognition (CVPR), 2020.
Oral Presentation
Project Page Paper BibTex Code


@inproceedings{Schult20CVPR,
  author    = {Schult, Jonas and Engelmann, Francis and Kontogianni, Theodora and Leibe, Bastian},
  title     = {{DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes}},
  booktitle = {{IEEE Conference on Computer Vision and Pattern Recognition (CVPR)}},
  year      = {2020}
}

Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds
Francis Engelmann, Theodora Kontogianni, Jonas Schult, Bastian Leibe
Proc. European Conference on Computer Vision Workshops (ECCVW), 2018.
Paper BibTex


@inproceedings{Engelmann18ECCVW,
  author    = {Francis Engelmann and Theodora Kontogianni and Jonas Schult and Bastian Leibe},
  title     = {Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds},
  booktitle = {{European Conference on Computer Vision Workshops (ECCVW)}},
  year      = {2018}
}