developing neuraly neurons to see the world
We are a team of research enthusiasts pushing the boundaries of photo-realistic 3D scanning. Our mission is to capture and digitize reality using cutting-edge machine learning techniques.
SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans
Angela Dai, Christian Diller, Matthias Nießner. CVPR 2020
RevealNet: Seeing Behind Objects in RGB-D Scans
Ji Hou, Angela Dai, Matthias Nießner. CVPR 2020
Joint Embedding of 3D Scan and CAD Objects
Manuel Dahnert, Angela Dai, Leonidas Guibas, Matthias Nießner. ICCV 2019
Deferred Neural Rendering: Image Synthesis using Neural Textures
Justus Thies, Michael Zollhöfer, Matthias Nießner. ACM Transactions on Graphics 2019 (TOG)
DDSL: Deep Differentiable Simplex Layer for Learning Geometric Signals
Chiyu 'Max' Jiang, Dana Lansigan, Philip Marcus, Matthias Nießner. ICCV 2019
Multi-Robot Collaborative Dense Scene Reconstruction
Siyan Dong, Kai Xu, Qiang Zhou, Andrea Tagliasacchi, Shiqing Xin, Matthias Nießner, Baoquan Chen. ACM Transactions on Graphics 2019 (TOG)
Face2Face: Real-time Face Capture and Reenactment of RGB Videos
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner. CACM 2019 (Research Highlight)
Inverse Path Tracing for Joint Material and Lighting Estimation
Dejan Azinović, Tzu-Mao Li, Anton Kaplanyan, Matthias Nießner. CVPR 2019 (Oral)
3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans
Ji Hou, Angela Dai, Matthias Nießner. CVPR 2019 (Oral)
Scan2CAD: Learning CAD Model Alignment in RGB-D Scans
Armen Avetisyan, Manuel Dahnert, Angela Dai, Angel X. Chang, Manolis Savva, Matthias Nießner. CVPR 2019 (Oral)
Scan2Mesh: From Unstructured Range Scans to 3D Meshes
Angela Dai, Matthias Nießner. CVPR 2019
DeepVoxels: Learning Persistent 3D Feature Embeddings
Vincent Sitzmann, Justus Thies, Felix Heide, Matthias Nießner, Gordon Wetzstein, Michael Zollhöfer. CVPR 2019 (Oral)
TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkhouser, Matthias Nießner, Leonidas Guibas. CVPR 2019 (Oral)
Spherical CNNs on Unstructured Grids
Chiyu 'Max' Jiang, Jingwei Huang, Karthik Kashinath, Prabhat, Philip Marcus, Matthias Nießner. ICLR 2019
RIO: 3D Object Instance Re-Localization in Changing Indoor Environments
Johanna Wald, Armen Avetisyan, Nassir Navab, Federico Tombari, Matthias Nießner. ICCV 2019 (Oral)
FaceForensics++: Learning to Detect Manipulated Facial Images
Andreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, Matthias Nießner. ICCV 2019
End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans
Armen Avetisyan, Angela Dai, Matthias Nießner. ICCV 2019
Joint Embedding of 3D Scan and CAD Objects
Manuel Dahnert, Angela Dai, Leonidas Guibas, Matthias Nießner. ICCV 2019
DDSL: Deep Differentiable Simplex Layer for Learning Geometric Signals
Chiyu 'Max' Jiang, Dana Lansigan, Philip Marcus, Matthias Nießner. ICCV 2019
Deferred Neural Rendering: Image Synthesis using Neural Textures
Justus Thies, Michael Zollhöfer, Matthias Nießner. ACM Transactions on Graphics 2019 (TOG)
Convolutional Neural Networks on non-uniform geometrical signals using Euclidean spectral transformation
Chiyu 'Max' Jiang, Dequan Wang, Jingwei Huang, Philip Marcus, Matthias Nießner. ICLR 2019
RegNet: Learning the Optimization of Direct Image-to-Image Pose Registration
Lei Han, Mengqi Ji, Lu Fang, Matthias Nießner. arXiv 2018
ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection
Davide Cozzolino, Justus Thies, Andreas Rössler, Christian Riess, Matthias Nießner, Luisa Verdoliva. arXiv 2018
IGNOR: Image-guided Neural Object Rendering
Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner. arXiv 2018
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Andreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, Matthias Nießner. arXiv 2018
3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation
Angela Dai, Matthias Nießner. ECCV 2018
PlaneMatch: Patch Coplanarity Prediction for Robust RGB-D Reconstruction
Yifei Shi, Kai Xu, Matthias Nießner, Szymon Rusinkiewicz, Thomas Funkhouser. ECCV 2018 (Oral)
HeadOn: Real-time Reenactment of Human Portrait Videos
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner. ACM Transactions on Graphics 2018 (TOG)
FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner. ACM Transactions on Graphics 2018 (TOG)
Deep Video Portaits
Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Nießner, Patrick Pérez, Christian Richardt, Michael Zollhöfer, Christian Theobalt. ACM Transactions on Graphics 2018 (TOG)
InverseFaceNet: Deep Monocular Inverse Face Rendering
Hyeongwoo Kim, Michael Zollhöfer, Ayush Tewari, Justus Thies, Christian Richardt, Christian Theobalt. CVPR 2018
ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans
Angela Dai, Daniel Ritchie, Martin Bokeloh, Scott Reed, Jürgen Sturm, Matthias Nießner. CVPR 2018
State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications
Michael Zollhöfer, Justus Thies, Derek Bradley, Pablo Garrido, Thabo Beeler, Patrick Pérez, Marc Stamminger, Matthias Nießner, Christian Theobalt. Eurographics 2018
Calipso: Physics-based Image and Video Editing through CAD Model Proxies
Nazim Haouchine, Frederick Roy, Hadrien Courtecuisse, Matthias Nießner, Stephane Cotin. Visual Computer 2018
Plan3D: Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction
Benjamin Hepp, Matthias Nießner, Otmar Hilliges. ACM Transactions on Graphics 2018 (TOG)
Parsing Geometry Using Structure-Aware Shape Templates
Vignesh Ganapathi-Subramanian, Olga Diamanti, Soeren Pirk, Chengcheng Tang, Matthias Nießner, Leonidas Guibas. 3DV 2018
QuadriFlow: A Scalable and Robust Method for Quadrangulation
Jingwei Huang, Yichao Zhou, Matthias Nießner, Jonathan Richard Shewchuk, Leonidas Guibas. SGP 2018 (Best Paper Award)
State of the Art on 3D Reconstruction with RGB-D Cameras
Michael Zollhöfer, Patrick Stotko, Andreas Görlitz, Christian Theobalt, Matthias Nießner, Reinhard Klein, Andreas Kolb. Eurographics 2018
Multiframe Scene Flow with Piecewise Rigid Motion
Vladislav Golyanik, Kihwan Kim, Robert Maier, Matthias Nießner, Didier Stricker, Jan Kautz. 3DV 2017
3DLite: Towards Commodity 3D Scanning for Content Creation
Jingwei Huang, Angela Dai, Leonidas Guibas, Matthias Nießner. ACM Transactions on Graphics 2017 (TOG)
Autonomous Reconstruction of Unknown Indoor Scenes Guided by Time-varying Tensor Fields
Kai Xu, Lintao Zheng, Zihao Yan, Guohang Yan, Eugene Zhang, Matthias Nießner, Oliver Deussen, Daniel Cohen-Or, Hui Huang. ACM Transactions on Graphics 2017 (TOG)
Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
Zachary DeVito, Michael Mara, Michael Zollhöfer, Gilbert Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, Matthias Nießner. ACM Transactions on Graphics 2017 (TOG)
BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration
Angela Dai, Matthias Nießner, Michael Zollhöfer, Shahram Izadi, Christian Theobalt. ACM Transactions on Graphics 2017 (TOG)
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting
Robert Maier, Kihwan Kim, Daniel Cremers, Jan Kautz, Matthias Nießner. ICCV 2017
A Lightweight Approach for On-the-Fly Reflectance Estimation
Kihwan Kim, Jinwei Gu, Stephen Tyree, Pavlo Molchanov, Matthias Nießner, Jan Kautz. ICCV 2017 (Oral)
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner. CVPR 2017 (Spotlight)
Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis
Angela Dai, Charles Ruizhongtai Qi, Matthias Nießner. CVPR 2017 (Spotlight)
FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping
Christian Siegl, Vanessa Lange, Marc Stamminger, Frank Bauer, Justus Thies. ISMAR 2017
Matterport3D: Learning from RGB-D Data in Indoor Environments
Angel X. Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Nießner, Manolis Savva, Shuran Song, Andy Zeng, Yinda Zhang. 3DV 2017
3DMatch: Learning the Matching of Local 3D Geometry in Range Scans
Andy Zeng, Shuran Song, Matthias Nießner, Matthew Fisher, Jianxiong Xiao. CVPR 2017 (Oral)
Learning to Navigate the Energy Landscape
Julien Valentin, Angela Dai, Matthias Nießner, Pushmeet Kohli, Philip H. S. Torr, Shahram Izadi, Cem Keskin. 3DV 2016
VolumeDeform: Real-time Volumetric Non-rigid Reconstruction
Matthias Innmann, Michael Zollhöfer, Matthias Nießner, Christian Theobalt, Marc Stamminger. ECCV 2016
Efficient GPU Rendering of Subdivision Surfaces using Adaptive Quadtrees
Wade Brainerd, Tim Foley, Manuel Kraemer, Henry Moreton, Matthias Nießner. ACM Transactions on Graphics 2016 (TOG)
PiGraphs: Learning Interaction Snapshots from Observations
Manolis Savva, Angel X. Chang, Pat Hanrahan, Matthew Fisher, Matthias Nießner. ACM Transactions on Graphics 2016 (TOG)
ProxImaL: Efficient Image Optimization using Proximal Algorithms
Felix Heide, Steven Diamond, Matthias Nießner, Jonathan Ragan-Kelley, Wolfgang Heidrich, Gordon Wetzstein. ACM Transactions on Graphics 2016 (TOG)
Face2Face: Real-time Face Capture and Reenactment of RGB Videos
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner. CVPR 2016 (Oral)
Volumetric and Multi-View CNNs for Object Classification on 3D Data
Charles Ruizhongtai Qi, Hao Su, Matthias Nießner, Angela Dai, Mengyuan Yan, Leonidas Guibas. CVPR 2016 (Spotlight)
Activity-centric Scene Synthesis for Functional 3D Scene Modeling
Matthew Fisher, Manolis Savva, Yangyan Li, Pat Hanrahan, Matthias Nießner. ACM Transactions on Graphics 2015 (TOG)
SemanticPaint: Interactive 3D Labeling and Learning at your Fingertips
Julien Valentin, Vibhav Vineet, Ming-Ming Cheng, David Kim, Jamie Shotton, Pushmeet Kohli, Matthias Nießner, Antonio Criminisi, Shahram Izadi, Philip H. S. Torr. ACM Transactions on Graphics 2015 (TOG)
Efficient Ray Tracing of Subdivision Surfaces using Tessellation Caching
Carsten Benthin, Sven Woop, Matthias Nießner, Kai Selgrad, Ingo Wald. High Performance Graphics 2015
Real-time Rendering Techniques with Hardware Tessellation
Matthias Nießner, Benjamin Keinert, Matthew Fisher, Marc Stamminger, Charles Loop, Henry Schäfer. Computer Graphics Forum 2015
Shading-based Refinement on Volumetric Signed Distance Functions
Michael Zollhöfer, Angela Dai, Matthias Innmann, Chenglei Wu, Marc Stamminger, Christian Theobalt, Matthias Nießner. ACM Transactions on Graphics 2015 (TOG)
Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization
Julien Valentin, Matthias Nießner, Jamie Shotton, Andrew Fitzgibbon, Shahram Izadi, Philip H. S. Torr. CVPR 2015
Incremental Dense Semantic Stereo Fusion for Large-Scale Semantic Scene Reconstruction
Vibhav Vineet, Ondrej Miksik, Morten Lidegaard, Matthias Nießner, Stuart Golodetz, Victor A. Prisacariu, Olaf Kähler, David W. Murray, Shahram Izadi, Patrick Pérez, Philip H. S. Torr. ICRA 2015
The Semantic Paintbrush: Interactive 3D Mapping and Recognition in Large Outdoor Spaces
Ondrej Miksik, Vibhav Vineet, Morten Lidegaard, Ram Prasaath, Matthias Nießner, Stuart Golodetz, Stephen L. Hicks, Patrick Pérez, Shahram Izadi, Philip H. S. Torr. CHI 2015
Database-Assisted Object Retrieval for Real-Time 3D Reconstruction
Yangyan Li, Angela Dai, Leonidas Guibas, Matthias Nießner. Eurographics 2015
Real-time Expression Transfer for Facial Reenactment
Justus Thies, Michael Zollhöfer, Matthias Nießner, Levi Valgaerts, Marc Stamminger, Christian Theobalt. ACM Transactions on Graphics 2015 (TOG)
Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping
Christian Siegl, Matteo Colaianni, Lucas Thies, Justus Thies, Michael Zollhöfer, Shahram Izadi, Marc Stamminger, Frank Bauer. ACM Transactions on Graphics 2015 (TOG)
Dynamic Feature-Adaptive Subdivision
Henry Schäfer, Jens Raab, Mark Meyer, Marc Stamminger, Matthias Nießner. I3D 2015
SceneGrok: Inferring Action Maps in 3D Environments
Manolis Savva, Angel X. Chang, Pat Hanrahan, Matthew Fisher, Matthias Nießner. ACM Transactions on Graphics 2014 (TOG)
Real-time Shading-based Refinement for Consumer Depth Cameras
Chenglei Wu, Michael Zollhöfer, Matthias Nießner, Marc Stamminger, Shahram Izadi, Christian Theobalt. ACM Transactions on Graphics 2014 (TOG)
Real-time Non-rigid Reconstruction using an RGB-D Camera
Michael Zollhöfer, Matthias Nießner, Shahram Izadi, Christoph Rhemann, Christopher Zach, Matthew Fisher, Chenglei Wu, Andrew Fitzgibbon, Charles Loop, Christian Theobalt, Marc Stamminger. ACM Transactions on Graphics 2014 (TOG)
Real-Time Deformation of Subdivision Surfaces from Object Collisions
Henry Schäfer, Benjamin Keinert, Matthias Nießner, Christoph Buchenau, Michael Guthe, Marc Stamminger. High Performance Graphics 2014
Local Painting and Deformation of Meshes on the GPU
Henry Schäfer, Benjamin Keinert, Matthias Nießner, Marc Stamminger. Computer Graphics Forum 2014
RetroDepth: 3D Silhouette Sensing for High-Precision Input On and Above Physical Surfaces
David Kim, Shahram Izadi, Jakub Dostal, Christoph Rhemann, Cem Keskin, Christopher Zach, Jamie Shotton, Tim Large, Steven Bathiche, Matthias Nießner, Alex Butler, Sean Fanello, Vivek Pradeep. CHI 2014
State of the Art Report on Real-time Rendering with Hardware Tessellation
Henry Schäfer, Matthias Nießner, Benjamin Keinert, Marc Stamminger, Charles Loop. Eurographics 2014
Combining Inertial Navigation and ICP for Real-time 3D Surface Reconstruction
Matthias Nießner, Angela Dai, Matthew Fisher. Eurographics 2014
Real-time 3D Reconstruction at Scale using Voxel Hashing
Matthias Nießner, Michael Zollhöfer, Shahram Izadi, Marc Stamminger. ACM Transactions on Graphics 2013 (TOG)
Analytic Displacement Mapping using Hardware Tessellation
Matthias Nießner, Charles Loop. ACM Transactions on Graphics 2013 (TOG)
Real-time Collision Detection for Dynamic Hardware Tessellated Objects
Matthias Nießner, Christian Siegl, Henry Schäfer, Charles Loop. Eurographics 2013
Feature Adaptive GPU Rendering of Catmull-Clark Subdivision Surfaces
Matthias Nießner, Charles Loop, Mark Meyer, Tony DeRose. ACM Transactions on Graphics 2012 (TOG)
Efficient Evaluation of Semi-Smooth Creases in Catmull-Clark Subdivision Surfaces
Matthias Nießner, Charles Loop, Günther Greiner. Eurographics 2012