publications

2024

1. 

   AGG: Amortized Generative 3D Gaussians for Single Image to 3D

   Dejia Xu, Ye Yuan, Morteza Mardani, and 4 more authors

   2024

   TLDR PDF Project Video

   We design a novel cascaded generation pipeline that produces 3D Gaussian-based objects without per-instance optimization. Our Amortized Generative 3D Gaussians (AGG) framework involves a coarse generator that predicts a hybrid representation for 3D Gaussians at a low resolution and a super-resolution module that delivers dense 3D Gaussians in the fine stage.

2023

1. 

   4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency

   Dejia Xu*, Yuyang Yin*, Zhangyang Wang, and 2 more authors

   2023

   TLDR PDF Project Video Code

   We introduce grounded 4D content generation. We identify static 3D assets and monocular video sequences as key components in constructing the 4D content. Our pipeline facilitates conditional 4D generation, enabling users to specify geometry (3D assets) and motion (monocular videos), thus offering superior control over content creation.

2. 

   Taming Mode Collapse in Score Distillation for Text-to-3D Generation

   Peihao Wang, Dejia Xu, Zhiwen Fan, and 8 more authors

   2023

   TLDR PDF Project Code

   We derive an entropy-maximizing score distillation rule that fosters view diversity and address the multi-face problem for text-to-3D generation.

3. 

   LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS

   Zhiwen Fan, Kevin Wang, Kairun Wen, and 3 more authors

   2023

   TLDR PDF Project Video

   We transform 3D Gaussians into a more efficient and compact format.

4. 

   Multi-Concept T2I-Zero: Tweaking Only The Text Embeddings and Nothing Else

   Hazarapet Tunanyan, Dejia Xu, Shant Navasardyan, and 2 more authors

   2023

   PDF Project

5. 

   CLE Diffusion: Controllable Light Enhancement Diffusion Model

   Yuyang Yin, Dejia Xu, Chuangchuang Tan, and 3 more authors

   2023

   PDF Project Code

6. 

   Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gap

   Dejia Xu, Xingqian Xu, Wenyan Cong, and 2 more authors

   2023

   PDF Project

7. 

   PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models

   Vidit Goel, Elia Peruzzo, Yifan Jiang, and 5 more authors

   2023

   PDF Project Code

8. 

   NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360 Views

   Dejia Xu, Yifan Jiang, Peihao Wang, and 3 more authors

   In IEEE / CVF Computer Vision and Pattern Recognition Conference, 2023

   PDF Project Code

9. 

   AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training

   Yifan Jiang, Peter Hedman, Ben Mildenhall, and 4 more authors

   In IEEE / CVF Computer Vision and Pattern Recognition Conference, 2023

   PDF Project

10. 

    NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes

    Zhiwen Fan, Peihao Wang, Yifan Jiang, and 3 more authors

    In International Conference on Learning Representations, 2023

    PDF Project Code

2022

1. 

   Signal Processing for Implicit Neural Representations

   Dejia Xu*, Peihao Wang*, Yifan Jiang, and 2 more authors

   In Annual Conference on Neural Information Processing Systems, 2022

   PDF Project Code

2. 

   SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image

   Dejia Xu*, Yifan Jiang*, Peihao Wang, and 3 more authors

   In European Conference on Computer Vision, 2022

   PDF Project Code

3. 

   Unified Implicit Neural Stylization

   Zhiwen Fan, Yifan Jiang, Peihao Wang, and 3 more authors

   In European Conference on Computer Vision, 2022

   PDF Project Code

4. 

   ReCoRo: Region-Controllable Robust Light Enhancement by User-Specified Imprecise Masks

   Dejia Xu*, Hayk Poghosyan*, Shant Navasardyan, and 3 more authors

   In ACM Multimedia, 2022

   PDF Code

5. 

   Cloud2Sketch: Augmenting Clouds with Imaginary Sketches

   Zhaoyi Wan, Dejia Xu, Zhangyang Wang, and 2 more authors

   In ACM Multimedia, 2022

   PDF Project
6. TMM

   Background Scene Recovery from an Image Looking through Colored Glass

   Ce Wang, Dejia Xu, Renjie Wan, and 3 more authors

   IEEE Transactions on Multimedia, 2022

   PDF

2021

1. IJCV

   Benchmarking low-light image enhancement and beyond

   Jiaying Liu, Dejia Xu, Wenhan Yang, and 2 more authors

   International Journal of Computer Vision, 2021

   PDF
2. ICLR

   Is label smoothing truly incompatible with knowledge distillation: An empirical study

   Zhiqiang Shen, Zechun Liu, Dejia Xu, and 3 more authors

   In International Conference on Learning Representations , 2021

   PDF Project

2020

1. AAAI

   Towards scale-free rain streak removal via self-supervised fractal band learning

   Wenhan Yang, Shiqi Wang, Dejia Xu, and 2 more authors

   In AAAI Conference on Artificial Intelligence, 2020

   PDF Code
2. CVPRW

   Moiré pattern removal via attentive fractal network

   Dejia Xu, Yihao Chu, and Qingyan Sun

   In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020

   PDF Code
3. ECCVW

   AIM 2020 challenge on real image super-resolution: Methods and results

   Pengxu Wei, Hannan Lu, Radu Timofte, and 8 more authors

   In European Conference on Computer Vision Workshops, 2020
4. CVPRW

   Ntire 2020 challenge on image and video deblurring

   Seungjun Nah, Sanghyun Son, Radu Timofte, and 1 more author

   In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020
5. CVPRW

   Ntire 2020 challenge on image demoireing: Methods and results

   Shanxin Yuan, Radu Timofte, Ales Leonardis, and 1 more author

   In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020
6. ECCVW

   AIM 2020 challenge on image extreme inpainting

   Evangelos Ntavelis, Andrés Romero, Siavash Bigdeli, and 8 more authors

   In European Conference on Computer Vision, 2020