Zhongzheng (Jason) Ren
Research Scientist
Apple
Email: renzhzh [at] gmail [dot] com
GitHub / CV / Google Scholar / LinkedIn

I'm a research scientist at Apple working on computer vision and machine learning. I am particularly interested in topics such as generative modeling, 3D vision, efficient ML, and LLMs.

I received my Ph.D in CS from the University of Illinois at Urbana-Champaign (UIUC), where I was advised by Alex Schwing and closely collaborated with Shenlong Wang. I received my M.Sc in CS from UC Davis working with Yong Jae Lee, and B.Eng from Sun Yat-sen University (中山大学).

During my graduate studies, I was very fortunate to have spent summer 2023 at Apple with Fangchang Ma and Edward Zhang; summer 2022 and 2021 at Adobe Research with Aseem Agarwala, Bryan Russell, and Oliver Wang; summer 2020 at Fundamental AI Research (FAIR), Meta with Rohit Girdhar and Ishan Misra; summer 2019 and 2018 at NVIDIA Research with Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. I worked as machine learning researcher at EgoVid with Michael Ryoo in 2017.

My research wouldn't be possible without support made by Yee Memorial Fund Fellowship, Yunni & Maxine Pao Memorial Fellowship, Amazon AWS, UC Davis, and UIUC. Thanks so much!

News

  • We released a detailed tech report on Apple Intelligence LLMs. Please check!
  • One paper on physics-grounded Img2Vid is accepted into ECCV 2024.
  • Our work on Apple Intelligence has been announced on WWDC'24! Read more here.
  • Two papers are accepted into CVPR 2024 on human modeling and NeRF transformation.
  • Publications (*: equal contribution, : alphabetic ordering)

    Apple Intelligence Foundation Language Models
    Apple (Tom Gunter, ..., Zhongzheng Ren)
    arXiv, 2024
    PDF | Blog | Apple Intelligence | WWDC'24
    PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation
    Shaowei Liu, Zhongzheng Ren, Saurabh Gupta*, Shenlong Wang*
    European Conference on Computer Vision (ECCV), 2024
    PDF | BIBTEX | Project
    GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
    Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing, Shenlong Wang
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
    PDF | BIBTEX | Project
    NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows
    Zhenggang Tang, Zhongzheng Ren, Xiaoming Zhao, Bowen Wen, Jonathan Tremblay, Stan Birchfield, Alexander G. Schwing
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
    PDF | BIBTEX | Project
    StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D
    Pengsheng Guo, Hans Hao, Adam Caccavale, Zhongzheng Ren, Edward Zhang, Qi Shan, Aditya Sankar, Alexander G. Schwing, Alex Colburn, Fangchang Ma
    arXiv, 2023
    PDF | BIBTEX | Project
    Occupancy Planes for Single-view RGB-D Human Reconstruction
    Xiaoming Zhao, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing
    AAAI Conference on Artificial Intelligence (AAAI), 2023
    PDF | BIBTEX | Project
    In case you're wondering: Yes! That's me and my dog Loki :)
    CASA: Category-agnostic Skeletal Animal Reconstruction
    Yuefan Wu*, Zeyuan Chen*, Shaowei Liu, Zhongzheng Ren, Shenlong Wang
    Neural Information Processing Systems (NeurIPS), 2022
    PDF | BIBTEX | Project
    Neural Volumetric Object Selection
    Zhongzheng Ren, Aseem Agarwala, Bryan Russell, Alexander G. Schwing,
    Oliver Wang

    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
    PDF | BIBTEX | Project
    Also presented at AI for Content Creation Workshop (AI4CC) and
    Computer Vision for AR/VR workshop (CV4ARVR) at CVPR'22
    Total Variation Optimization Layers for Computer Vision
    Raymond A. Yeh, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
    PDF | BIBTEX | Project
    Class-agnostic Reconstruction of Dynamic Objects from Videos
    Zhongzheng Ren*, Xiaoming Zhao*, Alexander G. Schwing
    Neural Information Processing Systems (NeurIPS), 2021
    PDF | BIBTEX | Project
    Semantic Tracklets: An Object-Centric Representation for Visual
    Multi-Agent Reinforcement Learning

    Iou-Jen Liu*, Zhongzheng Ren*, Raymond A. Yeh*, Alexander G. Schwing
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
    PDF | BIBTEX | Project
    Also presented at ICML'21 Reinforcement Learning for Real Life Workshop
    3D Spatial Recognition without Spatially Labeled 3D
    Zhongzheng Ren, Ishan Misra, Alexander G. Schwing, Rohit Girdhar
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    PDF | BIBTEX | Project
    Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning
    Zhongzheng Ren*, Raymond A. Yeh*, Alexander G. Schwing
    Neural Information Processing Systems (NeurIPS), 2020
    PDF | BIBTEX | Project
    UFO2: A Unified Framework towards Omni-supervised Object Detection
    Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Alexander G. Schwing, Jan Kautz
    European Conference on Computer Vision (ECCV), 2020
    PDF | BIBTEX | Project
    Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection
    Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Yong Jae Lee,
    Alexander G. Schwing, Jan Kautz

    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    PDF | BIBTEX | Project
    Also presented at CVPR'20 Visual Learning with Limited Labels Workshop
    Learning to Anonymize Faces for Privacy Preserving Action Detection
    Zhongzheng Ren, Yong Jae Lee, Michael S. Ryoo
    European Conference on Computer Vision (ECCV), 2018
    PDF | BIBTEX | Project
    Also presented at CVPR'18 workshop on The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security
    Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagery
    Zhongzheng Ren, Yong Jae Lee
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018
    PDF | BIBTEX | Project
    Who moved my cheese? Automatic Annotation of Rodent Behaviors with Convolutional Neural Networks
    Zhongzheng Ren, Adriana Noronha, Annie Vogel Ciernia, Yong Jae Lee
    IEEE Winter Conference on Applications of Computer Vision (WACV), 2017
    PDF | BIBTEX | Project

    Teaching

    We (mostly Alex) developed an efficient tool PDFCrop for creating Compass/Blackboard online exam from pdf files. Check out this demo video and reach out if you need access!

  • CS 446/ECE 449: Machine Learning (Spring 2023), UIUC
    Teaching Assistant (TA) with Matus Telgarsky and Zhizhen Zhao
  • CS 446/ECE 449: Machine Learning (Spring 2022), UIUC
    Teaching Assistant (TA) with Matus Telgarsky and Alex Schwing
  • ECE 544: Pattern Recognition (Fall 2020), UIUC
    Teaching Assistant (TA) with Alex Schwing
  • CS 446/ECE 449: Machine Learning (Spring 2020), UIUC
    Teaching Assistant (TA) with Alex Schwing
  • ECS 174: Computer Vision (Spring 2017), UC Davis
    Teaching Assistant (TA) with Yong Jae Lee
  • Misc.

  • My Chinese name is 任中正.
  • My Erdős number is 4 computed by csauthors.net. Try yours:)
    Paul Erdős -> Ronald L. Graham -> Chung-Kuan Cheng -> Xiaodong Yang -> Zhongzheng Ren.