Zhongzheng (Jason) Ren Research Scientist Apple Email: renzhzh [at] gmail [dot] com GitHub / CV / Google Scholar / LinkedIn Follow @RenZhongzheng

I'm a research scientist at Apple working on computer vision and machine learning. I am particularly interested in topics such as generative modeling, 3D vision, efficient ML, and LLMs.

I received my Ph.D in CS from the University of Illinois at Urbana-Champaign (UIUC), where I was advised by Alex Schwing and closely collaborated with Shenlong Wang. I received my M.Sc in CS from UC Davis working with Yong Jae Lee, and B.Eng from Sun Yat-sen University (中山大学).

During my graduate studies, I was very fortunate to have spent summer 2023 at Apple with Fangchang Ma and Edward Zhang; summer 2022 and 2021 at Adobe Research with Aseem Agarwala, Bryan Russell, and Oliver Wang; summer 2020 at Fundamental AI Research (FAIR), Meta with Rohit Girdhar and Ishan Misra; summer 2019 and 2018 at NVIDIA Research with Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. I worked as machine learning researcher at EgoVid with Michael Ryoo in 2017.

My research wouldn't be possible without support made by Yee Memorial Fund Fellowship, Yunni & Maxine Pao Memorial Fellowship, Amazon AWS, UC Davis, and UIUC. Thanks so much!

News

We released a detailed tech report on Apple Intelligence LLMs. Please check!

One paper on physics-grounded Img2Vid is accepted into ECCV 2024.

Our work on Apple Intelligence has been announced on WWDC'24! Read more here.

Two papers are accepted into CVPR 2024 on human modeling and NeRF transformation.

Publications (*: equal contribution, ^†: alphabetic ordering)

	Apple Intelligence Foundation Language Models Apple (Tom Gunter, ..., Zhongzheng Ren) arXiv, 2024 PDF | Blog | Apple Intelligence | WWDC'24
	PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation Shaowei Liu, Zhongzheng Ren, Saurabh Gupta*, Shenlong Wang* European Conference on Computer Vision (ECCV), 2024 PDF | BIBTEX | Project
	GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing, Shenlong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 PDF | BIBTEX | Project
	NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows Zhenggang Tang, Zhongzheng Ren, Xiaoming Zhao, Bowen Wen, Jonathan Tremblay, Stan Birchfield, Alexander G. Schwing IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 PDF | BIBTEX | Project
	StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D Pengsheng Guo, Hans Hao, Adam Caccavale, Zhongzheng Ren, Edward Zhang, Qi Shan, Aditya Sankar, Alexander G. Schwing, Alex Colburn, Fangchang Ma arXiv, 2023 PDF | BIBTEX | Project
	Occupancy Planes for Single-view RGB-D Human Reconstruction Xiaoming Zhao, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing AAAI Conference on Artificial Intelligence (AAAI), 2023 PDF | BIBTEX | Project In case you're wondering: Yes! That's me and my dog Loki :)
	CASA: Category-agnostic Skeletal Animal Reconstruction Yuefan Wu*, Zeyuan Chen*, Shaowei Liu, Zhongzheng Ren, Shenlong Wang Neural Information Processing Systems (NeurIPS), 2022 PDF | BIBTEX | Project
	Neural Volumetric Object Selection Zhongzheng Ren, Aseem Agarwala†, Bryan Russell†, Alexander G. Schwing†, Oliver Wang† IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 PDF | BIBTEX | Project Also presented at AI for Content Creation Workshop (AI4CC) and Computer Vision for AR/VR workshop (CV4ARVR) at CVPR'22
	Total Variation Optimization Layers for Computer Vision Raymond A. Yeh, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 PDF | BIBTEX | Project
	Class-agnostic Reconstruction of Dynamic Objects from Videos Zhongzheng Ren*, Xiaoming Zhao*, Alexander G. Schwing Neural Information Processing Systems (NeurIPS), 2021 PDF | BIBTEX | Project
	Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning Iou-Jen Liu*, Zhongzheng Ren*, Raymond A. Yeh*, Alexander G. Schwing IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021 PDF | BIBTEX | Project Also presented at ICML'21 Reinforcement Learning for Real Life Workshop
	3D Spatial Recognition without Spatially Labeled 3D Zhongzheng Ren, Ishan Misra, Alexander G. Schwing, Rohit Girdhar IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 PDF | BIBTEX | Project
	Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning Zhongzheng Ren*, Raymond A. Yeh*, Alexander G. Schwing Neural Information Processing Systems (NeurIPS), 2020 PDF | BIBTEX | Project
	UFO2: A Unified Framework towards Omni-supervised Object Detection Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Alexander G. Schwing, Jan Kautz European Conference on Computer Vision (ECCV), 2020 PDF | BIBTEX | Project
	Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Yong Jae Lee, Alexander G. Schwing, Jan Kautz IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020 PDF | BIBTEX | Project Also presented at CVPR'20 Visual Learning with Limited Labels Workshop
	Learning to Anonymize Faces for Privacy Preserving Action Detection Zhongzheng Ren, Yong Jae Lee, Michael S. Ryoo European Conference on Computer Vision (ECCV), 2018 PDF | BIBTEX | Project Also presented at CVPR'18 workshop on The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security
	Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagery Zhongzheng Ren, Yong Jae Lee IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018 PDF | BIBTEX | Project
	Who moved my cheese? Automatic Annotation of Rodent Behaviors with Convolutional Neural Networks Zhongzheng Ren, Adriana Noronha, Annie Vogel Ciernia, Yong Jae Lee IEEE Winter Conference on Applications of Computer Vision (WACV), 2017 PDF | BIBTEX | Project

Teaching

We (mostly Alex) developed an efficient tool PDFCrop for creating Compass/Blackboard online exam from pdf files. Check out this demo video and reach out if you need access!

CS 446/ECE 449: Machine Learning (Spring 2023), UIUC
Teaching Assistant (TA) with Matus Telgarsky and Zhizhen Zhao

CS 446/ECE 449: Machine Learning (Spring 2022), UIUC
Teaching Assistant (TA) with Matus Telgarsky and Alex Schwing

ECE 544: Pattern Recognition (Fall 2020), UIUC
Teaching Assistant (TA) with Alex Schwing

CS 446/ECE 449: Machine Learning (Spring 2020), UIUC
Teaching Assistant (TA) with Alex Schwing

ECS 174: Computer Vision (Spring 2017), UC Davis
Teaching Assistant (TA) with Yong Jae Lee

Misc.

My Chinese name is 任中正.

My Erdős number is 4 computed by csauthors.net. Try yours:)
Paul Erdős -> Ronald L. Graham -> Chung-Kuan Cheng -> Xiaodong Yang -> Zhongzheng Ren.