Yunhao (Andy) Ge 葛云皓 CS Ph.D. Candidate @ University of Southern California Visiting Ph.D. Student @ Stanford University Amazon Fellow with Amazon ML Fellowship (2022-2023) Email: yunhaoge at usc dot edu; yunhaoge at stanford dot edu     [About Me] [News & Updates] [Publications] [Experience]

About Me

I am a Ph.D. Candidate in the CS Department at University of Southern California, advised by Prof. Laurent Itti. I am also a Visiting PhD Student at Stanford Vision and Learning Lab (SVL) advised by Prof. Jiajun Wu. My primary research interest lies in controllable data generation, intending to use generated dataset train AI models that can effectively perceive, understand, interact with, and reason about the physical world.

• Controllable Data Generation: [Learning to generate] Use generative models and neural renderers to synthesize realistic and physically plausible data automatically. [Generating to learn] AI models trained with synthetic data can solve real-world Vision and Robotics tasks.
• Vision Language Models, Lifelong Learning, and Reliable Deep Learning

News & Updates

[2023/09/23] One paper on 3D Copy-Paste is accepted by NeurIPS 2023.

[2023/07/26] One paper on Lifelong (Continual) Learning is accepted by ICCV 2023.

[2023/05/09] One paper on Shared Knowledge Lifelong Learning, a new Lifelong Learning paradigm, is accepted by TMLR.

[2023/02/27] One paper on Multi-modal models' Robustness and Generalization is accepted by CVPR 2023.

[2022/12/01] Starting a new journey at Stanford Vision and Learning (SVL) Lab as a Visiting Student Researcher, advised by Prof. Jiajun Wu.

[2022/08/16] I was awarded the Amazon ML Fellowship (2022-2023), and will be an Amazon Fellow at USC + Amazon Center on Secure & Trusted Machine Learning. Thank you Amazon!

[2022/08/16] One paper on Disentangled and Convex Representation learning is accepted by WACV 2023, code is coming soon.

[2022/07/03] Two papers on NeRF and Humanoid Neural Network are accepted by ECCV 2022, code are released.

[2022/05/31] I will be joining Google Research as a student researcher, advised by Dr. Jiaping Zhao , Dr. Jie Ren , Dr. Balaji Lakshminarayanan and Prof. Ming-Hsuan Yang.

[2022/01/20] Finally passed my qual exam and officially became a PhD Candidate now.

[2021/08/23] I will be joining Google Cloud AI as a student researcher, advised by Dr. Sercan Arik and Dr. Jinsung Yoon

[2021/07/15] USC News , Tech Xplore , Technology Networks and other media pressed our ICLR 2021 paper: Group-Supervised Learning (Enabling the 'imagination' of artificial intelligence)

[2021/05/17] I will be joining Computer Vision Group at Microsoft Research Redmond as a research intern in summer 2021, advised by Dr. Vibhav Vineet and Dr. Neel Joshi

[2021/04/07] Releasing Img2SceneGraph, a pipeline that transfers images to scene graphs with node attributes! Welcome to Download and try!

[2021/04/02] One paper (Graph Autoencoder for Graph Compression and Representation Learning) was accepted by Neural Compression Workshop @ICLR 2021 as Spotlight!

[2021/02/28] One paper (A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts) was accepted by CVPR 2021!

[2021/01/16] One paper (Beneficial Perturbation Network for designing general adaptive artificial intelligence systems) was accepted by TNNLS!

[2021/01/12] One paper (Zero-shot Synthesis with Group-Supervised Learning) was accepted by ICLR 2021!

[2020/09/14] Fonts dataset was proposed for fast testing and idea iteration on disentangled representation learning and zero-shot synthesis. Welcome to Download and try!

[2020/07/02] One paper (Pose Augmentation: Class-agnostic Object Pose Transformation) was accepted by ECCV 2020!

[2020/05/12] I will be joining UII America as a research intern in summer 2020, advised by Dr. Ziyan Wu and Dr. Srikrishna Karanam

[2019/08/12] I will be joining USC CS Ph.D. Program in fall 2019, advised by Prof. Laurent Itti.

[2019/07/01] One paper (Synthesis and inpainting-based MR-CT registration) was accepted by MICCAI 2019.

[2019/03/01] One paper (Unpaired Whole-Body Mr to CT Synthesis) was accepted by ISBI 2019.

Selected Publications [Google Scholar]

	3D Copy-Paste: Physically-Plausible Object Insertion for Monocular 3D Detection Yunhao Ge, Hong-Xing Yu, Cheng Zhao, Yuliang Guo, Xinyu Huang, Liu Ren, Laurent Itti, Jiajun Wu NeurIPS 2023 (Advances in Neural Information Processing Systems). [paper (coming soon)] [github (coming soon)]
	DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detection Beyond Generation: Harnessing Text to Image Models for Object Detection and Segmentation Yunhao Ge*, Jiashu Xu*, Brian Nlong Zhao, Neel Joshi, Laurent Itti, Vibhav Vineet (*=equal contribution) arXiv:2206.09592, 2022. [paper(Beyond Generation)] [paper(DALL-E for Detection)] [github]
	CLR: Channel-wise Lightweight Reprogramming for Continual Learning Yunhao Ge, Yuecheng Li*, Shuo Ni*, Jiaping Zhao, Ming-Hsuan Yang, Laurent Itti (*=equal contribution as second author) ICCV 2023 (International Conference on Computer Vision). [paper] [code] [SKILL-102 Dataset]
	Lightweight Learner for Shared Knowledge Lifelong Learning Yunhao Ge, Yuecheng Li*, Di Wu*, Ao Xu*, Adam M. Jones, Amanda Sofie Rios, Iordanis Fostiropoulos, Shixian wen, Po-Hsuan Huang, Zachary William Murdock, Gozde Sahin, Shuo Ni, Kiran Lekkala, Sumedh Anand Sontakke, Laurent Itti (*=equal contribution as second author) TMLR (Transactions on Machine Learning Research). [paper] [code] [project page] [SKILL-102 Dataset] [USC Viterbi Press]
	Building One-class Detector for Anything: Open-vocabulary Zero-shot OOD Detection Using Text-image Models Yunhao Ge*, Jie Ren*, Jiaping Zhao, Kaifeng Chen, Andrew Gallagher, Laurent Itti, and Balaji Lakshminarayanan (*=equal contribution) Knowledge and Logical Reasoning workshop @ ICML 2023 [paper]
	Improving Zero-shot Generalization and Robustness of Multi-modal Models Yunhao Ge*, Jie Ren*, Andrew Gallagher, Yuxiao Wang, Ming-Hsuan Yang, Hartwig Adam, Laurent Itti, Balaji Lakshminarayanan, and Jiaping Zhao (*=equal contribution) CVPR 2023 (IEEE/ CVF International Conference on Computer Vision and Pattern Recognition). [paper] [code] [project page]
	Neural-Sim: Learning to Generate Training Data with NeRF Yunhao Ge, Harkirat Behl*, Jiashu Xu*, Suriya Gunasekar, Neel Joshi, Yale Song, Xin Wang, Laurent Itti, and Vibhav Vineet (*=equal contribution as second author) ECCV 2022 (European Conference on Computer Vision). [paper] [code]
	Contributions of Shape, Texture, and Color in Visual Recognition Yunhao Ge*, Yao Xiao*, Zhi Xu, Xingrui Wang, Laurent Itti (*=equal contribution) ECCV 2022 (European Conference on Computer Vision). [paper] [code]
	A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts Yunhao Ge, Yao Xiao, Zhi Xu, Meng Zheng, Srikrishna Karanam, Terrence Chen, Laurent Itti and Ziyan Wu CVPR 2021 (IEEE/ CVF International Conference on Computer Vision and Pattern Recognition). [paper] [github] [project page] [video] [知乎] [机器之心] [AI科技评论]
	Zero-shot Synthesis with Group-Supervised Learning Yunhao Ge, Sami Abu-El-Haija, Gan Xin and Laurent Itti ICLR 2021 (International Conference on Learning Representations). [paper] [code] [project page] [Fonts Dataset] [USC Viterbi Press] [知乎] [AI科技评论] [ USC News ] [ Tech Xplore ] [ Technology Networks ]
	Invariant Structure Learning for Better Generalization and Causal Explainability Yunhao Ge, Sercan Ö. Arik, Jinsung Yoon, Ao Xu, Laurent Itti and Tomas Pfister TMLR (Transactions on Machine Learning Research) [paper]
	Encouraging Disentangled and Convex Representation with Controllable Interpolation Regularization Yunhao Ge, Zhi Xu, Yao Xiao, Gan Xin, Yunkui Pang and Laurent Itti WACV 2023 (IEEE/CVF Winter Conference on Applications of Computer Vision). [paper]
	Graph Autoencoder for Graph Compression and Representation Learning Yunhao Ge*, Yunkui Pang*, Linwei Li and Laurent Itti (*=equal contribution) ICLR 2021 Workshop (Neural Compression: From Information Theory to Applications--Workshop@ ). [paper] [code] [Img2SceneGraph] Spotlight Presentation
	Pose Augmentation: Class-agnostic Object Pose Transformation for Object Recognition Yunhao Ge, Jiaping Zhao, Laurent Itti ECCV 2020 (European Conference on Computer Vision). [paper] [github] [video-1min] [video-10min]
	Beneficial Perturbation Network for designing general adaptive artificial intelligence systems Shixian Wen, Amanda Rios*, Yunhao Ge* and Laurent Itti (*=equal contribution as second author) TNNLS 2021 ( IEEE Transactions on Neural Networks and Learning Systems ). [paper]
	Unpaired MR to CT Synthesis with Explicit Structural Constrained Adversarial Learning Yunhao Ge*, Dongming Wei*, Zhong Xue, Yiqiang Zhan, Xiang Zhou, Qian Wang and Shu Liao (*=equal contribution) ISBI 2019 (IEEE International Symposium on Biomedical Imaging). [paper] [code]
	Synthesis and inpainting-based MR-CT registration for image-guided thermal ablation of liver tumors Dongming Wei, Sahar Ahmad, Jiayu Huo, Wen Peng, Yunhao Ge, Zhong Xue, Pew-Thian Yap, Wentao Li, Dinggang Shen, Qian Wang MICCAI 2019 (International Conference on Medical Image Computing and Computer-Assisted Intervention). [paper]
	Unpaired Whole-body MR to CT Synthesis with Correlation Coefficient Constrained Adversarial Learning Yunhao Ge, Zhong Xue, Yiqiang Zhan, Xiang Zhou and Shu Liao SPIE 2019 (SPIE-Medical Imaging). [paper] [code] Oral Presentation

Intern & Work Experience

Google Research, Los Angeles, USA (May. 2022 - Dec. 2022)

• Position: Student Researcher in Google Research
• Supervisor: Dr. Jiaping Zhao , Dr. Jie Ren , Dr. Balaji Lakshminarayanan and Prof. Ming-Hsuan Yang
• Project: Improving Zero-shot Generalization and Robustness of Multi-modal Models --> Accepted by CVPR 2023

Google Cloud AI, Mountain View, USA (Aug. 2021 - May 2022)

• Position: Student Researcher in Google Cloud AI
• Supervisor: Dr. Sercan Arik and Dr. Jinsung Yoon
• Project: Causal Explainable AI --> Accepted by TMLR

Microsoft Research, Redmond, USA (May. 2021 - Aug. 2021)

• Position: Research Intern in Microsoft Research Computer Vision Group
• Supervisor: Dr. Vibhav Vineet and Dr. Neel Joshi
• Project: On-demand training data generation with Neural Rendering --> Accepted by ECCV 2022

UII America, Inc, Boston, USA (May. 2020 - Aug. 2020)

• Position: Research Intern in UII America
• Supervisor: Dr. Ziyan Wu and Dr. Srikrishna Karanam
• Project: Explain reasoning logic of NN --> Accepted by CVPR 2021

Flexiv Ltd, Shanghai, China (May. 2019 - Aug. 2019)

• Position: Computer Vision Engineer in Flexiv Robotics
• Supervisor: Prof. Cewu Lu and Dr. Shuyun Chong
• Project: Robotics adaptive massage based on human pose detection and tracking

United Imaging Intelligence Co., Ltd, Shanghai, China (Jun. 2018 - Apr. 2019)

• Position: Research Intern in United Imaging Intelligence
• Supervisor: Prof. Dinggang Shen and Dr. Shu Liao
• Project: Unpaired MR to CT image synthesis --> Accepted by ISBI 2019 and MICCAI 2019

Scholarships

• Aug. 2022 Amazon ML Fellowship (2022-2023)
• Apr. 2022 Annenberg Project Grant for simulating human imagination, awarded annually to 10 PhD students across USC for high impact projects
• Aug. 2019 Annenberg Graduate Fellowship at University of Southern California
• Sep. 2017 National Scholarship(Graduate), (highest honor for graduates) top 1% nationwide
• Sep. 2015 National Scholarship(Undergraduate), (highest honor for undergraduates, top 2% nationwide)
• May. 2018 KaiYuan Motivational Scholarship top 0.5% in Shanghai Jiao Tong University
• Sep. 2015 Presidential Scholarship, (highest honor in Shandong University) top 0.2% in Shan Dong University
• Sep. 2015 BaoGang Excellent student Scholarship, (4 Places per year at Shandong University)
• Sep. 2015 & Sep 2014 & Sep 2015 First Prize Scholarship (Top 6% in China,three-year continuous)

Honors and Awards

• Aug. 2017 The First Prize 2017 ROBOMASTER The World’s Leading Robotics Competition (Responsible for the design of electronic control in robotics)[Code-T_Infantry]
• Aug. 2017 Rank 1st (preliminary competition) , Tianchi: Precision medical competition-Artificial Intelligence Aided genetic risk prediction of diabetes [Code-Pred_diabetes]
• Oct. 2015 The First Prize 9th international college students ican innovation and entrepreneurship contest
• Oct. 2015 The Special prize(Top 1%) 6th National University Students Process Equipment Practice and Innovation Competition
• Aug. 2015 The Silver prize 8th national college students in energy saving social practice and science and technology competition

Academic Service

Software & Patents

	Systems and methods for image processing S Liao, GE Yunhao, WEI Dongming US Patent App. 16/729,303.
	Pulmonary Nodular Assisted Detection System Based on AI(V1.0) Bin Li, Yunhao Ge 2018SR037095.
	A Two-Layer Barrier Free Parking Equipment Based on Bionic Manipulator Yunhao Ge, Shangze Yang, Zheng Zhang, Weixin Yan and Yanzheng Zhao CN201610712048.
	A Double Decker Parking Equipment based on Shear Lifting Mechanism and Hydraulic Mechanism Yunhao Ge, Xulong Zhou, Peng Liu and Yanzheng Zhao CN201610704408.

Last update: Sep. 25, 2023