About关于我
I study how to reconstruct, generate, render, and simulate dynamic 3D/4D worlds, with current interests in world models, 3D Gaussian Splatting, and multimodal 3D generation.
-
a Ph.D. student (since Fall 2023) in the Department of Electrical and Computer Engineering (ECE, formerly EEE) at The University of Hong Kong (HKU)

-
previously received an M.S. degree from Tsinghua University (THU)
and a B.S. degree from Nanjing University of Science and Technology (NJUST)
-
advised by Yifan (Evan) Peng & Jia Pan @ HKU
- previously worked with
-
research interests: Computer Vision (3D/4D), Computer Graphics (Rendering), VR/AR/MR, and Holographic Imaging/Display
-
research impact: Citations274
- CV: English PDF
我致力于动态 3D/4D 世界的重建、生成、渲染与仿真,目前重点关注世界模型、3D Gaussian Splatting 与多模态三维生成。
-
香港大学(HKU)
电机与计算机工程系(ECE,原 EEE)博士研究生,2023 年秋季入学 -
曾获清华大学(THU)
大数据工程硕士学位,以及南京理工大学(NJUST)
电子信息工程学士学位 -
博士导师:Yifan (Evan) Peng & Jia Pan @ HKU
- 曾合作研究者
-
研究兴趣:计算机视觉(3D/4D)、计算机图形学(渲染)、VR/AR/MR,以及计算成像与全息显示
-
学术影响力:Citations274
- 简历:中文 PDF
🔬 Research Focus🔬 研究方向
My work spans four connected directions, from core 3D/4D reconstruction and generation to perception, embodied intelligence, and cross-disciplinary applications.
我的研究涵盖四个相互关联的方向,从核心的 3D/4D 重建与生成延伸至场景感知、具身智能及交叉领域应用。
3D/4D Scene Reconstruction, Depth & Correspondence
Event-to-image reconstruction, NeRF, 3D Gaussian Splatting, stereo and multi-view depth estimation, and feature correspondence for recovering appearance, geometry, and motion.
Structured Generative Models, Neural Network-driven Rendering & Physical Simulation
Structured scene and garment generation, path-traced image synthesis, event-camera simulation, and video-based physical system identification for controllable, simulation-ready worlds.
Representative works: PatternGSL · Scenix · EventTracer
Video Understanding, Scene Perception & Embodied AI
Action recognition, anomaly detection, panoramic segmentation, vision-language-action reasoning, and embodied navigation for understanding and interacting with dynamic environments.
Representative works: O-VAD · SAP · ConsistNav
Computational Imaging, Biomedical AI & Engineering Systems
Neural holography, foundation models for biomedical imaging, AR-assisted healthcare, recommender systems, and wireless communication.
Representative works: 3D-HoloNet · CryoSAM · AR-assisted surgery
3D/4D 场景重建、深度估计与图像对应
研究事件到图像重建、NeRF、3D Gaussian Splatting、立体与多视图深度估计及特征对应,用于恢复场景外观、几何与运动。
结构化生成模型、神经网络驱动的渲染与物理仿真
研究结构化场景与三维服装生成、路径追踪图像合成、事件相机仿真,以及基于视频的物理系统辨识,构建可控且可仿真的三维世界。
代表性工作:PatternGSL · Scenix · EventTracer
视频理解、场景感知与具身智能
研究动作识别、异常检测、全景分割、视觉-语言-动作推理与具身导航,使智能体理解动态环境并与之交互。
代表性工作:O-VAD · SAP · ConsistNav
计算成像、生物医学智能与工程系统
探索神经全息、生物医学影像基础模型、增强现实辅助医疗、推荐系统与无线通信。
代表性工作:3D-HoloNet · CryoSAM · 增强现实辅助手术
🔥 News🔥 新闻动态
- 2026.08: 📄 Scenix is released on arXiv: sparse-view 3D scene reconstruction via executable scene programs.
- 2026.08: 📄 E2Pano is released on arXiv: event-to-panorama image reconstruction.
- 2026.07: 🏆 O-VAD is accepted to ECCV 2026: object-centric industrial video anomaly detection.
- 2026.06: 🏆 ERF-GS is accepted to Computational Visual Media (CVMJ): fast-motion reconstruction from disjoint Event-RGB viewpoints.
- 2026.05: 🏆 EventTracer is accepted to IEEE TVCG: fast path tracing-based event-stream rendering.
- 2026.05: 📄 ConsistNav is released on arXiv: semantic executive control for zero-shot object navigation.
Show earlier news
- 2026.04: 🏆 PatternGSL is accepted to SIGGRAPH 2026: structured, simulation-ready 3D garment modeling.
- 2026.04: 📄 Our work on AR-assisted dental implant surgery is published in Journal of the Society for Information Display (JSID).
- 2026.03: 🏆 Our work on stereo matching generalization is accepted to 3DV 2026.
- 2026.03: 📄 SAP is released on arXiv: segmenting high-resolution 4K panoramas.
- 2026.08: 📄 Scenix 已发布于 arXiv:通过可执行场景程序实现稀疏视角三维场景重建。
- 2026.08: 📄 E2Pano 已发布于 arXiv:从事件流重建全景图像。
- 2026.07: 🏆 O-VAD 被 ECCV 2026 接收:基于目标中心跟踪与推理的工业视频异常检测。
- 2026.06: 🏆 ERF-GS 被 Computational Visual Media (CVMJ) 接收:从非共视事件与 RGB 视角重建快速运动。
- 2026.05: 🏆 EventTracer 被 IEEE TVCG 接收:基于快速路径追踪的事件流渲染。
- 2026.05: 📄 ConsistNav 已发布于 arXiv:通过语义执行控制改进零样本目标导航。
展开更早动态
- 2026.04: 🏆 PatternGSL 被 SIGGRAPH 2026 接收:面向仿真的结构化三维服装建模。
- 2026.04: 📄 增强现实辅助牙种植导航工作发表于 Journal of the Society for Information Display(JSID)。
- 2026.03: 🏆 立体匹配泛化工作被 3DV 2026 接收。
- 2026.03: 📄 SAP 已发布于 arXiv:面向高分辨率 4K 全景图像的实例分割。
📝 Publications📝 论文发表
🎯 Selected Publications (* indicates equal contribution)🎯 代表性论文(* 表示共同一作)
2026
PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments
Zhenyang Li*, Lutao Jiang*, Yizhou Zhao, Ying-Cong Chen, Xin Wang, Weikai Chen, Yifan Peng.A structured specification language for generating editable, simulation-ready 3D garments without predefined templates.
EventTracer: Fast Path Tracing-based Event Stream Rendering
Zhenyang Li*, Xiaoyang Bai*, Jinfan Lu, Pengfei Shen, Edmund Y. Lam, Yifan Peng.
A fast path-tracing simulator for physically based event-stream rendering and scalable synthetic data generation.Accepted to IEEE Transactions on Visualization and Computer Graphics (TVCG). Project / arXiv / Code / Hugging Face
ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints
Xiaoyang Bai*, Zhenyang Li*, Weiwei Xu, Edmund Y. Lam, Yifan Peng.
Fuses disjoint event and RGB viewpoints with Gaussian representations to reconstruct fast real-world motion.Accepted to Computational Visual Media (CVMJ). arXiv / Code / Datasets: Neu3D / Nvidia
O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning
Mei Yuan, Qi Long, Qifeng Wu, Zhenyang Li, Yizhou Zhao, Lei Wang, Yang Liu, Min Xu.
Accepted to European Conference on Computer Vision (ECCV) 2026. arXiv
Structure-grounded Training Strategies Aid Generalization in Stereo Matching
Liangxun Ou, Yuhui Liu, Zhenyang Li, Xiaoyang Bai, Yifan Peng.
-
Augmented Reality Integration Improves Ergonomics in Dynamic Navigation for Dental Implant Surgery
Pui Hang Leung, Feng Wang, Zhenyang Li, Zongqi He, Yifan Peng, Wei-fa Yang. Scenix: Sparse-View 3D Scene Reconstruction via Executable Scene Programs
Kai Li, Lutao Jiang, Zhenyang Li, Jiayu Dong, Jierui Zhang, Yingda Yin, Runze Zhang, Kai Yan, Xiaoyang Huang, Keyang Luo, Xin Wang, Xiangyu Zhao, Weikai Chen.Infers editable executable scene programs from sparse, uncalibrated RGB observations.
E2Pano: Learning Event-to-Panorama Image Reconstruction
Zhenyang Li, Zongqi He, Jia Pan, Shijie Lin, Yifan Peng.Reconstructs panoramic imagery from asynchronous event streams for wide-field dynamic scenes.
ConsistNav: Closing the Action Consistency Gap in Zero-Shot Object Navigation with Semantic Executive Control
Haosen Wang*, Zhenyang Li*, Yinqiang Zhang, Zongqi He, Lutao Jiang, Kai Li, Yizhou Zhao, Liaoyuan Fan, Wenjian Hou, Tingbang Liang, Yibin Wen, Defeng Gu.
SAP: Segment Any 4K Panorama
Lutao Jiang, Zidong Cao, Weikai Chen, Xu Zheng, Yuanhuiyi Lyu, Zhenyang Li, Zeyu Hu, Yingda Yin, Keyang Luo, Runze Zhang, Kai Yan, Shengju Qian, Haidi Fan, Yifan Peng, Xin Wang, Hui Xiong, Ying-Cong Chen.
Project / arXiv
2025
Toward Material-Agnostic System Identification from Videos
Yizhou Zhao, Haoyu Chen, Chunjiang Liu, Zhenyang Li, Charles Herrmann, Junhwa Hur, Yinxiao Li, Ming-Hsuan Yang, Bhiksha Raj, Min Xu.
Enhanced Velocity Field Modeling for Gaussian Video Reconstruction
Zhenyang Li*, Xiaoyang Bai*, Tongchen Zhang, Pengfei Shen, Weiwei Xu, Yifan Peng.
ORBIT: Overlapping Region-Based Image Feature Matching Technique (Preprint Coming Soon)
Qi Luo*, Zhenyang Li*, Linsong Xue, Haojie Wu, Yifan Peng, Kai Zhang.
2024
3D-HoloNet: Fast, unfiltered, 3D hologram generation with camera-calibrated network learning
Wenbin Zhou, Feifan Qu, Xiangyu Meng, Zhenyang Li, Yifan Peng
CryoSAM: Training-free CryoET Tomogram Segmentation with Foundation Models
Yizhou Zhao, Hengwei Bian, Michael Mu, Mostofa R. Uddin, Zhenyang Li, Xiang Li, Tianyang Wang, Min Xu.
Point Resampling and Ray Transformation Aid to Editable NeRF Models
Zhenyang Li*, Zilong Chen*, Feifan Qu, Mingqing Wang, Yizhou Zhao, Kai Zhang, Yifan Peng.
2023
Breaking Filter Bubble: A Reinforcement Learning Framework of Controllable Recommender System
Zhenyang Li*, Yancheng Dong*, Chen Gao, Yizhou Zhao, Dong Li, Jianye Hao, Kai Zhang, Yong Li, Zhi Wang.
Unsupervised Anomaly Detection with Local-Sensitive VQVAE and Global-Sensitive Transformers
Mingqing Wang, Jiawei Li, Zhenyang Li, Chengxiao Luo, Bin Chen, Shu-Tao Xia, Zhi Wang.
2022
Alignment-guided Temporal Attention for Video Action Recognition
Yizhou Zhao*, Zhenyang Li*, Xun Guo, Yan Lu.
Adaptive Range guided Multi-view Depth Estimation with Normal Ranking Loss
Yikang Ding*, Zhenyang Li*, Dihe Huang, Kai Zhang, Zhiheng Li, Wensen Feng.
Enhancing multi-view stereo with contrastive matching and weighted focal loss
Yikang Ding*, Zhenyang Li*, Dihe Huang, Zhiheng Li, Kai Zhang.
🎖 Honors and Awards🎖 荣誉与奖励
🏆 Competitions
-
2023.12 Champion 🥇, Guangdong-Hong Kong-Macao Greater Bay Area (Huangpu) International Algorithm Case Competition
Topic: Three-dimensional reconstruction of objects using neural implicit representation -
2020.04 Top 7/256 🥈, High-energy particle collision classification challenge, Beindata
-
2019.05 Second Prize 🥉, American College Student Mathematical Modeling Contest (MCM)
💰 Scholarships & Academic Honors
- 2017 TE Connectivity Scholarship (Top 1/600), Beijing SMC Education Foundation Outstanding Scholarship Special Award (Top 1/600), Second Prize in National Mathematics Competition for College Students
🏆 竞赛获奖
-
2023.12 冠军 🥇,粤港澳大湾区(黄埔)国际算法算例大赛
赛题:基于神经隐式表示的物体三维重建 -
2020.04 前 7 / 256 🥈,高能粒子碰撞分类挑战赛,Beindata
-
2019.05 二等奖 🥉,美国大学生数学建模竞赛(MCM)
💰 奖学金与学术荣誉
- 2017 TE Connectivity Scholarship(Top 1/600)、北京晟铭创科教育基金会优秀学生奖学金特等奖(Top 1/600)、全国大学生数学竞赛二等奖
📖 Education📖 教育经历
-
🎓 Ph.D. in Electrical and Computer Engineering (formerly EEE) | 2023.09 - Present
The University of Hong Kong (HKU)
Advisor: Yifan (Evan) Peng & Jia Pan @ HKU -
🎓 M.S. in Big Data Engineering | 2020.09 - 2023.07
Tsinghua University (THU)
Department of Automation & Shenzhen International Graduate School
Advisor: Prof. Kai Zhang -
🎓 B.S. in Electronic and Information Engineering | 2016.09 - 2020.07
Nanjing University of Science and Technology (NJUST)
School of Electronic and Optical Engineering
-
🎓 电机与计算机工程博士(原电子电气工程) | 2023.09 - 至今
香港大学(HKU)
导师:Yifan (Evan) Peng & Jia Pan @ HKU -
🎓 大数据工程硕士 | 2020.09 - 2023.07
清华大学(THU)
自动化系、深圳国际研究生院
导师:Kai Zhang 教授 -
🎓 电子信息工程学士 | 2016.09 - 2020.07
南京理工大学(NJUST)
电子与光学工程学院
💻 Internships💻 实习经历
-
🏢 Research Intern | Oct. 2025 - Present
Tencent LIGHTSPEED STUDIOS, Shenzhen, Guangdong, China
Research Focus: Multimodal & 3D Content Generation and Simulation -
🏢 Research Intern | Jul. 2022 - Nov. 2022
Megvii Technology Limited (Face++), Beijing, China
Research Focus: Visual Odometry, NeRF, Multi-View Stereo (MVS), Feature Matching -
🏢 Research Intern | Nov. 2021 - May. 2022
Microsoft Research Asia (MSRA), Beijing, China
Research Focus: Video Understanding, Learning-based Computer Vision -
🏢 Artificial Intelligence Researcher | Mar. 2021 - Sep. 2021
Huawei Technologies Co., Ltd., Shenzhen, Guangdong, China
Research Focus: 3D Reconstruction, Visual Localization
-
🏢 研究实习生 | 2025.10 - 至今
Tencent LIGHTSPEED STUDIOS,中国广东深圳
研究方向:多模态与 3D 内容生成及仿真 -
🏢 研究实习生 | 2022.07 - 2022.11
Megvii Technology Limited (Face++),中国北京
研究方向:视觉里程计、NeRF、多视图立体(MVS)、特征匹配 -
🏢 研究实习生 | 2021.11 - 2022.05
Microsoft Research Asia (MSRA),中国北京
研究方向:视频理解、学习式计算机视觉 -
🏢 人工智能研究员 | 2021.03 - 2021.09
Huawei Technologies Co., Ltd.,中国广东深圳
研究方向:三维重建、视觉定位
🧑⚖️ Academic Service🧑⚖️ 学术服务
Program Committee Member
- AAAI 2027
- 34th ACM Multimedia (ACMMM) 2026
Conference Reviewer
- Vision & Graphics: CVPR 2026; ICCV 2025; ECCV 2026; SIGGRAPH Asia 2025 (XR Track); 3DV 2027, 2026, 2025; ISMAR 2026, 2025
- AI & Machine Learning: NeurIPS 2026, 2025 (Main + Datasets and Benchmarks), 2024; ICML 2025; ICLR 2025; AISTATS 2025; ACML Conference 2026, 2025; ACML Journal Track 2026
- Multimedia & Vision: ACM MM 2025; BMVC 2026
Journal Reviewer
- IEEE Journal of Selected Topics in Signal Processing (J-STSP)
程序委员会成员
- AAAI 2027
- 第 34 届 ACM Multimedia(ACMMM)2026
会议审稿
- 视觉与图形:CVPR 2026;ICCV 2025;ECCV 2026;SIGGRAPH Asia 2025(XR Track);3DV 2027、2026、2025;ISMAR 2026、2025
- 人工智能与机器学习:NeurIPS 2026、2025(Main + Datasets and Benchmarks)、2024;ICML 2025;ICLR 2025;AISTATS 2025;ACML Conference 2026、2025;ACML Journal Track 2026
- 多媒体与视觉:ACM MM 2025;BMVC 2026
期刊审稿
- IEEE Journal of Selected Topics in Signal Processing(J-STSP)
💬 Invited Talks & Teaching💬 报告与教学
-
🎤 Workshop Organizer & Speaker | Dec. 2025
WeLight Workshop, The University of Hong Kong
Organized by WeLightLab@HKU -
🎤 Guest Lecturer | May 2023
ELEC4544: AI and Deep Learning, The University of Hong Kong
Invited by Dr. Yifan (Evan) Peng
-
🎤 Workshop 组织者与报告人 | 2025.12
WeLight Workshop,香港大学
由 WeLightLab@HKU 组织 -
🎤 特邀讲师 | 2023.05
ELEC4544: AI and Deep Learning,香港大学
由 Yifan(Evan)Peng 博士邀请



