New York University (NYU), New York, U.S.
PhD in Future Reality Lab (FRL), Courant, GSAS,Adviser: Prof. Kenneth Perlin (9/2015 – Present)
Shanghai Jiao Tong University (SJTU), Shanghai, China
M.S. in Digital Art Lab (DALAB), School of Software,Adviser: Prof. Xubo Yang (9/2012 – 3/2015)
B.S. in Software Engineering, School of Software (9/2008 – 6/2012)
Graduate Research Assistant, FRL, NYU 9/2015 – Present
HoloKit, the low cost open source mixed reality experience, which includes the HeadKit cardboard headset and TrackKit software. I help create several demos for the release.
HoloDoodle Adviser: Prof. Ken Perlin
Premiering at at SIGGRAPH 2017, conceived by VR Director DAFFY LONDON, HOLO-DOODLE is a unique virtual hangout based on our lab’s holojam. In this experience, we help setup cross-machine light houses.
ChalkTalk in MR Adviser: Prof. Ken Perlin
Chalktalk is an interactive, performative presentation tool that allows for improvisation and limitless extensibility. We bring the web-based free drawing tool to VR through HTC Vive and AR through Tango.
Robotic Haptic Proxies for Collaborative Virtual Reality Adviser: Prof. Ken Perlin
We propose a new approach for interaction in Virtual Reality (VR) using mobile robots as proxies for haptic feedback. This approach allows VR users to have the experience of sharing and manipulating tangible physical objects with remote collaborators.
VRite: A Text-Input Method for Virtual Reality Systems Adviser: Prof. Ken Perlin
A glyph-based aerial virtual keyboard that can be used anywhere for text-input.
Foot-based Interaction with Tactonic in VR Environment Adviser: Prof. Ken Perlin
To free users’ hands for further user experience, we use foot-based interaction to meet basic navigation requirement. The sensors supported by Tactonic provide data of foot is the input.
Holojam Adviser: Prof. Ken Perlin
An untethered multi-user VR prototyping platform. Using the tools of today to prototype the future of interaction when unobtrusive MR is commonplace. I help upgrade the whole framework and maintenance of the hardware.
Graduate Research Assistant, DALAB, School of Software, SJTU 9/2012 – 3/2015
Bimanual Modelling Using Free Virtual Grid With ARGlass Adviser: Prof. Xubo Yang
A homemade AR eyeglass is created by cameras, leap motion and OculusVR and designed bimanual interaction with AR eyeglass. A new approach called Free Virtual Grid is designed to help create 3D models.
Hand-Based Interaction for Object Manipulation Adviser: Prof. Xubo Yang
Designed three types of 3D menus placement with AR eyeglass. Designed unimanual and bimanual hand- based interaction for basic manipulation of virtual objects.
AR Authoring Tools based on Hand-held Device Adviser: Prof. Xubo Yang
Designed an authoring tool to create animation and interaction without coding. Received acceptance of HHME 2014 Poster Session.
FaceTalk: augmented video conference Adviser: Prof. Xubo Yang and Assoc.Prof. Beijun Shen
Act as a team leader by controlling the schedule, solving the technology difficulties and communicating among TA and members. Design AR module including draw ideas by hands and share property during video conferences.
Zhenyi He, Fengyuan Zhu, Ken Perlin. Sharing Physical Interaction in Virtual Reality. //UIST 2017 Demo. (Accepted)
 Zhenyi He, Xubo Yang. Object creation based on free virtual grid with ARGlass[C] //SIGGRAPH Asia 2014
Posters. ACM, 2014: 41.(Published)
 Zhenyi He, Xubo Yang. Hand-based interaction for object manipulation with augmented reality glasses[C] //Pro- ceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applica- tions in Industry. ACM, 2014: 227-230.(Published)
• Computer Graphics 9/2016 – 12/2016
• Human Computer Interaction and Interface 2/2012 – 6/2012 and 2/2013 – 6/2013
Received Outstanding Teaching Assistant Award
• Programming and Data Structure 9/2012 – 1/2013 and 2/2013 – 6/2013
Microsoft Asia R&D. WOSS Group, Shanghai, China Program Manager Intern, Manager: Bekim Demiroski, 6/2014 – 6/2015
eBay in Shanghai, PE Team, Shanghai, China Software Develop Engineer Intern, Manager: Jason Liu, 7/2011 – 7/2012