Curriculum Vitae


New York University (NYU), New York, U.S.
PhD in Future Reality Lab (FRL), Courant, GSAS,Adviser: Prof. Kenneth Perlin (9/2015 – Present)

Shanghai Jiao Tong University (SJTU), Shanghai, China
M.S. in Digital Art Lab (DALAB), School of Software,Adviser: Prof. Xubo Yang  (9/2012 – 3/2015)
B.S. in Software Engineering, School of Software (9/2008 – 6/2012)


Graduate Research Assistant, FRL, NYU  9/2015 – Present


HoloKit, the low cost open source mixed reality experience, which includes the HeadKit cardboard headset and TrackKit software. I help create several demos for the release.

HoloDoodle                 Adviser: Prof. Ken Perlin

Premiering at at SIGGRAPH 2017, conceived by VR Director DAFFY LONDON, HOLO-DOODLE is a unique virtual hangout based on our lab’s holojam. In this experience, we help setup cross-machine light houses.

ChalkTalk in MR         Adviser: Prof. Ken Perlin

Chalktalk is an interactive, performative presentation tool that allows for improvisation and limitless extensibility. We bring the web-based free drawing tool to VR through HTC Vive and AR through Tango.

Robotic Haptic Proxies for Collaborative Virtual Reality      Adviser: Prof. Ken Perlin

We propose a new approach for interaction in Virtual Reality (VR) using mobile robots as proxies for haptic feedback. This approach allows VR users to have the experience of sharing and manipulating tangible physical objects with remote collaborators.

VRite: A Text-Input Method for Virtual Reality Systems         Adviser: Prof. Ken Perlin

A glyph-based aerial virtual keyboard that can be used anywhere for text-input.

Foot-based Interaction with Tactonic in VR Environment     Adviser: Prof. Ken Perlin

To free users’ hands for further user experience, we use foot-based interaction to meet basic navigation requirement. The sensors supported by Tactonic provide data of foot is the input.

Holojam                         Adviser: Prof. Ken Perlin

An untethered multi-user VR prototyping platform. Using the tools of today to prototype the future of interaction when unobtrusive MR is commonplace. I help upgrade the whole framework and maintenance of the hardware.

Graduate Research Assistant, DALAB, School of Software, SJTU 9/2012 – 3/2015

Bimanual Modelling Using Free Virtual Grid With ARGlass Adviser: Prof. Xubo Yang

A homemade AR eyeglass is created by cameras, leap motion and OculusVR and designed bimanual interaction with AR eyeglass. A new approach called Free Virtual Grid is designed to help create 3D models.

Hand-Based Interaction for Object Manipulation                    Adviser: Prof. Xubo Yang

Designed three types of 3D menus placement with AR eyeglass. Designed unimanual and bimanual hand- based interaction for basic manipulation of virtual objects.

AR Authoring Tools based on Hand-held Device                       Adviser: Prof. Xubo Yang

Designed an authoring tool to create animation and interaction without coding. Received acceptance of HHME 2014 Poster Session.

FaceTalk: augmented video conference  Adviser: Prof. Xubo Yang and Assoc.Prof. Beijun Shen

Act as a team leader by controlling the schedule, solving the technology difficulties and communicating among TA and members. Design AR module including draw ideas by hands and share property during video conferences.


[1]Zhenyi He, Fengyuan Zhu, Ken Perlin. Sharing Physical Interaction in Virtual Reality. //UIST 2017 Demo. (Accepted)
[2] Zhenyi He, Xubo Yang. Object creation based on free virtual grid with ARGlass[C] //SIGGRAPH Asia 2014
Posters. ACM, 2014: 41.(Published)
[3] Zhenyi He, Xubo Yang. Hand-based interaction for object manipulation with augmented reality glasses[C] //Pro- ceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applica- tions in Industry. ACM, 2014: 227-230.(Published)


Teaching Assistant
• Computer Graphics                                                            9/2016 – 12/2016
• Human Computer Interaction and Interface                2/2012 – 6/2012 and 2/2013 – 6/2013
Received Outstanding Teaching Assistant Award
• Programming and Data Structure                                   9/2012 – 1/2013 and 2/2013 – 6/2013


Microsoft Asia R&D. WOSS Group, Shanghai, China Program Manager Intern, Manager: Bekim Demiroski, 6/2014 – 6/2015

eBay in Shanghai, PE Team, Shanghai, China Software Develop Engineer Intern, Manager: Jason Liu, 7/2011 – 7/2012