Tyler Yang

Developed VR/XR Unity experiences for Gabb Global.

Built immersive camera-based Maya plugin for 3D artists using C++, Python and MEL with a Qt-based UI. Achieved real-time data streaming at >60FPS in a custom Python face tracking module with OpenCV and MediaPipe. Developed auto and manual calibration systems to reduce cross-device setup errors by 80% for consistent tracking. Integrated Qt panels and controls for no-code artist controls, improving accessibility for non-technical users. Designed artist-friendly UIs for mode selection, object selection and calibration tools, reducing setup time by 40%. Integrated multiplayer system using Photon for synchronized voice interaction. Built a phoneme-level speech recognition system in VR, improving pronunciation accuracy by 30% in pilot tests. Developed cognitive science research tools with automated phoneme-level analysis.

Built custom CV tools to improve annotation 6x and 50,000+ frame data collection for 98% accuracy ASL models. Engineered core gameplay systems in Unity with real-time CV/ML inference for feedback. Constructed a React frontend for the Unity WebGL build, tripling accessibility by making the game faster and lighter. Built a Django backend deployed to AWS, supporting research dashboards, data collection, and asset hosting.