Virtual Production x Unity Editor App
This real-time spatial UX prototype was created to aid set and level designers in film and game production by allowing them to manipulate 3D environments directly from a mobile device. The app enabled users to adjust objects within Unity in real time using simple touch-based gestures. The goal was to bridge the gap for designers who may have limited technical knowledge of game engines, allowing them to easily translate, rotate, and scale objects within a scene. Our prototype successfully demonstrated the usability of 2D-to-3D spatial manipulation and the importance of intuitive controls in complex environments.
- Gesture-Based Controls: Users could adjust objects by using one or two fingers to manipulate objects’ position, rotation, and scale.
- Axis Control Options: For more precise manipulation, users could lock into a specific axis, simplifying complex 3D navigation.
- Future Potential: The prototype highlighted the potential for adding asset libraries and more complex scene manipulation tools for future iterations.
My Role & Skills Used
As the primary UX/UI designer on this project, I was responsible for developing a streamlined, intuitive interface that allowed users to easily manipulate objects within a 3D scene. The journey began with created wire-frames through whiteboard sessions and led several iterations of usability testing, refining the design to improve interaction clarity. Additionally, I worked on shaders that highlighted selected objects and developed button feedback mechanisms to ensure that users could easily track their actions. The challenge of managing 3-axis control in a user-friendly way was resolved through gesture controls and axis-lock options, balancing simplicity with functionality. We ran usability tests, including a SUS test, which yielded positive results, reinforcing the effectiveness of the design approach.
Application Showcase
Below is a video showcasing some of the elements in the application.