Dungeons & Dragons using Computer Vision

Inspired by web-based and light applications: This project was born out of the need to keep traditional tabletop gaming experiences, like Dungeons & Dragons, accessible during the COVID-19 pandemic. To bridge the gap between physical and virtual play, we developed an application using Java and JavaFX that utilized computer vision to translate a physical battle map into a virtual one. The system allowed Dungeon Masters to draw or mark the physical map in real-time, with colored pens representing different types of terrain (e.g., green for trees, blue for water). The virtual map would then adapt dynamically, recreating the battle map with high-fidelity custom assets, ensuring players enjoyed both physical and digital immersion simultaneously.

My Role & Skills Used

I took on the UX designer and JavaFX developer, creating all the visual assets based on the aesthetic and thematic needs of Dungeons & Dragons. My focus was to ensure the artistic style resonated with players and brought the virtual map to life. I worked closely with the development to integrate these assets seamlessly into the program, ensuring they adapted to the physical map in real-time. My design choices emphasized clarity, user engagement, and thematic consistency without over-complicating the design.