CookPilotA VR assissted culinary experience

CIID Spatial Computing, 2025
Mentors: David Rose, Ricardo Acosta
Duration: 1 week 
Team:  Edha, Chey, Rohan, Ignacio 

CookPilot is a spatial computing tool designed to assist home cooks by providing real-time, hands-free recipe guidance. By scanning the kitchen environment, it places digital anchors that offer step-by-step instructions, allowing users to follow a recipe seamlessly without needing to check a screen.

Using a headset, CookPilot maps the user’s kitchen, identifying key areas such as the stove, cutting board, and sink. As the cooking process unfolds, virtual cues appear in the physical space—highlighting ingredients, guiding placement, and delivering instructions precisely where they are needed. This eliminates the need to pause, check a device, or flip through a recipe book, enabling a more natural and immersive cooking experience.


The exploration of spatial computing in kitchen interactions revealed a common frustration—frequent shifts between instructions and cooking actions disrupt workflow and focus. Current digital solutions, such as apps and video tutorials, require users to repeatedly check screens, interrupting the natural rhythm of cooking. This insight led to the development of CookPilot, which integrates guidance directly into the physical space.

CookPilot provides a speculative look at how spatial computing could shape domestic spaces, raising critical questions about the evolving relationship between technology and everyday experiences.