: The system analyzes a how-to video, extracting narrated steps and augmenting them with specific completion criteria (e.g., "the onion should be translucent").
: Integrated with commercial smart glasses, Vid2Coach uses a camera to track the user’s actions and provides context-aware instructions and proactive feedback. vid2coach
With Vid2Coach, Emma and Alex were able to: : The system analyzes a how-to video, extracting
Early evaluations of Vid2Coach have shown remarkable results in improving independence for BLV individuals. In user studies, participants using the system completed complex cooking tasks with compared to their standard workflows. The system significantly reduces the cognitive load required to translate visual instructions into physical actions. Future Directions and Challenges In user studies, participants using the system completed
Alex had been using Vid2Coach for months and had seen significant improvements in his clients' progress. He was able to provide detailed feedback on their form, technique, and performance, which helped them correct their mistakes and achieve their goals faster. Emma was impressed by Alex's success and decided to join him in using Vid2Coach.
Binarynights
