Create
Design Project Gallery
Toward Accessible Board Game Interaction: A Computer Vision–Based Multisensory Feedback System
- Program: Electrical and Computer Engineering
- Course: EN.520.498.499 Capstone Design Project 1
- Year: 2026
Project Description:
Our project is an assistive system that helps visually impaired players independently play board games. A camera watches the game, and a single board computer (SBC) computes where all the pieces are and what the player is trying to do. That information is turned into touch-based feedback: a tactile grid shows the layout of the board, and a wearable wristband uses vibrations to guide the player’s hand to the right piece or location they’re targeting. The system also provides audio narrations and cues through a speaker to complement the feedback. By combining these features, our system makes board games more accessible, interactive, and enjoyable without requiring constant assistance.
Project Photo:
Our system uses computer vision to track a Sorry! board in real time, identifying pawns, cards, and the player’s hand. Tactile feedback, audio cues, and haptic guidance work together to direct the player to game pieces and announce game state, enabling visually impaired users to play the game independently.