teech.ai
A proof-of-concept tutoring app for students learning math. Using the phone camera, the app sees and understands math problems, guiding students through problems with hints and step-by-step questions. We added text-to-speech (TTS) to give our app a voice, further engaging students and making it feel like a more personal experience.
Tri Vu built a web interface prototype and Python-based backend utilizing the Gemini Vision API and Fish Audio for TTS.
I built a native proof-of-concept using SwiftUI, AVFoundation, and other native frameworks. In the app, I built a chat and camera interface, integrating with Tri’s backend by sending image and prompt data. I decided to use a gesture-based approach to bring the camera interface front and center.
The app was built in 48 hours for Cal Hacks 12.0, the world’s largest
collegiate hackathon.