The Hallway Track
Engineering Insights

Turning raw hardware sensor data into music with Gemini

Google Developers (Google I/O) · Oct 15, 2026 · Engineering Insights

Developer used Gemini to build a browser-based synthesizer driven by laptop sensor data

“It was my vision and I was able to mold and achieve using a tool like Gemini.”

A developer used Google Gemini to rapidly prototype a browser-based digital synthesizer that converts real-time laptop sensor data (tilt, shake, angle) into music. The project demonstrates Gemini's utility as a coding assistant for creative hardware-adjacent projects using open-source documentation as context. While a compelling use case, it is a hobbyist demo rather than a significant industry signal.

gemini creative-coding browser sensors music prototyping

Watch / read the original source →