A camera-like object that remembers a moment by turning it into music.
I designed the device experience around a physical shutter button, connecting image capture, AI interpretation and music playback in a handheld prototype.
An audio snapshot
I wanted to use another sense to remember a moment. A photo is a visual snapshot; with mmento-1, I wanted an audio snapshot.
Design & implementation
The prototype runs on a Raspberry Pi style setup with camera, screen, button, battery monitoring, and local playback. When the button is pressed, it captures an image and freezes that moment on screen.
That image is then interpreted locally through a vision-language model to produce two structured outputs: lyrics and style. Those outputs are sent to a music generation service, which later returns a generated track through a callback. The device downloads the result, plays it, and overlays the generated text on the captured image.
What it does
- Camera-like object designed around musical memory
- Multimodal pipeline from image to lyrics to music
- Local vision-language inference with remote music generation
- Embedded playback, display, and hardware-button interaction
- Single-device interaction loop with callback-driven audio return
