Live demo
Watch a footstep become a kind word.
Real geophone recordings play as if live. Everything on the left runs in your browser, like the device in the home. Only the summary goes to Gemini on the right.
- 1Press Start sensor and watch steps appear.
- 2Pick a kind of day.
- 3Ask Gemini for the family note.
Inside the home · edge device
Floor sensor
Sensor input
Floor vibration · last 8 sresident not recognised
Latest step · CWT scalogram5–400 Hz
Step fingerprintvs resident (dashed)
0steps detected
–steps / min
–who is walking
–match to resident
Outbox · what leaves the home
Start the sensor. When a walk ends, its summary appears here.
Cloud · Gemini API
Family note
What kind of day? Earlier hours are simulated
Today’s events
Your key goes only from this browser to Google’s Gemini API. Without a key, a clearly labelled offline sample is shown.
Function called
To the family
Spoken to the resident
Exact request sent to Gemini
Gemini’s raw response
Real
Floor recordings (two lab participants, 5 min each, 2 kHz), step detection, CWT, gait timing, the “is this the resident?” check, the JSON, and the Gemini calls.
Simulated
Earlier hours of the day, the 14-day history, and the five kinds of day. “Walking slower” re-times the real steps 18% further apart.
Simplified
In the browser, identity uses a small CWT fingerprint. On the real device, DeepStep (22 MB, ~0.8 s per step on a Raspberry Pi) does this job.