Bonsai pcb

The main repository containing all the files involved in the creation of this smart device, such as cad files, code, designs...

Motivation for the project

I've always wanted to do a hardware project like this, involving a camera. And I love the idea of being able to connect AI with real-world data, so this project is perfect!

Repository Structure

Bonsai-Glasses/
├── bom.csv             # The bill of materials with links.
├── src/
│   ├── firmware/       # Embedded / microcontroller source code
├── hardware/
│   ├── cad/            # 3D CAD models and mechanical designs
│   └── bonsai_pcb/     # PCB schematics and board layouts
└── assets/             # Images, logos, and other design assets

How it works (WIP)

Thanks to the backend, Bonsai is able to interact easily with free and fast AI providers, such as Groq (for the STT and vision LLM). For TTS, it uses Piper (locally), which is esential for Catalan support. Thanks to the board, a XIAO ESP32 Sense, we can use the provided camera to give the model visual context, which is then used to describe the current enviroment. Using the built-in web server in the firmware, you can configre all the Wifi networks, and default user button actions. You can also change parameters such as default language. Some of these parameters can also be configured using the wake word (ex. "Hey Bonsai, change the language to Spanish").

Flashing a board

The web flasher writes a firmware release to a board over USB from the browser, with no toolchain to install. Plug the board in, pick a version and press write. It needs Chrome, Edge or Opera on a computer, since it runs on the Web Serial API.

Releases are cut by hand: run the Build and publish firmware workflow from the Actions tab, give it a version like v1.0.0, and it builds the firmware, tags the commit and publishes the release the page reads (.github/workflows/release.yml). The page itself lives in docs/ and is described in docs/README.md.

Your settings are safe across a flash: /config.json, the saved networks and the voice clips are on the SD card, and only the firmware images get replaced.

Bill of Materials