1 open-source ESP32 project guide tagged #inference: build steps, hardware and firmware.
Flash a Rust inference engine for a 28.9M-parameter language model onto an ESP32-S3. Generates children's stories at 10.5 tok/s — faster than the C port it beat.
