The device held in one hand: a Raspberry Pi with a small touchscreen and a Logitech webcam on top, the screen showing a local Llama model explaining how to perform CPR

Can knowledge outlive the grid?

A pocket-sized Raspberry Pi that runs a language model offline, for when there are no books, no mentors and no internet.

Timeline
2024
Scope
Concept
Hardware Prototyping
Local AI
Personal Work

Knowledge is survival

When you have to survive with no books, no mentors and no internet, what knowledge still matters? And when memory begins to fade, when even a single human can no longer carry their own cherished past, we turn to tools and machines to remember for us.

So what fragments of civilization must the machine remember first? Is it medicine, shelter, or the memory of language itself? What is the minimum data that still carries the weight of humanity? If knowledge becomes fire, who does the machine choose to warm, and who might it burn?

Listing the components: scrap or buy

  1. Raspberry Pi 5 (buy)
  2. Raspberry Pi heatsink (buy)
  3. Acrylic back cover (scrap)
  4. Camera (scrap, from my old Logitech webcam)
  5. Screen (I first tried to scrap one from a Nintendo DS, but it failed)
  6. Power supply (scrap USB-C cable and battery, still to be improved)
Working out the stack in my sketchbook.

Built without soldering

The Raspberry Pi 5 is claimed to run AI efficiently on little electricity. The problem with running AI locally is heat, so I added thermal pads, a heatsink and a fan. A touchscreen LCD and a basic webcam handle output and input.

These photos are from my early days of learning: every part plugs or screws together, no soldering.

1 Raspberry Pi 5
2 Thermal pads
3 Heatsink and fan
4 Touchscreen
5 Webcam and power

Running offline

The device runs a language model locally, TinyLlama or Llama 3.2. A power bank powers it, but power banks run out. So when there is no electricity, the power bank has to be charged by a mechanical crank, turned by hand.

No internet, no cloud: the model answers on the device itself.

To improve

Power. Running increasingly intelligent AI demands far more energy, which makes a hand crank generator hard to rely on. The workflow is always to charge the power bank first and then turn on the device. The crank can’t power the device directly, because its voltage and supply are inconsistent.

Knowledge. The AI’s survival knowledge could be trained to be more accurate and concise. For now it runs Llama 3.2 (3 billion parameters), because of hardware limits too.

A hand crank generator, the planned energy source for the power bank.