models.dev: Turn Your Data Into On-Device AI Models Without the Headache

You've got a bunch of labeled images or text snippets. You want a lightweight model that runs locally, maybe even on a phone. The usual path? Setup a training environment, wrestle with TensorFlow Lite or Core ML, and spend hours debugging model conversion. There's a simpler way now.

models.dev is a tool that takes your raw data (images, text, audio) and spits out an optimized on‑device model ready to integrate. No cloud dependency, no complex pipeline. Just your data and a few commands.

What It Does

At its core, models.dev is a developer‑focused CLI and library that handles the entire model lifecycle from data to deployment. You feed it your dataset (CSV, image folders, audio files), choose a task (classification, regression, object detection), and it outputs a model in formats like TensorFlow Lite, Core ML, or ONNX. It also generates a simple inference snippet in Python, Swift, or Kotlin so you're not staring at an empty file.

The tool is built on top of popular frameworks (PyTorch, TensorFlow) but abstracts away the boilerplate. You don't write training loops anymore. You don't manually prune or quantize. It handles that based on your target device (phone, Raspberry Pi, web browser).

Why It's Cool

No cloud, no API keys. The model runs entirely on the user's device. That means privacy by default, zero latency, and offline capability. Perfect for things like a tiny gesture recognizer in a smart mirror or a local spam filter in a messaging app.

Automatic quantization and pruning. models.dev compresses the model specifically for your target hardware. If you're deploying to a Pixel phone, it'll use the Edge TPU or GPU if available. If it's a Raspberry Pi, it'll optimize for ARM CPU. You get a lean model without manually tweaking every parameter.

One command to go from CSV to working app. The tool includes a serve command that starts a local web API with your model, so you can test it with real requests before writing any integration code. That's a huge time‑saver.

Supports multiple data types. Images, text, audio, and even structured tabular data. If you can label it, you can turn it into a model.

How to Try It

1. Clone the repo:

   git clone https://github.com/anomalyco/models.dev
   cd models.dev
   

2. Install dependencies (Python 3.10+ recommended):

   pip install -r requirements.txt
   

3. Run a quick example with sample data:

   python -m models.dev train --data