Skip to content

Edge Deployment of Machine Learning Models

Running models on phones, devices and sensors: benefits, constraints and optimisation techniques.

Editorial team 1 min read

Edge deployment runs models directly on devices rather than in the cloud.

Benefits

  • Latency: instant responses without network round trips.
  • Privacy: data stays on the device.
  • Offline operation.
  • Lower server costs.

Constraints

  • Limited memory, compute and battery.
  • Diverse hardware.
  • Harder updates and monitoring.

Optimisation Techniques

  • Quantisation.
  • Pruning unnecessary weights.
  • Distillation into smaller models.
  • Efficient architectures designed for mobile.
  • Hardware-specific runtimes and accelerators.

Uses

  • On-device speech recognition and keyboards.
  • Camera features and vision in manufacturing.
  • Wearables and health sensors.
  • Small language models on laptops and phones.

Operations

Plan how to update models, collect performance telemetry (with consent) and roll back.

Hybrid

Many systems combine on-device models for fast, private tasks with cloud models for harder ones.

More in MLOps & deployment

All MLOps & deployment guides →
MLOps & deployment Guide · 2 min

What Is MLOps?

The practices that take machine learning from notebook to reliable production: versioning, automation, deployment and monitoring.

MLOps & deployment 2 min read 26 Dec 2025

MLOps & deployment Guide · 2 min

Deploying Machine Learning Models

Batch scoring, real-time APIs, streaming and on-device inference: choosing how predictions reach users, and deploying safely.

MLOps & deployment 2 min read 25 Dec 2025

MLOps & deployment Guide · 2 min

Monitoring Machine Learning Models in Production

What to monitor after deployment — data, predictions, outcomes and operations — and how to respond when things change.

MLOps & deployment 2 min read 24 Dec 2025

MLOps & deployment Guide · 2 min

Model Registries and Versioning

Why every production model needs a version, metadata and lineage, and how a model registry manages promotion and rollback.

MLOps & deployment 2 min read 23 Dec 2025