What is embedded machine learning?

By Paddy Smith
The power required for AI means it is usually done remotely, away from a device. But a new era of IoT devices with embedded machine learning is coming...

Data transmission and computational power. That’s AI in a nutshell. It’s computationally expensive to implement and gets in the way of computers doing other work. Now a new generation of AI threatens to remove these roadblocks and usher in a better AI future. It’s called embedded machine learning.

What is embedded ML?

Embedded machine learning moves AI computation from a remote computer to the device. That could be IoT-enabled components or machines, for instance. To date, it hasn’t been practically possible to get enough computational power into IoT devices. That could be about to change as more powerful dedicated IoT AI chips come to market.

What’s the benefit of embedded machine learning?

Embedded ML could allow more widespread use of IoT, with efficiency improvements that allow for the equivalent of 25 per cent faster execution times. It would improve visibility on a machine by machine basis and harvest data that is currently excluded owing to cost or bandwidth constraints.

Embedded machine learning will free up budgets and bandwidth

Too much data is a bad thing when you can’t collect it all. Current AI models get by on what data they are allowed to collect, as chosen by humans driven by cost-saving briefs or limited allocations of bandwidth. Without those constraints, embedded machine learning is set to accelerate as reasons to limit data transfer and computational power fall.

Embedded machine learning everywhere

Embedded AI chips could find their way into everything – vehicles, plant, data centres, arms – and spark a wave of automatic data collection under their own computational steam.

Share

Featured Articles

Toshiba Takes Another Step to Ushering in Embodied AI

Toshiba's Cambridge Research Lab has announced two breakthroughs in Embodied AI alongside a new group to renew focus on the tech

Why AWS is Investing $230m in Credits for Gen AI Startups

Amazon is investing US$230m in AWS cloud credits to entice Gen AI startups to get onboard with using its cloud services

How Retrieval Augmented Generation (RAG) Enhances Gen AI

RAG is a technique that promises to improve the way Gen AI fetches answers and provide business with a more reliable use case for client-facing uses

Synechron’s Prag Jaodekar on the UK's AI Regulation Journey

AI Strategy

LGBTQ+ in AI: Vivienne Ming and the Human Power of AI

Machine Learning

Samsung’s AI-Era Vision Coincides With its New Chip Tech

AI Strategy