EDGE AI POD

EDGE AI FOUNDATION

Discover the cutting-edge world of energy-efficient machine learning, edge AI, hardware accelerators, software algorithms, and real-world use cases with this podcast feed from all things in the world's largest EDGE AI community.

These are shows like EDGE AI Talks, EDGE AI Blueprints as well as EDGE AI FOUNDATION event talks on a range of research, product and business topics.

Join us to stay informed and inspired!

Play

Open in

27 episodes
weekly
Avg 22 min
English

Support the show

Goes straight to the publisher. podnod takes nothing.

Support this Podcast

Episodes 27

Newest Oldest Longest

All20 Unplayed20 In progress0 Played0

Counted on this page — what you have heard stays on this device, so it is not something the list can be paged by.

Thursday · 25 min
Revolutionizing On-Device AI Deployment Through Rapid Implementation
The fastest AI you’ll use today might already be in your pocket. We dive into how modern smartphones ship with dedicated MPUs that outperform CPUs and GPUs for inference while slashing power use, unlocking private, real‑time AI without a GPU cloud bill. Our roadmap shows how to turn that potential into products: optimize your model, compile for each vendor target, benchmark on 200+ devices, then drop in a generated runtime for iOS, Android, or mobile Linux. We walk through a developer‑first workflow that starts with a simple upload and ends with a copy‑paste app. Scan a QR code to run your model on your phone and see real latency, accuracy, and power. Meanwhile, automated harnesses test across Apple, Qualcomm, and MediaTek devices to produce a credible performance report. For language models and agents, we compare quantization options like Q2, Q4, and Q8, measure tokens per second, and surface trade‑offs between footprint and quality so you can pick a configuration that feels instant, not sluggish. Beyond the how, we explore why on‑device AI changes the game: zero recurring cloud compute, lower maintenance overhead, and stronger user trust through data locality. Real‑world applications include medical imaging in the operating room, offline audio features, and rugged field tools that work in tunnels, aircraft, or rural areas with poor connectivity. We also address vendor fragmentation and share how a unified SDK bridges iOS and Android, with Flutter and React Native support on the way. If you care about speed, privacy, and cost, this is your blueprint for running AI at the edge—reliably and at scale. Subscribe for new deep dives, share this with a teammate wrestling with GPU bills, and leave a review to tell us which device you want benchmarked next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
October 8 · 22 min
How Edge AI Moves From Cloud Hype To Real-World Impact
What if the next great leap in AI isn’t bigger models in bigger clouds, but millions of small, smart systems making decisions where the data is born? Guy Tamir of Intel connects the dots from steam and electricity to today’s language-driven AI, then map the pattern that keeps repeating: parallelism, mobility, autonomy, and finally distributed swarms. Once machines learned our language with tokenization, embeddings, and attention, text unlocked human knowledge—and capability exploded so quickly that benchmarks now show models outscoring average humans on IQ-like tests. The shocking part isn’t just that they’re smart; it’s how fast it happened. We break down why the future belongs to Edge AI. Factories don’t need round trips to the cloud to reject a faulty part. City cameras can detect crashes, alert responders, and create a green wave for ambulances in real time. Laptops can run personal copilots tuned to your style and goals, drawing on your emails and documents without exposing everything to a data center. That shift demands hardware built for tight power and heat budgets—heterogeneous chips mixing CPUs for control, GPUs for vision, NPUs for efficient inference, and media accelerators. On the software side, we cut through complexity with the open-edge platform: OpenVINO for cross-accelerator inference, Deep Learning Streamer for video pipelines, Scenescape for multi-camera 3D understanding, and Getty for fast, GUI-driven dataset creation and custom training. Looking ahead, we outline four trends: models get smaller and more targeted, retrieval replaces stale memorization with live knowledge, continual fine-tuning adapts systems to local contexts, and cognition becomes personal and explanatory. Think a tutor that teaches the way you learn, or a car that becomes safer each night as it absorbs local edge data. Autonomy will grow, but trust must catch up through reliability, guardrails, and transparency before agents get the keys to your finances or schedule. If you’re building for the real world, this is your roadmap to put intelligence where it matters most. If this conversation sparks ideas, follow and share it with a teammate who’s wrestling with edge deployments. Subscribe for more deep dives, and leave a review telling us your top edge use case—you’ll shape what we explore next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
October 1 · 26 min
Edge AI, Energy, And Autonomy
What if the next big jump in productivity isn’t a single breakthrough but a flywheel—AI that runs on the edge, energy systems that adapt in real time, and autonomy that safely acts in the physical world? Professor Winston Hsu of NPU in Taiwan brings academic perspective and industry experience together to map where the value actually lands over the next few years. We start by reframing AI’s progress through four waves—perception, language, scaling, and now longer-context reasoning—and explain why the most useful gains are arriving from the opposite direction: small, capable models that run locally. With tokens getting cheaper and inference efficiency rising, billion-parameter LLMs and VLMs can power phones, PCs, and embedded devices where latency and privacy rule. That shift changes what’s possible for autonomy. Instead of waiting for a full robotaxi world, we dig into the realistic trajectory: L2+ features at massive scale, software-defined vehicles, and the safety and cybersecurity discipline that keeps humans in the loop while reliability climbs. Then we cross the bridge from bits to atoms. Robots must perceive, plan, and act under uncertainty, so we explore how foundation models bring common sense, how cross-embodiment learning transfers skills from a few videos, and why dense mapping and closed-loop control belong at the edge. Capability without caution is a trap, so we draw on automotive standards—functional safety, compliance, lifecycle quality—to show how to bound risk and reduce hallucination-induced failures when systems touch the real world. Finally, we turn to energy—the constraint and the opportunity. AI workloads demand power, but AI also strengthens the grid: battery storage coordination, renewable integration, and site-level optimization with reinforcement learning and predictive control. Operators already manage gigawatts and billions of data points with hybrid edge–cloud stacks, cutting curtailment and boosting resilience. If you’re building for the near term, this is your playbook: pick edge-first use cases, favor compact models with strong reasoning, embed safety from day one, and treat AI, energy, and autonomy as one system. Subscribe, share with a teammate who ships products, and leave a quick review with the one edge use case you want launched next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
September 24 · 20 min
Why The Next Wave Of AI Lives At The Edge
AI’s center of gravity is moving—from monolithic cloud models to a living fabric that connects devices, senses the world, and infers on the spot. We walk through how agentic systems coordinate models across earbuds, phones, gateways, cars, and the cloud to deliver speed, privacy, and lower costs without sacrificing capability. We unpack the practical stack behind this shift: connect, sense, and infer. That means the right protocol for the job—Bluetooth, Wi‑Fi, UWB, Thread, Matter, or 5G—paired with robust sensing for audio, vision, motion, and biometrics, and inference engines sized for each device’s power and compute envelope. From driver monitoring to spatial audio and affordable glucose monitors, we explore how physical AI turns everyday objects into intelligent collaborators and why on-device models often create better user experiences than cloud round trips. You’ll hear how investment is tilting toward inference, why hybrid edge-cloud is the realistic future, and how toolchains that target multiple devices with one software stack will separate winners from the rest. We share a real-time translation walkthrough—noise reduction and wake words on earbuds, ASR and translation on the phone, and long-context insight in the cloud—to illustrate how an AI fabric routes tasks for the best latency, privacy, and cost profile. Along the way, we highlight Siva’s role in connectivity IP, AI DSPs, and scalable inference that already power billions of shipped devices. If you’re building AI products—or deciding where to run your next model—this is your roadmap to the edge. Subscribe, share with a colleague, and leave a review telling us which device you’d empower with on‑device intelligence next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
September 17 · 42 min
Why Hardware, Software, And Developers Must Unite To Bring AI To The Real World
The hype fades fast when your cloud bill spikes and your devices still lag. We sat down with leaders from Qualcomm, Renesas, Enerzai, Kudrat AI, and Advantech to trace how edge AI finally delivers real-world value—by uniting silicon, software, and developer experience into one coherent pipeline. From cost predictability to privacy and power, the economic and technical case for running models on-device has never been stronger. You’ll hear how chipmakers are acting like platform companies, pairing scalable TOPS with compilers, model hubs, and ready-to-run containers that collapse months of integration. Renesas explains how consistent APIs and multi-frontend support (TensorFlow Lite, PyTorch, ExecuTorch, ONNX) tame hardware sprawl from MCUs to MPUs. Qualcomm outlines a developer-first approach—optimizations, reference apps, and ecosystems—that smooth the last mile from prototype to fleet deployment. And when it’s time to ship, Advantech shows how prebuilt containers and integrated OTA cut through toolchain sprawl so teams can focus on product, not plumbing. We also dig into two market-proven stories. Enerzai walks through a nationwide rollout of sub-100 MB voice-control LLMs on two million set-top boxes, matching cloud quality while stabilizing costs and slashing latency. Kudrat AI brings edge AI to the forest frontier, using on-device detection to expand battery life from weeks to six months, protect privacy by filtering human images, and scale monitoring across thousands of kilometers with limited connectivity. Along the way we grapple with the hard parts: missing operator support, talent gaps in embedded ML, and the need for pragmatic standards that keep models off slow software fallbacks. The next five years won’t be a cloud-or-edge debate. Smarter endpoints will decide what stays local, what calls the cloud, and when to sync—especially as robotics stacks multiple models per device. If you care about cutting costs without cutting capability, building reliable fleets, and turning idle data into action, this conversation lays out the edge AI playbook. Enjoy the episode, share it with a teammate, and if it sparked ideas for your roadmap, subscribe and leave a quick review to help others find the show. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
September 10 · 20 min
Your Earbuds Might Be Smarter Than Your Car - A talk with Iri Trashanski of Ceva
Join Iri Trashanski, Chief Strategy Officer of Ceva, as we explore how intelligence is shifting into a distributed fabric where devices connect, sense, and infer in concert with the cloud. From phones and PCs to earbuds, cars, and medical wearables, we break down why latency, privacy, cost, and power are driving a new architecture—and how agentic AI coordinates models across endpoints to deliver seamless outcomes. We unpack the connect, sense, infer framework as a practical blueprint for product teams. On connectivity, we compare Bluetooth, Wi‑Fi, 5G, Thread, Matter, UWB, and Zigbee, and explain how each fits different throughput, power, and range needs. On sensing, we look at audio, vision, and motion pipelines, plus sensor fusion running on AI‑tuned DSPs. On inference, we show how NPUs and AI DSPs scale from tiny wearables to automotive ADAS and why monetization increasingly happens at inference, not training. Along the way, we trace real evolutions: headsets moving from simple streaming to AI noise reduction and biometrics, vehicles layering ADAS on top of connectivity, and low‑cost glucose monitors gaining always‑on analysis. To make this tangible, we walk through a real‑time translation chain that spans earbuds, a phone, and the cloud. The earbud enhances and detects wake words, the phone runs ASR and translation for low latency, and the cloud summarizes meetings for long‑form insights. The result is faster response, stronger privacy, and lower OPEX, with heavy compute where it belongs and lightweight models at the edge. If you’re building for the next wave—physical AI across billions of devices—this conversation offers a clear roadmap and concrete choices you can act on today. If you enjoyed this, follow the show, share it with a teammate who builds edge products, and leave a quick review to help others find us. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
September 3 · 15 min
Cans, Defects, And Synthetic Vision
What if the best training data for your model never existed in the real world? We walk through a practical, high-stakes use case—defect detection on aluminum cans—and show how synthetic images, perfect annotations, and smart scene design can outperform slow, manual pipelines. First, we explain why traditional data collection and labeling bog down computer vision projects: rare defects are hard to capture, human annotations drift, and production lines can’t pause for staged photo shoots. Then we share how a no-code platform lets teams design photoreal scenes, generate millions of images across can types—standard, sleek, slim, and stubby—and automatically export COCO, YOLO, and TensorFlow labels. You’ll hear how we simulate real defects like bent, broken, lifted, and missing tabs with fine control over severity and placement, so models learn edge cases that matter. We also dig into realism. Reflective metal surfaces demand careful lighting and shading, so we randomize illumination, camera angles, and rotations to capture what top and side inspection cameras actually see. That domain diversity pays off in robustness across factories, lines, and sensors. The result: the world’s largest synthetic can dataset—2,985,600 images, high and low resolution, fully annotated, and released under Creative Commons Zero for frictionless experimentation and deployment. Beyond this single project, the episode highlights a shift in how AI gets built. Analysts expect synthetic-first pipelines to dominate by 2030 because they deliver controllable, balanced, and privacy-safe data at scale. If you’re tired of chasing edge cases with screwdrivers and clipboards, this conversation offers a faster, cleaner path to high-accuracy models on the factory floor. If this resonates, follow the show, share it with a teammate, and leave a quick review to help more builders find it. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
August 27 · 50 min
Bridging the Research-Reality Divide in Edge AI
Ever wondered why so many groundbreaking AI innovations never make it to market? The answer lies in the treacherous gap between research and reality – a challenge that's costing companies millions and delaying critical technologies from reaching consumers. This riveting panel discussion brings together seasoned experts from Intel, Wind River, Advantech, EmbedUR, and The Things Industries who've accumulated plenty of "scar tissue" trying to bridge this divide. Their conversation cuts through the hype to reveal the practical obstacles that prevent brilliant AI concepts from becoming commercial products. The panelists don't hold back as they address the hard truths: safety certification requirements that can derail deployment in mission-critical industries, the dangers of incorporating AI technology without clear use cases, and the lack of standardization that forces developers to reinvent the wheel with each implementation. One panelist shares how aerospace customers peppered them with certification and explainability questions for 45 minutes when presented with new edge AI capabilities – revealing how regulatory requirements can completely block adoption in certain sectors. You'll gain invaluable insights into the four pillars needed for successful edge AI deployment: standardization, traceability, explainability, and certification. The discussion also explores the surprising disconnect between technology maturity and business processes, revealing why even the simplest IoT implementations fail when organizations aren't digitally ready. Whether you're a researcher, developer, product manager, or business leader, this conversation provides the roadmap for turning your AI innovations into market-ready solutions. Because as one panelist bluntly puts it, "At the end of the day, the KPI is cash." Subscribe now to hear the strategies that can help your next AI project cross the finish line from laboratory to real-world deployment. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
August 20 · 15 min
Synthetic Data For Smarter Vision
You shouldn’t need a warehouse full of broken products to build a reliable vision model. We dig into how synthetic data flips the script for manufacturing and quality control, showing why controlled scenes, perfect labels, and rapid iteration can outrun old pipelines of manual collection and error-prone annotation. With Sherry List and Goran from Synthetic AI Data, we walk through the strategy behind a no-code engine that empowers fusion teams—engineers, developers, and operators—to generate the exact scenarios their models need. The story centers on a high-stakes, high-volume domain: metal and aluminum cans. From standard to sleek, slim to stubby, tabs in different materials and colors, and both beverage and food lids, we map the defect landscape that actually matters on the line. Bent, broken, missing, and lifted tabs are recreated with photoreal materials, realistic reflections, and varied lighting, then captured from top-down and side angles to match real inspection setups. The result is control—over class balance, severity, camera pose, and environment—so teams can stress-test models and discover what improves accuracy before hitting production. We also reveal the scale required to make a difference: roughly three million synthetic images, high and low resolution, fully annotated in COCO, YOLO, TensorFlow, and more. Releasing the dataset under CC0 via the EDGE AI Labs removes friction for researchers and practitioners to explore defect detection, domain randomization, and multi-view training. Along the way, we share a cautionary tale of “screwdriver datasets” and explain why simulation delivers safer, faster, and more reproducible results. If you care about computer vision performance, cost, and time-to-value, this conversation offers a practical blueprint you can use today. Subscribe for more deep dives, share this with a teammate who wrangles labels, and leave a review telling us what you’ll build with the dataset. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
August 13 · 15 min
Cloud Can’t Keep Up, So Your Toaster Gets A Brain
The cloud can’t carry the weight of billions of sensors forever, and we’re proving why. We walk through a new class of ultra‑low‑power, heterogeneous neuromorphic microcontrollers that bring real intelligence to the edge, where timing, latency, and privacy matter most. From raw IMU streams to on‑device actions, you’ll hear how spiking neural networks, tiny CNNs, and a RISC‑V core team up to decode the world in real time without draining a battery. We dig into the full signal path: encoding analog magnitude and velocity into spikes, pushing temporal patterns through an SNN accelerator, and decoding results for decisions on the spot. Our Talamo SDK lets you train in a familiar PyTorch‑like workflow, visualize progress with TensorBoard, and then hand everything to a system compiler that maps your pipeline across hardware and software, generating deployable binaries. No guesswork, no fragile glue code. To keep iteration fast, our cycle‑approximate SoC simulator mirrors the chip’s timing behavior so closely that functional results match hardware one‑to‑one, enabling confident development even before silicon lands on your desk. We also showcase a live wearable gesture demo built on accelerometer and gyroscope data, using integrate‑and‑fire and temporal‑contrast encoders to capture amplitude and motion dynamics. You’ll get candid results: auto‑generated code trades a bit of size and power for big gains in developer speed, while the simulator runs near real time. To cap it off, we announce a commercial, award‑winning ultra‑low‑power neuromorphic chip designed for consumer electronics, smart home, industrial monitoring, and wearables. Ready to build products that sense, understand, and act at the source? Follow, share, and leave a review to tell us what you want to create at the edge. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
August 6 · 17 min
Edge AI That Cuts Chemical Waste
What if a lab test that takes 12 to 24 hours could be replaced by a live estimate that guides dosing in real time? We walk through a high-stakes water story where boron control in desalination demanded more than a clever model—it needed a secure, local-first AI system that works across wildly different plants. Our journey with Acciona started with a simple idea: a virtual sensor to predict boron and avoid overusing caustic soda or risking fines. The reality was messy. Membranes, sensors, and SCADA setups varied from site to site. Cybersecurity kept data locked on-prem, and lab workflows produced sparse, noisy labels. A single global model wasn’t resilient enough. So we flipped the playbook and orchestrated many models at the edge—one per rack when needed—packaged in Docker, deployed with a click, and monitored locally with InfluxDB and Grafana. We break down the full stack: MQTT brokers to standardize data, connectors for heterogeneous OT systems, TensorFlow for inference, and JupyterLab plus MLflow for on-device training and versioning. This architecture kept raw data inside the plant while a cloud console managed applications securely. The payoff was immediate: accurate boron estimates tightened dosing, cut chemical spend, reduced penalties, and built operator trust by showing predictions alongside lab results. One site saved over $200,000 in a year; scaled across the fleet, the impact reaches well into the millions, with healthier water as a bonus. Beyond boron, the same edge AI approach unlocks energy optimization for high-pressure pumps, membrane fouling detection, and even computer vision tasks—without compromising critical infrastructure security. If you care about industrial AI that actually ships, this is a practical blueprint: local models, secure orchestration, and a path from pilot to fleet. Enjoy the episode, share it with a teammate who wrestles with on-prem constraints, and leave a review. Want to see it live? Ask us for the free trial and we’ll set up a demo. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
July 30 · 42 min
The Skinny Transformer: Squeezing Gen AI into Tiny Devices
The future of artificial intelligence isn't just in massive cloud data centers—it's happening right now on the devices all around us. This insightful panel discussion brings together leading experts from major semiconductor companies and academia to explore how Generative AI is transforming edge computing. What makes this conversation particularly valuable is the panelists' emphasis on practical reality versus future potential. While many assume GenAI requires enormous computing resources, the experts reveal that today's edge hardware—from smartphones to IoT devices—already supports numerous generative applications. The key isn't waiting for more powerful chips but rethinking how we approach model design, quantization, and specialization. Danilo Pau from STMicroelectronics shares a fascinating vision of natural language interaction with everyday objects like thermostats, while Qualcomm's Evgeny Kuznetsov highlights how real-time translation and synthetic data generation deliver immediate productivity benefits. ARM's John Mark Yodis emphasizes that education and framework selection are more significant barriers than hardware limitations. The technical discussion delves into cutting-edge compression techniques, with quantization advancing from Int8 to Int4, Int2, and even Int1 representations. Professor Huanrui Yang explains how foundation models can be specialized and pruned to maintain performance only in domains relevant to specific edge applications. This targeted approach enables capabilities previously thought impossible on resource-constrained devices. Perhaps most exciting is the panel's exploration of unique edge advantages—proximity to data, sensor integration, and specialized hardware—that enable entirely new GenAI applications impossible in the cloud. Through orchestration across heterogeneous computing resources and domain-specific adaptation, the next wave of intelligent systems will distribute AI processing across the compute spectrum. Whether you're a developer looking to deploy GenAI on current hardware, a researcher exploring new compression techniques, or a product manager planning your AI roadmap, this discussion provides crucial insights into what's possible today and where the technology is heading tomorrow. Don't wait for the future—generative AI at the edge is already here. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
July 23 · 12 min
How Microsecond AI Control Transforms Power Systems And Cuts Errors
What if the control loop could think ahead and correct itself before errors take hold? We dive into a practical leap for motors, inverters, and energy storage: ultra-low-latency edge AI that predicts error trajectories at startup and intervenes inside the loop in about 100 microseconds. Instead of piling on sensors and pushing raw signals to the cloud, we work directly from existing operational data, chart the most efficient path, and act locally—then pass only meaningful transients upstream for fleet analytics and predictive maintenance. We start by grounding the challenge: linear systems tolerate classic PID, but nonlinear dynamics create overshoot, oscillation, and costly performance tradeoffs. Throwing bigger processors at the problem hits limits on cost, memory, and thermals. The solution mirrors a lesson from the smartphone era—where dynamic voltage and frequency scaling transformed performance-per-watt—by bringing adaptive optimization to the plant itself. Our Ultra-Edge technology extends PID behavior into nonlinear territory, shrinking speed error during torque steps and tightening control, even on modest 32 MHz platforms, with further gains as faster silicon comes online. From factory floors to the power grid, the implications are big. In motor drives, torque transitions smooth out with fewer current spikes. In utilities and data centers, grid-forming converters coordinate with renewables and battery energy storage to deliver synthetic inertia, riding through disturbances and supporting stability rather than tripping offline. By acting in microseconds, converters offer a stabilizing boost, enabling higher renewable penetration and a more credible path to net zero. Meanwhile, microcontroller-level filtering trims a million samples per second down to high-value events so teams get signal without noise. If you care about real-time control, nonlinear systems, and scaling stability with clean energy, this conversation brings clear examples, measured results, and a roadmap for adoption—from pilots and soft IP to demo platforms and a growing model library. Subscribe, share with a teammate who owns drives or converters, and leave a review with your biggest control pain point so we can tackle it next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
July 16 · 28 min
Edge of Tomorrow: How NXP is Revolutionizing On-Device AI
The AI landscape is transforming rapidly, and NXP Semiconductors is at the forefront of bringing these capabilities where they matter most—directly to edge devices. Alberto Alvarez delivers a compelling overview of how NXP is enabling sophisticated generative AI to run locally on microprocessors, without relying on cloud connectivity. Unlike companies focused on massive cloud-based AI training, NXP targets the critical deployment phase, where privacy, security, and efficiency are paramount. Their approach empowers developers to create AI-enhanced solutions for industrial automation, healthcare, automotive systems, and smart environments that keep sensitive data completely local. The presentation unveils the EAQ GenAI flow—a comprehensive software pipeline that allows developers to fine-tune and optimize large language models for specific applications without exposing proprietary data to third-party servers. This pipeline includes automatic speech recognition (ASR) based on the Whisper architecture, LLM reasoning with LLAMA3, retrieval-augmented generation (RAG) for domain-specific knowledge, and natural text-to-speech synthesis—all running efficiently on NXP's hardware. Most impressively, through a partnership with Kinara, NXP demonstrates a fully edge-based multimodal AI implementation running on their iMX810 Plus platform. This system combines an 8-billion parameter language model with computer vision capabilities, allowing it to analyze images, reason about visual content, and respond to questions—all without sending any data to the cloud. The implementation achieves remarkable performance metrics, generating 6.5 tokens per second with response latency as low as 1.5 seconds for follow-up questions about images. From robots with enhanced reasoning capabilities to medical assistants that can analyze diagnostic imagery, the possibilities for this technology are vast and expanding daily. As NXP continues pushing the boundaries of what's possible at the edge, they're laying the groundwork for the next frontier: agentic AI systems that can perceive, reason, and act autonomously across multiple modalities. Ready to build secure, private AI applications that don't compromise on capability? Explore NXP's resources and start creating tomorrow's intelligent edge solutions today. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
July 9 · 13 min
Hardware-Aware AI, Not Just Bigger Models
What if the obstacle to fast, reliable AI isn’t your dataset or your optimizer—but the silicon under your model? We dig into why performance collapses when architecture and hardware don’t align, and we lay out a clear path to ship models that actually fly on the devices your users own. Starting with the Ferrari-and-hummingbird metaphor, we show how theoretical efficiency—FLOPs, parameters, even TOPS—often fails to predict real-world latency, power, and user experience. We walk through a surprising benchmark: MobileNet V2, small and “efficient,” runs slower than an older ResNet18 on GPUs because depthwise, sequential kernels underutilize parallel hardware. Then we zoom out to hardware selection itself, where NPUs can outperform GPUs despite lower TOPS due to operator support, kernel fusion, and memory behavior. The takeaway is simple: architecture matters only in context, and context means the execution engine, compiler stack, and memory hierarchy that will carry your model in production. From there, we share a four-step framework to become hardware aware: profile on real devices from day one, verify operator compatibility early, automate bottleneck discovery and model selection in CI, and optimize with context using hardware-aware pruning and mixed precision. To show how this works in practice, we unpack our Llama 3.2-1B project on Snapdragon Gen 3, where targeted pruning and precision tuning delivered 31% faster token generation, 25% faster prompt processing, and a 126% faster initialization—all with under 1% accuracy loss. If you build models for the edge, mobile, GPUs, or NPUs, this conversation will help you avoid dead-ends and design for the hardware you actually ship on. Subscribe for more deep dives, share this episode with your team, and leave a review to tell us which hardware you’re targeting next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
July 2 · 15 min
What If A Pair Of Glasses Could Read Intent?
Imagine steering a game with nothing but a blink and a glance. That’s the spark behind our latest build: a noninvasive brain-computer interface that runs entirely on a tiny edge microcontroller, translating eye movements into reliable, real-time commands without a laptop or cloud. We start with the human why. Millions live with neurological conditions that constrain movement but preserve eye control—a narrow channel with huge potential. We compare the promises and trade-offs of invasive BCIs like Neuralink, BrainGate, and Synchron against accessible wearables from Emotiv, Muse, and OpenBCI. The big gap is obvious: people need precise, low-latency control without surgery, high cost, or a desktop tether. Our approach uses electrostatic charge sensing with a glasses-ready electrode layout at the nose bridge and a reference behind the ear, capturing strong ocular signals that are practical for daily wear. From there, we break down the full on-device pipeline. A high-pass filter removes drift, a 50 Hz notch kills power-line noise, and a low-pass smooths the signal so a smaller model can focus on meaningful features. A lightweight Z-score event detector stays always-on and wakes the classifier only when something happens, buffering a 300-sample window at 240 Hz across two channels. The classifier is a tiny 1D CNN—convolution, ReLU, pooling, softmax—clocking about 0.76 ms inference with roughly 18 KB flash and 6 KB RAM. With K-fold cross-validation on nine participants, we see around 90% accuracy for four classes: discard involuntary blinks, map voluntary blinks to “click,” and detect left and right glances. We showcase it with a playful demo: blink to jump over obstacles, glance right to change lanes and collect coins. Beyond the fun, the implications are serious—restoring agency with affordable hardware that works off-grid in real time. We close by outlining what’s next: integrating the sensors into everyday glasses, testing across more users and environments, and adding quick calibration for personalization. If accessible control matters to you—whether for assistive tech, gaming, or new hands-free interfaces—this is a glimpse of what near-future wearables can do. Enjoy the episode? Follow the show, share it with a friend, and leave a quick review to help more listeners discover these conversations. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
June 25 · 9 min
Got Fake Chips? Our AI Doesn't Fall For That
Semiconductor counterfeiting has grown into a $200 billion annual problem threatening the integrity of global electronics supply chains. As both chip shortages and sophisticated counterfeiting techniques persist, traditional detection methods fall short—requiring complex setups, hardware modifications, or extensive data labeling. Two machine learning engineers from Analog Devices' advanced R&D team unveil their elegant solution: an unsupervised learning approach that captures the unique "fingerprints" of authentic chips by analyzing power signatures during memory operations. What makes their method revolutionary is its lightweight footprint (under 60KB) and ability to run directly on standard Cortex-M4 microcontrollers at the edge, requiring no cloud connectivity or specialized equipment. The team shares their methodology for creating a robust dataset of 1,000 secure authenticator chips and developing a convolutional autoencoder architecture that achieved 100% accuracy in distinguishing authentic components from close counterparts. Their model learns the normal reconstruction patterns of legitimate chips, then flags anomalies when encountering counterfeits with distinctly different power signatures. Beyond secure authenticators, this approach proves universally applicable to any semiconductor from which analog fingerprints can be collected. Rather than replacing traditional cryptographic methods, it serves as an additional security layer that remains effective even when encryption keys might be compromised through side-channel attacks. Ready to strengthen your supply chain against increasingly sophisticated counterfeits? Discover how this scalable, software-based solution could be integrated with your existing security infrastructure to provide an additional layer of protection for critical semiconductor components. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
June 18 · 11 min
Smarter AI, Faster Hardware
Your phone, watch, and even your fridge want real-time intelligence—but power and latency won’t tolerate bloated models or generic compute. We walk through a practical path from Python to custom hardware using high-level synthesis, then invite you to prove it in our Efficient Inferencing Hackathon. With a ready-to-run RISC‑V Rocket Core baseline for MNIST, a full Siemens EDA toolchain, and on-demand training, you’ll learn how to cut latency and power while protecting accuracy through precision mapping, parallelism, and smarter dataflow. We start by mapping the compute landscape—CPUs for flexibility, GPUs for throughput, TPUs/NPUs for tensors, and custom FPGA/ASIC designs for peak power-performance-area. From there, we get tactical: use quantization to right-size bit-widths; apply loop pipelining and unrolling to unlock throughput; partition memories and stream between layers to eliminate round-trips; and iterate quickly with HLS directives instead of rewriting RTL. You’ll see how a baseline inference in the millisecond range can be driven far lower with disciplined co-design, and how Catapult HLS, Questa, and PowerPro provide the feedback loop—latency, area, and power—to make confident trade-offs. Participants receive a virtual machine, C kernels for convolution and dense layers, and a step-by-step path from Keras to synthesizable RTL. The goal is simple and demanding: deliver the fastest MNIST implementation that meets accuracy, area, and energy targets. Along the way, the HLS Academy community offers guidance from experts and peers, and winners will be announced at the Edge AI Foundation event in Taipei, with prizes including a 3D printer, an FPGA board, and Bose earbuds. Ready to turn models into efficient silicon? Join the workshop series, claim your VM via the QR code at hls.academy, and use the promo code with two underscores to unlock full access. If this resonates, subscribe, share with a teammate who ships edge AI, and leave a review to help others find the show. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
June 11 · 1 hr 1 min
Village OS: AI For Sustainable Living
What if a neighborhood could think, heal, and feed itself? We sit down with James Ehrlich of Stanford to unpack Village OS, a generative AI platform that designs resilient communities by starting with a simple question: what does the land want? From the urban edge of Riyadh to peri-urban sites worldwide, James shows how geospatial data, climate histories, hydrology, and cultural patterns come together to shape housing, farms, energy, and mobility as one living system. We trace James’s path from early game design and digital effects into the world of eco-villages and permaculture, where taste, health, and connection inspired a research agenda: use technology to serve nature and people. The demo moves from contour maps and fluid dynamics to soil restoration, aquaponics, and agrovoltaics that grow shade crops under solar. Real-time modeling toggles apartments, townhomes, and single-family mixes while projecting costs, returns, and service loads for water, energy, and waste. The punchline is elegant: at the neighborhood scale, waste becomes an asset, powering heat, cooling, and purification while closing loops for food and energy security. Funding and measurement get equal attention. Village OS projects ESG and SDG outcomes and carbon sequestration across decades, offering a transparent view for sovereign wealth funds, pensions, and institutional capital. After groundbreak, the operating layer shifts to edge AI: tinyML sensors and small language models form a digital mycelial network with low latency, low energy, and high autonomy, connected by a thin, privacy-safe cloud channel for cross-site learning. It’s resilience defined by human well-being—lower stress, safer streets, access to fresh food, and spaces for elders and children—backed by systems that can ride out disruption. If you care about sustainable housing, regenerative agriculture, microgrids, and the future of edge AI, this conversation offers a practical, hopeful blueprint. Subscribe, share with a friend who’s into systems thinking, and leave a review with the one feature you’d want in your ideal resilient neighborhood. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters
June 4 · 14 min
When Edge AI Meets Hearing Loss, Access Gets Real
Crowded cafés, clinking plates, and echoey halls make conversations exhausting. We set out to change that by fitting real deep learning into an ear-sized device and proving it can separate speech from noise with almost no delay or battery hit. The result isn’t louder sound; it’s clearer lives and less fatigue. We walk through the full Clara enhancement path: transforming raw mic input into log-mel features, stabilizing for gain shifts, and feeding a 40-layer temporal convolutional recurrent network that predicts a mask to preserve voice and suppress noise. Then we show how a light touch of the original signal brings back space and warmth, avoiding the hollow, underwater audio that turns people off. Along the way, we tackle painful transients—the cutlery and clatter that spike hearing aids—and explain how wide dynamic range compression keeps everything comfortable and intelligible. The heart of the story is edge AI done right. Our SPU001 chip uses unstructured sparsity to skip zero multiplies in hardware, shrinking memory needs and power draw by orders of magnitude. That lets a pruned model with effective 10 MB scale run from just one MB of SRAM while holding algorithmic latency near eight milliseconds and total path time under ten. Metrics back it up: higher scale-invariant signal-to-distortion ratios, better hearing aid speech quality scores, and strong user reports. A rapid partnership with New Sound brought this to market in about three months, and audiologists on a noisy show floor heard the difference immediately. If you care about hearing tech, edge computing, or just making conversations effortless again, this one is for you. Hear how small silicon and smart modeling turn “AI” from a buzzword into a daily benefit. Subscribe for more deep dives on practical edge AI, share with someone who struggles in noisy rooms, and leave a review with your toughest audio environment—we might feature it next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
- Transcript
- Chapters

Showing 1–20 of 27 episodes