Alif Semiconductor, Bosch Sensortec, and Edge Impulse deliver extended sensor functions using machine learning on the edge
By combining hardware acceleration, smart MEMS IMU sensing, and an easy-to-use development platform for machine learning, Alif, Bosch Sensortec, and Edge Impulse have dramatically simplified the creation of edge sensing applications that classify complex motions and identify gestures. Performance of this solution is up to 40 times faster than similar existing solutions.
PLEASANTON, Calif., Nov. 14, 2022 /PRNewswire/ — Alif Semiconductor, supplier of microcontrollers (MCUs) and fusion processors, today announced collaboration with Bosch Sensortec and Edge Impulse to combine hardware and software in reference designs that remove the complexity of creating precision motion-sensing products while drastically increasing performance, lowering power consumption, and establishing airtight security. Applications that benefit include game controllers, predictive maintenance, and monitoring status of industrial machinery and cargo.
Typically, creating and training an artificial intelligence/machine learning (AI/ML) framework that consumes dynamic sensor input, then deploying the model to a hardware platform and optimizing the model on that specific hardware for speed, accuracy, and power efficiency is a very difficult task for developers. Alif and its partners have completely removed this complexity by offering reference designs based on the secure, low-power E3 MCU from Alif’s Ensemble family, Bosch Sensortec’s BMI323, an affordable Inertial Measurement Unit (IMU) with high accuracy and power efficiency, and Edge Impulse’s development platform for machine learning.
The E3 MCU employs dual processing domains that uniquely accelerate machine learning. The E3’s High Efficiency processing domain is meant to be always on to sense the environment, while the E3’s High Performance processing domain wakes as needed to rapidly execute heavy workloads and returns to sleep. In the reference design the BMI323 IMU feeds precision acceleration and angular rate data to the MCU. Edge Impulse’s platform is used to rapidly train an ML model to identify complex continuous gestures such as multiple characters, symbols, and anomalies in repeating complex movement patterns.
The results are astonishing.
In less than one hour a ML model can be created, trained, and deployed to the E3 MCU to detect and identify a complex multi-directional motion pattern and translate it to a symbol. While running, the time to complete the inference operation required to identify the gesture pattern is only 280 μsec.
By comparison, a traditional model trained to identify movement in a single direction deployed on a traditional Cortex-M7 MCU required 2300 μsec for the inference operation to complete, and a traditional Cortex-M4F MCU required 12 msec. These results are 9 times slower and 43 times slower than Alif’s results, and the simplistic nature of the detectable motion is very limiting for real world use-cases
“This is truly an amazing uplift in performance and potential,” said Stefan Finkbeiner, CEO at Bosch Sensortec. “The increase in inference speed directly translates to lower system-level power consumption and could also be used for this kind of solution to operate at significantly higher symbol rates. This opens the door to deploying smart sensors in ways that are not achievable today.”
“Edge Impulse is specifically designed to leverage the power of advanced tools like Alif’s processors and Bosch Sensortec’s sensors, enabling groundbreaking development without the complexity and lead time traditionally needed for ML applications,” said Zach Shelby, CEO and Co-founder of Edge Impulse. “The performance demonstrated with this combination is going to be very attractive to enterprises looking to build the next generation of technology solutions.”
“One of the key drivers behind the architecture of the Ensemble family has been to deliver a higher degree of integrated high-level functions to edge platforms than ever seen before,” said Reza Kazerounian, President and Co-Founder at Alif Semiconductor. “Being able to handle this performance level of machine learning workloads within the power and price budget of an MCU is unmatched in the industry today.”
About Bosch Sensortec:
Bosch Sensortec GmbH, a fully owned subsidiary of Robert Bosch GmbH, develops and markets a wide portfolio of microelectromechanical systems (MEMS) sensors and solutions tailored for smartphones, tablets, wearables and hearables, AR/VR devices, drones, robots, smart home and IoT (Internet of Things) applications. The product portfolio includes 3-axis accelerometers, gyroscopes and magnetometers, integrated 6- and 9-axis sensors, smart sensors, barometric pressure sensors, humidity sensors, gas sensors, optical microsystems and comprehensive software. Since its foundation in 2005, Bosch Sensortec has emerged as the MEMS technology leader in the markets it addresses. Bosch has been both a pioneer and a global market leader in the MEMS sensor segment since 1995 and has, to date, sold more than 15 billion MEMS sensors. For more information, please visit www.bosch-sensortec.com.
About Edge Impulse:
Edge Impulse is the leading machine learning platform, enabling all enterprises to build smarter edge products. Their technology empowers developers to bring more ML products to market faster, and helps enterprise teams rapidly develop industry-specific solutions in weeks instead of years. The Edge Impulse platform provides powerful automation and low-code capabilities to make it easier to build valuable datasets and develop advanced ML with streaming data. With over 40,000 developers, and partnerships with the top silicon vendors, Edge Impulse offers a seamless integration experience to validate and deploy with confidence across the largest hardware ecosystem. To learn more, visit edgeimpulse.com.