Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Enabling machine learning on the edge using SRAM conserving efficient neural networks execution approach

Sudharsan, Bharath orcid logoORCID: 0000-0001-5906-113X, Patel, Pankesh orcid logoORCID: 0000-0001-5973-4197, Breslin, John G. orcid logoORCID: 0000-0001-5790-050X and Ali, Muhammad Intizar orcid logoORCID: 0000-0002-0674-2131 (2021) Enabling machine learning on the edge using SRAM conserving efficient neural networks execution approach. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases ECML PKDD 2021, 13-17 Sept 2021, Bilbao, Spain. ISBN 978-3-030-86516-0

Abstract
Edge analytics refers to the application of data analytics and Machine Learning (ML) algorithms on IoT devices. The concept of edge analytics is gaining popularity due to its ability to perform AI-based analytics at the device level, enabling autonomous decision-making, without depending on the cloud. However, the majority of Internet of Things (IoT) devices are embedded systems with a low-cost microcontroller unit (MCU) or a small CPU as its brain, which often are incapable of handling complex ML algorithms. In this paper, we propose an approach for the efficient execution of already deeply compressed, large neural networks (NNs) on tiny IoT devices. After optimizing NNs using state-of-the-art deep model compression methods, when the resultant models are executed by MCUs or small CPUs using the model execution sequence produced by our approach, higher levels of conserved SRAM can be achieved. During the evaluation for nine popular models, when comparing the default NN execution sequence with the sequence produced by our approach, we found that 1.61-38.06% less SRAM was used to produce inference results, the inference time was reduced by 0.28-4.9 ms, and energy consumption was reduced by 4-84 mJ. Despite achieving such high conserved levels of SRAM, our method 100% preserved the accuracy, F1 score, etc. (model performance).
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Edge AI; Resource-Constrained Devices; Intelligent Microcontrollers; SRAM Conservation; Offline Inference.
Subjects:Computer Science > Artificial intelligence
Computer Science > Machine learning
Engineering > Electronics
Engineering > Electronic engineering
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Published in: Machine Learning and Knowledge Discovery in Databases. Applied Data Science Track. ECML PKDD 2021. Lecture Notes in Computer Science 12979. Springer. ISBN 978-3-030-86516-0
Publisher:Springer
Official URL:https://doi.org/10.1007/978-3-030-86517-7_2
Copyright Information:© 2021 Springer
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:26953
Deposited On:01 Apr 2022 12:19 by Muhammad Intizar Ali . Last Modified 18 Jan 2023 12:30
Documents

Full text available as:

[thumbnail of ECMLPKDD_21_paper_1007.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
1MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record