Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

AI-based lane recognition for micromobility users using neural network compression techniques and a low-spec microcontroller unit

Kaundanya, Chinmaya and Little, Suzanne orcid logoORCID: 0000-0003-3281-3471 (2023) AI-based lane recognition for micromobility users using neural network compression techniques and a low-spec microcontroller unit. In: TinyML EMEA Innovation Forum Conference 2023, 26-28 June 2023, Amsterdam, Netherlands.

Abstract
The rise of Micromobility as a primary mode of transportation across the globe has brought about the need for effective rules and regulations governing the usage of E-scooters and E-bikes. As such, we have developed an AI-based solution of ‘Lane Recognition’ to address this problem. Our solution utilises AI Computer Vision technology to identify whether a Micromobility user is using the designated lane or not. To achieve this, we have developed and deployed a Convolutional Neural Network (CNN) model to an extremely low-spec, power-efficient camera-integrated Microcontroller Unit. The training dataset includes open-source images from the internet and frames captured with our camera module from multiple major cities worldwide. We developed a multiclass classification Neural Network model, small yet robust enough to be fitted into the Microcontroller Unit with just 2 MB of each SRAM and Flash memory by utilising Neural Network unstructured pruning and full-integer 8-bit model quantisation techniques. We share the results of a short demo performed on the streets, which proves the efficacy of our lane recognition solution. We conducted various experiments with a Microcontroller simulation environment. The experiments were performed on a small subset of the original dataset using a simple CNN model architecture and different input image resolutions and their colour modes such as 160X160 Grayscale/RGB and 96X96 Grayscale/RGB. The purpose of these experiments was to compare Microcontrollers with different colour depth cameras, Static RAMs, storage and computing power and decide the optimal one according to the use case. The empirical results showed 84.85% Test Accuracy with 160X160 RGB images which was 7.34% more than 160X160 Grayscale and 11.85% more than using 96X96 Grayscale images with approximately 2.3 seconds of a tradeoff in model inference time using high-resolution RGB images over low-resolution Grayscale. This led us to the conclusion that better image classification model performance can be achieved with RGB colour mode images. Moving forward, we are working on designing a better model architecture by incorporating a fusion of channel shuffle and spatial attention mechanisms. We believe that this will further improve the accuracy and efficiency of our lane recognition solution, which in turn, will enable us to better manage the riding behaviour of Micromobility users.
Metadata
Item Type:Conference or Workshop Item (Poster)
Event Type:Other
Refereed:Yes
Subjects:Computer Science > Artificial intelligence
Computer Science > Image processing
Computer Science > Machine learning
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Institutes and Centres > INSIGHT Centre for Data Analytics
Publisher:CMS
Official URL:https://cms.tinyml.org/wp-content/uploads/ew2023/C...
Copyright Information:© 2023 The Authors.
Funders:Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289_2, European Regional Development Fund
ID Code:28327
Deposited On:23 Jun 2023 09:37 by Chinmaya Kaundanya . Last Modified 16 Nov 2023 16:26
Documents

Full text available as:

[thumbnail of TinyML_EMEA_2023_Abstract.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial 4.0
57kB
[thumbnail of Chinmaya_Kaundanya_poster.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial 4.0
3MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record