2021-12-20: Machine Learning on Mobile and Embedded Devices
What is TensorFlow and TensorFlow Lite? TensorFlow is an open-source machine learning library widely adopted among deep learning practitioners and researchers. The library provides functionalities for developing, training, and testing machine learning models on various devices through different Application Programmable Interfaces (APIs). Among them are the Python API and the JavaScript API . Despite these APIs being able to meet on-device, cloud, and web machine learning requirements, they do not support edge computing devices such as mobile and embedded devices. To address the issue, TensorFlow introduced TensorFlow Lite (TFLite), a lightweight solution for mobile and embedded systems. This blog post will briefly discuss how TFLite integrates into a development workflow and selected vital concepts in TF Lite. Then we will apply some of the ideas to a simple model to observe their impact. Finally, we will discuss how we ( NIRDSLab ) use TF Lite and te...