Edge AI
How can the advantages of deep learning be brought to the world of embedded IoT devices? The project investigates several core challenges in embedded and mobile deep learning, and develops solutions that demonstrate the feasibility of deploying IoT applications in resource-limited environments while exploiting effective, efficient, and reliable deep learning and inference models.
Acknowledgement: Funded by NSF, ARL
Example:
The video shows a 10x efficiency gain in dividing neural network computations between a Raspberry Pi (connected to web camera) and an edge server using compressive offloading.
References
-
Deep Compressive Offloading: Speeding Up Neural Network Inference by Trading Edge Computation for Network Latency
Shuochao Yao, Jinyang Li, Dongxin Liu, Tianshi Wang, Shengzhong Liu, Huajie Shao, Tarek Abdelzaher
In Proc. 18th ACM Conference on Embedded Networked Sensor Systems (SenSys), Japan (Online), November 2020.
Best Paper Award. -
On Removing Algorithmic Priority Inversion from Mission-critical Machine Inference Pipelines
Shengzhong Liu, Shuochao Yao, Xinzhe Fu, Rohan Tabish, Simon Yu, Ayoosh Bansal, Heechul Yun, Lui Sha and Tarek Abdelzaher
In Proc. IEEE Real-time Systems Symposium (RTSS), Houston, TX (Online), December 2020.
Best Paper Award. -
Handling Missing Sensors in Topology-aware IoT Applications with Gated Graph Neural Networks
Shengzhong Liu, Shuochao Yao, Yifei Huang, Dongxin Liu, Huajie Shao, Yiran Zhao, Jinyang Li, Tianshi Wang, Ruijie Wang, Chaoqi Yang, Tarek Abdelzaher
The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2020 (accepted). -
New Frontiers in IoT: Networking, Systems, Reliability, and Security Challenges
Saurabh Bagchi, Tarek F Abdelzaher, Ramesh Govindan, Prashant Shenoy, Akanksha Atrey, Pradipta Ghosh, Ran Xu
IEEE Internet of Things Journal, 2020. -
GlobalFusion: A Global Attentional Deep Learning Framework for Multisensor Information Fusion
Shengzhong Liu, Shuochao Yao,Jinyang Li, Dongxin Liu, Tianshi Wang, Huajie Shao, Tarek Abdelzaher
The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), also presented at UbiComp Cancun, Mexico, September 2020. -
Scheduling Real-time Deep Learning Services as Imprecise Computations
Shuochao Yao, Yifan Hao, Yiran Zhao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Tianshi Wang, Jinyang Li and Tarek Abdelzaher
In Proc. IEEE International Conference on Embedded and Real-time Computing Systems and Applications (RTCSA), South Korea, August 2020. -
ControlVAE: Controllable Variational Autoencoder
Huajie Shao, Shuochao Yao, Dachun Sun, Aston Zhang, Shengzhong Liu, Dongxin Liu, Jun Wang, Tarek Abdelzaher
In Proc. International Conference on Machine Learning (ICML), July 2020. -
"Five Challenges in Cloud-Enabled Intelligence and Control
Tarek Abdelzaher, Yifan Hao, Kasthuri Jayarajah, Archan Misra, Per Skarin, Shuochao Yao, Dulanga Weerakoon, Karl-Erik Arzen
ACM Trans. on Internet Technology, Vol. 3, Issue 1, February 2020. -
Eugene: Towards Deep Intelligence as a Service
Tarek Abdelzaher, Shuochao Yao, Yifan Hao, Yiran Zhao, Ailing Piao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Shaohan Hu, Dulanga Weerakoon, Kasthuri Jayarajah and Archan Misra
In Proc. 39th IEEE International Conference on Distributed Computing Systems (ICDCS), Dallas, Texas, July 2019. -
Edge-assisted Detection and Summarization of Key Global Events from Distributed Crowd-sensed Data
Abdelrahman Fahim, Ajaya Neupane, Evangelos Papalexakis, Lance Kaplan, Srikanth V. Krishnamurthy, and Tarek Abdelzaher
In Proc. IEEE International Conference on Cloud Engineering (IC2E), Prague, Czech Republic, June 2019. -
STFNets: Learning Sensing Signals from the Time-Frequency Perspective with Short-Time Fourier Neural Networks
Shuochao Yao, Ailing Piao, Wenjun Jiang, Yiran Zhao, Huajie Shao, Shengzhong Liu, Dongxin Liu, Jinyang Li, Tianshi Wang, Shaohan Hu, Lu Su, Jiawei Han and Tarek Abdelzaher
In Proc. The Web Conference (WWW), San Francisco, CA, May 2019. -
SADeepSense: Self-Attention Deep Learning Framework for Heterogeneous On-Device Sensors in Internet of Things Applications
Shuochao Yao, Yiran Zhao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Yifan Hao, Ailing Piao, Shaohan Hu, Lu Su, Tarek Abdelzaher
In Proc. IEEE Infocom, Paris, France, April 2019. -
Dependable Machine Intelligence at the Tactical Edge
Archan Misra, Kasthuri Jayarajah, Dulanga Weerakoon, Shuochao Yao, Tarek Abdelzaher
In Proc. SPIE Defense and Commercial Sensing, Baltimore, MD, April 2019. -
Deep Learning for the Internet of Battlefield Things
Tarek Abdelzaher
In Proc. NATO SET-262 Specialists' Meeting on Artificial Intelligence for Military Multisensor Fusion Engines, Budapest, Hungary, November 2018. -
FastDeepIoT: Towards Understanding and Optimizing Neural Network Execution Time on Mobile and Embedded Devices
Shuochao Yao, Yiran Zhao, Huajie Shao, Shengzhong Liu, Dongxin Liu, Lu Su, Tarek Abdelzaher
In Proc. 16th ACM Conference on Embedded Networked Sensor Systems (SenSys), Shenzhen, China, November 2018. -
SenseGAN: Enabling Deep Learning for Internet of Things with a Semi-Supervised Framework
Shuochao Yao, Yiran Zhao, Huajie Shao, Chao Zhang, Aston Zhang, Shaohan Hu, Dongxin Liu, Shengzhong Liu, Lu Su, Tarek Abdelzaher
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), September 2018. (Also appears in UbiComp '18, Singapore, October 2018.) -
ApDeepSense: Deep Learning Uncertainty Estimation Without the Pain for IoT Applications
Shuochao Yao, Yiran Zhao, Huajie Shao, Chao Zhang, Aston Zhang, Dongxin Liu, Shengzhong Liu, Lu Su and Tarek Abdelzaher
In Proc. IEEE International Conference on Distibuted Computing Systems (ICDCS), Vienna, Austria, July 2018. -
Deep Learning for the Internet of Things
Shuochao Yao, Yiran Zhao, Aston Zhang, Shaohan Hu, Huajie Shao, Chao Zhang, Lu Su, Tarek Abdelzaher
IEEE Computer, Vol. 51, No. 5, May 2018. -
RDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimation
Shuochao Yao, Yiran Zhao, Huajie Shao, Aston Zhang, Chao Zhang, Shen Li, and Tarek Abdelzaher
ACM IMWUT (formerly UbiComp), April 2018. -
DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework
Shuochao Yao, Yiran Zhao, Aston Zhang, Lu Su, and Tarek Abdelzaher
In Proc. 15th ACM Conference on Embedded Networked Sensor Systems (ACM SenSys), Delft, The Netherlands, November 2017. -
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Shuochao Yao, Shaohan Hu, Yiran Zhao, Aston Zhang, Tarek Abdelzaher
In Proc. International World Wide Web Conference (WWW), Perth, Australia, April 2017.