Edge AI

How can the advantages of deep learning be brought to the world of embedded IoT devices? The project investigates several core challenges in embedded and mobile deep learning, and develops solutions that demonstrate the feasibility of deploying IoT applications in resource-limited environments while exploiting effective, efficient, and reliable deep learning and inference models.

Acknowledgement: Funded by NSF, ARL

Example:

The video shows a 10x efficiency gain in dividing neural network computations between a Raspberry Pi (connected to web camera) and an edge server using compressive offloading.

References

  • Deep Compressive Offloading: Speeding Up Neural Network Inference by Trading Edge Computation for Network Latency
    Shuochao Yao, Jinyang Li, Dongxin Liu, Tianshi Wang, Shengzhong Liu, Huajie Shao, Tarek Abdelzaher
    In Proc. 18th ACM Conference on Embedded Networked Sensor Systems (SenSys), Japan (Online), November 2020.
    Best Paper Award.
  • On Removing Algorithmic Priority Inversion from Mission-critical Machine Inference Pipelines
    Shengzhong Liu, Shuochao Yao, Xinzhe Fu, Rohan Tabish, Simon Yu, Ayoosh Bansal, Heechul Yun, Lui Sha and Tarek Abdelzaher
    In Proc. IEEE Real-time Systems Symposium (RTSS), Houston, TX (Online), December 2020.
    Best Paper Award.
  • Handling Missing Sensors in Topology-aware IoT Applications with Gated Graph Neural Networks
    Shengzhong Liu, Shuochao Yao, Yifei Huang, Dongxin Liu, Huajie Shao, Yiran Zhao, Jinyang Li, Tianshi Wang, Ruijie Wang, Chaoqi Yang, Tarek Abdelzaher
    The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2020 (accepted).
  • New Frontiers in IoT: Networking, Systems, Reliability, and Security Challenges
    Saurabh Bagchi, Tarek F Abdelzaher, Ramesh Govindan, Prashant Shenoy, Akanksha Atrey, Pradipta Ghosh, Ran Xu
    IEEE Internet of Things Journal, 2020.
  • GlobalFusion: A Global Attentional Deep Learning Framework for Multisensor Information Fusion
    Shengzhong Liu, Shuochao Yao,Jinyang Li, Dongxin Liu, Tianshi Wang, Huajie Shao, Tarek Abdelzaher
    The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), also presented at UbiComp Cancun, Mexico, September 2020.
  • Scheduling Real-time Deep Learning Services as Imprecise Computations
    Shuochao Yao, Yifan Hao, Yiran Zhao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Tianshi Wang, Jinyang Li and Tarek Abdelzaher
    In Proc. IEEE International Conference on Embedded and Real-time Computing Systems and Applications (RTCSA), South Korea, August 2020.
  • ControlVAE: Controllable Variational Autoencoder
    Huajie Shao, Shuochao Yao, Dachun Sun, Aston Zhang, Shengzhong Liu, Dongxin Liu, Jun Wang, Tarek Abdelzaher
    In Proc. International Conference on Machine Learning (ICML), July 2020.
  • "Five Challenges in Cloud-Enabled Intelligence and Control
    Tarek Abdelzaher, Yifan Hao, Kasthuri Jayarajah, Archan Misra, Per Skarin, Shuochao Yao, Dulanga Weerakoon, Karl-Erik Arzen
    ACM Trans. on Internet Technology, Vol. 3, Issue 1, February 2020.
  • Eugene: Towards Deep Intelligence as a Service
    Tarek Abdelzaher, Shuochao Yao, Yifan Hao, Yiran Zhao, Ailing Piao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Shaohan Hu, Dulanga Weerakoon, Kasthuri Jayarajah and Archan Misra
    In Proc. 39th IEEE International Conference on Distributed Computing Systems (ICDCS), Dallas, Texas, July 2019.
  • Edge-assisted Detection and Summarization of Key Global Events from Distributed Crowd-sensed Data
    Abdelrahman Fahim, Ajaya Neupane, Evangelos Papalexakis, Lance Kaplan, Srikanth V. Krishnamurthy, and Tarek Abdelzaher
    In Proc. IEEE International Conference on Cloud Engineering (IC2E), Prague, Czech Republic, June 2019.
  • STFNets: Learning Sensing Signals from the Time-Frequency Perspective with Short-Time Fourier Neural Networks
    Shuochao Yao, Ailing Piao, Wenjun Jiang, Yiran Zhao, Huajie Shao, Shengzhong Liu, Dongxin Liu, Jinyang Li, Tianshi Wang, Shaohan Hu, Lu Su, Jiawei Han and Tarek Abdelzaher
    In Proc. The Web Conference (WWW), San Francisco, CA, May 2019.
  • SADeepSense: Self-Attention Deep Learning Framework for Heterogeneous On-Device Sensors in Internet of Things Applications
    Shuochao Yao, Yiran Zhao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Yifan Hao, Ailing Piao, Shaohan Hu, Lu Su, Tarek Abdelzaher
    In Proc. IEEE Infocom, Paris, France, April 2019.
  • Dependable Machine Intelligence at the Tactical Edge
    Archan Misra, Kasthuri Jayarajah, Dulanga Weerakoon, Shuochao Yao, Tarek Abdelzaher
    In Proc. SPIE Defense and Commercial Sensing, Baltimore, MD, April 2019.
  • Deep Learning for the Internet of Battlefield Things
    Tarek Abdelzaher
    In Proc. NATO SET-262 Specialists' Meeting on Artificial Intelligence for Military Multisensor Fusion Engines, Budapest, Hungary, November 2018.
  • FastDeepIoT: Towards Understanding and Optimizing Neural Network Execution Time on Mobile and Embedded Devices
    Shuochao Yao, Yiran Zhao, Huajie Shao, Shengzhong Liu, Dongxin Liu, Lu Su, Tarek Abdelzaher
    In Proc. 16th ACM Conference on Embedded Networked Sensor Systems (SenSys), Shenzhen, China, November 2018.
  • SenseGAN: Enabling Deep Learning for Internet of Things with a Semi-Supervised Framework
    Shuochao Yao, Yiran Zhao, Huajie Shao, Chao Zhang, Aston Zhang, Shaohan Hu, Dongxin Liu, Shengzhong Liu, Lu Su, Tarek Abdelzaher
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), September 2018. (Also appears in UbiComp '18, Singapore, October 2018.)
  • ApDeepSense: Deep Learning Uncertainty Estimation Without the Pain for IoT Applications
    Shuochao Yao, Yiran Zhao, Huajie Shao, Chao Zhang, Aston Zhang, Dongxin Liu, Shengzhong Liu, Lu Su and Tarek Abdelzaher
    In Proc. IEEE International Conference on Distibuted Computing Systems (ICDCS), Vienna, Austria, July 2018.
  • Deep Learning for the Internet of Things
    Shuochao Yao, Yiran Zhao, Aston Zhang, Shaohan Hu, Huajie Shao, Chao Zhang, Lu Su, Tarek Abdelzaher
    IEEE Computer, Vol. 51, No. 5, May 2018.
  • RDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimation
    Shuochao Yao, Yiran Zhao, Huajie Shao, Aston Zhang, Chao Zhang, Shen Li, and Tarek Abdelzaher
    ACM IMWUT (formerly UbiComp), April 2018.
  • DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework
    Shuochao Yao, Yiran Zhao, Aston Zhang, Lu Su, and Tarek Abdelzaher
    In Proc. 15th ACM Conference on Embedded Networked Sensor Systems (ACM SenSys), Delft, The Netherlands, November 2017.
  • DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
    Shuochao Yao, Shaohan Hu, Yiran Zhao, Aston Zhang, Tarek Abdelzaher
    In Proc. International World Wide Web Conference (WWW), Perth, Australia, April 2017.