Physical Sciences and Mathematics Commons^™

Rrto: A High-Performance Transparent Offloading System For Model Inference In Mobile Edge Computing, Zekai Sun, Xiuxian Guan, Zheng Lin, Yuhao Qing, Haoze Song, Zihan Fang, Zhe Chen, Fangming Liu, Heming Cui, Wei Ni, Jun Luo

Research outputs 2022 to 2026

Deploying Machine Learning (ML) applications on resource-constrained mobile devices remains challenging due to limited computational resources and poor platform compatibility. While Mobile Edge Computing (MEC) offers an offloading-based inference paradigm using GPU servers, existing approaches can be divided into non-transparent and transparent methods, with the former necessitating source-code modifications. Non-transparent offloading achieves high performance but requires intrusive code changes, limiting compatibility with diverse applications. Transparent offloading, in contrast, offers wide compatibility but introduces two challenges: performance degradation under MEC's low and fluctuating bandwidth, where per-operator remote procedure calls (RPCs) inflate end-to-end latency and energy consumption; and black-box logic reconstruction, which …