Cooperative vehicles-assisted task offloading in vehicular networks
Corresponding Author
Yaping Cui
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Correspondence
Yaping Cui, School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.
Email: [email protected]
Search for more papers by this authorLijuan Du
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorPeng He
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorDapeng Wu
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorRuyan Wang
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorCorresponding Author
Yaping Cui
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Correspondence
Yaping Cui, School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.
Email: [email protected]
Search for more papers by this authorLijuan Du
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorPeng He
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorDapeng Wu
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorRuyan Wang
School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, China
Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, China
Search for more papers by this authorFunding information: Natural Science Foundation of China, 61801065; 61771082; 61871062; 61901070; U20A20157; Science and Technology Research Program of Chongqing Municipal Education Commission, KJQN202000603; KJQN201900611; Natural Science Foundation of Chongqing, cstc2020jcyj-zdxmX0024; University Innovation Research Group of Chongqing, CXQT20017
Abstract
Cooperative task offloading emerges a well-received paradigm for mobile applications that are sensitive to computational power, while dynamic and real-time characteristics of vehicular networks makes it challenging to guarantee the low delay requirements of vehicular computation offloading. Existing researches cannot satisfy the real-time computation requests due to the sparse deployment of infrastructure constructions and constrained computing resources of edge servers. Motivated by these, we consider the idea of distributed vehicle-to-vehicle task offloading, which makes vehicles act as cooperative nodes to execute tasks. In this paper, we utilize parallel computing of multi-vehicle cooperation, to provide low-delay computation services without exceeding the energy constraint. Furthermore, a cooperative vehicles assisted task offloading strategy based on double deep Q-network is proposed to obtain the optimal task offloading ratio after selecting cooperative vehicles. Simulation results indicate that our proposed strategy can effectively decrease the total system delay. For example, compared with the local execution strategy, the total system delay of the proposed strategy can be reduced by 69.4% on average.
Open Research
DATA AVAILABILITY STATEMENT
The data that support the findings of this study are available from the corresponding author upon reasonable request.
REFERENCES
- 1Shi J, Du J, Wang J, Wang J, Yuan J. Priority-aware task offloading in vehicular fog computing based on deep reinforcement learning. IEEE Trans Veh Technol. 2020; 69(12): 16067-16081.
- 2Wang X, Wei X, Wang L. A deep learning based energy-efficient computational offloading method in internet of vehicles. China Commun. 2019; 16(3): 81-91.
- 3Cardellini V, De Nitto Personé V, Di Valerio V, et al. A game-theoretic approach to computation offloading in mobile cloud computing. Math Program. 2016; 157(2): 421-449.
- 4Wang J, Lv T, Huang P, Mathiopoulos PT. Mobility-aware partial computation offloading in vehicular networks: a deep reinforcement learning based scheme. China Commun. 2020; 17: 31-49.
- 5Ni L, Zhang J, Jiang C, Yan C, Yu K. Resource allocation strategy in fog computing based on priced timed petri nets. IEEE Internet Things J. 2017; 4(5): 1216-1228.
- 6Zhou Z, Liao H, Zhao X, Ai B, Guizani M. Reliable task offloading for vehicular fog computing under information asymmetry and information uncertainty. IEEE Trans Veh Technol. 2019; 68(9): 8322-8335.
- 7Mao Y, You C, Zhang J, Huang K, Letaief KB. A survey on mobile edge computing: the communication perspective. IEEE Commun Surv Tutor. 2017; 19(4): 2322-2358.
- 8Nguyen K, Drew S, Huang C, Zhou J. Collaborative container-based parked vehicle edge computing framework for online task offloading. Paper presented at: Proceedings of the 2020 IEEE 9th International Conference on Cloud Networking; 2020:1-6; IEEE: Piscataway, NJ, USA.
- 9Sakic EE, Sardis F, Guck JW, Kellerer W. Towards adaptive state consistency in distributed SDN control plane. Paper presented at: Proceedings of the 2017 IEEE International Conference on Communications (ICC); 2017:1-7; IEEE: Paris, France. doi:10.1109/ICC.2017.7997164
- 10Li H, Dong M, Ota K. Control plane optimization in software-defined vehicular ad hoc networks. IEEE Trans Veh Technol. 2019; 65(10): 7895-7904.
- 11Du J, Yu FR, Chu X, Feng J, Lu G. Computation offloading and resource allocation in vehicular networks based on dual-side cost minimization. IEEE Trans Veh Technol. 2019; 68(2): 1079-1092.
- 12Zhang H, Wang Z, Liu K. V2X offloading and resource allocation in SDN-assisted MEC-based vehicular networks. China Commun. 2020; 17(5): 266-283.
- 13Sun J, Gu Q, Zheng T, Dong P, Valera A, Qin Y. Joint optimization of computation offloading and task scheduling in vehicular edge computing networks. IEEE Access. 2020; 8: 10466-10477.
- 14Li X, Dang Y, Aazam M, Peng X, Chen T, Chen C. Energy-efficient computation offloading in vehicular edge cloud computing. IEEE Access. 2020; 8: 37632-37644.
- 15Abouaomar A, Cherkaoui S, Mlika Z, Kobbane A. Resource provisioning in edge computing for latency sensitive applications. IEEE Internet Things J. 2021; 1.
- 16Hwang RH, Islam MM, Tanvir MA, Hossain MS, Lin YD. Communication and computation offloading for 5G V2X: modeling and optimization. Paper presented at: Proceedings of the 2020 IEEE Global Communications Conference (GLOBECOM 2020); 2020:1-6; IEEE: Taipei, Taiwan, China.
- 17Feng L, Li W, Lin Y, Zhu L, Guo S, Zhen Z. Joint computation offloading and URLLC resource allocation for collaborative MEC assisted cellular-V2X networks. IEEE Access. 2020; 8: 24914-24926.
- 18Wang Y, Lang P, Tian D, et al. A game-based computation offloading method in vehicular multiaccess edge computing networks. IEEE Internet Things J. 2020; 4987-4996.
- 19Meireles R, Rodrigues A, Stanciu A, Aguiar A, Steenkiste P. Exploring Wi-Fi network diversity for vehicle-to-infrastructure communication. Paper presented at: Proceedings of the 2020 IEEE Vehicular Networking Conference (VNC); 2020:1-8; IEEE: New York, NY, USA.
- 20Zhao H, Zhu Q, Chen Y, Zhu Y. A research of task-offloading algorithm for distributed vehicles. Paper presented at: Proceedings of the 2020 IEEE International Conference on Communications Workshops; 2020:1-5; IEEE: Dublin, Ireland.
- 21Ma C, Zhu J, Liu M, Zhao H, Liu N, Zou X. Parking edge computing: parked vehicle assisted task offloading for urban VANETs. IEEE Internet Things J. 2021; 8(11): 9344-9358.
- 22Gong M, Ahn S. Computation offloading-based task scheduling in the vehicular communication environment for computation-intensive vehicular tasks. Paper presented at: Proceedings of the 2020 International Conference on Artificial Intelligence in Information and Communication; 2020; IEEE: Fukuoka, Japan.
- 23Wu Y, Wu J, Chen L, Zhou G, Yan J. Fog computing model and efficient algorithms for directional vehicle mobility in vehicular network. IEEE Trans Intell Transp Syst. 2021; 22(5): 2599-2614.
- 24Chen C, Chen L, Liu L, et al. Delay-optimized V2V-based computation offloading in urban vehicular edge computing and networks. IEEE Access. 2020; 8: 18863-18873.
- 25Sun Y, Guo X, Song J, et al. Adaptive learning-based task offloading for vehicular edge computing systems. IEEE Trans Veh Technol. 2019; 68(4): 3061-3074.
- 26Zhang R, Cheng P, Chen Z, Liu S, Li Y, Vucetic B. Online learning enabled task offloading for vehicular edge computing. IEEE Wirel Commun Lett. 2020; 9(7): 928-932.
- 27Wu Q, Liu H, Wang R, Fan P, Fan Q, Li Z. Delay-sensitive task offloading in the 802.11p-based vehicular fog computing systems. IEEE Internet Things J. 2020; 7(1): 773-785.
- 28Raja G, Ganapathisubramaniyan A, Anbalagan S, Baskaran SBM, Raja K, Bashir AK. Intelligent reward-based data offloading in next-generation vehicular networks. IEEE Internet Things J. 2020; 7(5): 3747-3785.
- 29Ning Z, Dong P, Wang X, Rodrigues JJPC, Xia F. Deep reinforcement learning for vehicular edge computing: an intelligent offloading system. ACM Trans Intell Syst Technol. 2019; 10(6): 1-24.
- 30Zhan W, Luo C, Wang J, Wang C, Min G, Duan H, Zhu Q. Deep-reinforcement-learning-based offloading scheduling for vehicular edge computing. IEEE Internet Things J. 2020; 7(6): 5449-5465.
- 31He X, Lu H, Du M, Mao Y, Wang K. QoE-based task offloading with deep reinforcement learning in edge-enabled internet of vehicles. IEEE Trans Intell Transp Syst. 2021; 22(4): 2252-2261.
- 32Zhang W, Wen Y, Guan K, Kilper D, Luo H, Wu DO. Energy-optimal mobile cloud computing under stochastic wireless channel. IEEE Trans Wirel Commun. 2013; 12(9): 4569-4581.
- 33Zhang J, Hu X, Ning Z, et al. Energy-latency tradeoff for energy-aware offloading in mobile edge computing networks. IEEE Internet Things J. 2018; 5(4): 2633-2645.
- 34Nasir YS, Guo D. Deep reinforcement learning for distributed dynamic power allocation in wireless networks. IEEE J Select Areas Commun. 2019; 37(10): 2239-2250.
- 35Liang L, Ye H, Li GY. Spectrum sharing in vehicular networks based on multi-agent reinforcement learning. IEEE J Select Areas Commun. 2019; 37(10): 2282-2292.
- 36Hasselt HV, Guez A, Silver D. Deep reinforcement learning with double q-learning. Proc. AAAI Conf. Artif. Intell. 2016; 30(1): 2094-2100.
- 37Pekka K. WINNER II channel models part II radio channel measurement and analysis results, IST-4-027756, WINNER II D1.1.2, v1.0; September 2007.
