Dynamic Resource Allocation in Industrial Internet of Things (IIoT) using Machine Learning Approaches

Article Sidebar

PDF
Published: Oct 7, 2023
DOI: https://doi.org/10.17762/ijritcc.v11i10s.7691
Keywords:
Internet of Things (IoT), Industrial IoT, Task Offloading, Resource Allocation, Optimal, Machine Learning

Main Article Content

Pankaj Singh Sisodiya
Research Scholar, Department of Computer Science & Engineering, Madhyanchal Professional University, Bhopal, India
Vijay Bhandari
Associate Professor, Department of Computer Science & Engineering, Madhyanchal Professional University, Bhopal, India

Abstract

In today's era of rapid smart equipment development and the Industrial Revolution, the application scenarios for Internet of Things (IoT) technology are expanding widely. The combination of IoT and industrial manufacturing systems gives rise to the Industrial IoT (IIoT). However, due to resource limitations such as computational units and battery capacity in IIoT devices (IIEs), it is crucial to execute computationally intensive tasks efficiently. The dynamic and continuous generation of tasks poses a significant challenge to managing the limited resources in the IIoT environment. This paper proposes a collaborative approach for optimal offloading and resource allocation of highly sensitive industrial IoT tasks. Firstly, the computation-intensive IIoT tasks are transformed into a directed acyclic graph. Then, task offloading is treated as an optimization problem, taking into account the models of processor resources and energy consumption for the offloading scheme. Lastly, a dynamic resource allocation approach is introduced to allocate computing resources to the edge-cloud server for the execution of computation-intensive tasks. The proposed joint offloading and scheduling (JOS) algorithm creates its DAG and prepare a offloading queue. This queue is designed using collaborative q-learning based reinforcement learning and allocate optimal resources to the JOS for execution of tasks present in offloading queue. For this machine learning approach is used to predict and allocate resources. The paper compares conventional and machine learning-based resource allocation methods. The machine learning approach performs better in terms of response time, delay, and energy consumption. The proposed algorithm shows that energy usage increases with task size, and response time increases with the number of users. Among the algorithms compared, JOS has the lowest waiting time, followed by DQN, while Q-learning performs the worst. Based on these findings, the paper recommends adopting the machine learning approach, specifically the JOS algorithm, for joint offloading and resource allocation.

Article Details

How to Cite
Sisodiya, P. S. ., & Bhandari, V. . (2023). Dynamic Resource Allocation in Industrial Internet of Things (IIoT) using Machine Learning Approaches. International Journal on Recent and Innovation Trends in Computing and Communication, 11(10s), 530–540. https://doi.org/10.17762/ijritcc.v11i10s.7691
Issue
Vol. 11 No. 10s (2023)
Section
Articles

References

Sangaiah AK, Hosseinabadi AAR, Shareh MB, Bozorgi Rad SY, Zolfagharian A, Chilamkurti N. IoT Resource Allocation and Optimization Based on Heuristic Algorithm. Sensors (Basel). 2020 Jan 18;20(2):539. doi: 10.3390/s20020539. PMID: 31963762; PMCID: PMC7014514.

S. Vimal, Manju Khari, Nilanjan Dey, Rubén González Crespo, Y. Harold Robinson, Enhanced resource allocation in mobile edge computing using reinforcement learning based MOACO algorithm for IIOT, Computer Communications, Volume 151, 2020, Pages 355-364, ISSN 0140-3664, https://doi.org/10.1016/j.comcom.2020.01.018.

P. Goswami, A. Mukherjee, M. Maiti, S. K. S. Tyagi and L. Yang, "A Neural-Network-Based Optimal Resource Allocation Method for Secure IIoT Network," in IEEE Internet of Things Journal, vol. 9, no. 4, pp. 2538-2544, 15 Feb.15, 2022, doi: 10.1109/JIOT.2021.3084636.

Y. Chen, Z. Liu, Y. Zhang, Y. Wu, X. Chen and L. Zhao, "Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things," in IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4925-4934, July 2021, doi: 10.1109/TII.2020.3028963.

Jamil, Sonain, MuhibUr Rahman, and Fawad. 2022. "A Comprehensive Survey of Digital Twins and Federated Learning for Industrial Internet of Things (IIoT), Internet of Vehicles (IoV) and Internet of Drones (IoD)" Applied System Innovation 5, no. 3: 56. https://doi.org/10.3390/asi5030056

P. Ambika, Chapter Thirteen - Machine learning and deep learning algorithms on the Industrial Internet of Things (IIoT), Editor(s): Pethuru Raj, Preetha Evangeline, Advances in Computers, Elsevier, Volume 117, Issue 1, 2020, Pages 321-338, ISSN 0065-2458, ISBN 9780128187562, https://doi.org/10.1016/bs.adcom.2019.10.007.

Mohamed Said Frikha, Sonia Mettali Gammar, Abdelkader Lahmadi, Laurent Andrey, Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey, Computer Communications, Volume 178, 2021, Pages 98-113, ISSN 0140-3664, https://doi.org/10.1016/j.comcom.2021.07.014.

W. Sun, J. Liu and Y. Yue, "AI-Enhanced Offloading in Edge Computing: When Machine Learning Meets Industrial IoT," in IEEE Network, vol. 33, no. 5, pp. 68-74, Sept.-Oct. 2019, doi: 10.1109/MNET.001.1800510.

B. Chen, J. Wan, Y. Lan, M. Imran, D. Li and N. Guizani, "Improving Cognitive Ability of Edge Intelligent IIoT through Machine Learning," in IEEE Network, vol. 33, no. 5, pp. 61-67, Sept.-Oct. 2019, doi: 10.1109/MNET.001.1800505.

X. Xu, R. Mo, F. Dai, W. Lin, S. Wan and W. Dou, "Dynamic Resource Provisioning With Fault Tolerance for Data-Intensive Meteorological Workflows in Cloud," in IEEE Transactions on Industrial Informatics, vol. 16, no. 9, pp. 6172-6181, Sept. 2020, doi: 10.1109/TII.2019.2959258.

H. Liang et al., "Reinforcement Learning Enabled Dynamic Resource Allocation in the Internet of Vehicles," in IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4957-4967, July 2021, doi: 10.1109/TII.2020.3019386.

Y. Chen, Z. Liu, Y. Zhang, Y. Wu, X. Chen and L. Zhao, "Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things," in IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4925-4934, July 2021, doi: 10.1109/TII.2020.3028963.

W. Wu, P. Yang, W. Zhang, C. Zhou and X. Shen, "Accuracy-Guaranteed Collaborative DNN Inference in Industrial IoT via Deep Reinforcement Learning," in IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4988-4998, July 2021, doi: 10.1109/TII.2020.3017573.

P. Zhang, C. Wang, C. Jiang and Z. Han, "Deep Reinforcement Learning Assisted Federated Learning Algorithm for Data Management of IIoT," in IEEE Transactions on Industrial Informatics, vol. 17, no. 12, pp. 8475-8484, Dec. 2021, doi: 10.1109/TII.2021.3064351.

Hussein, A. ., & Mohamed , R. . (2023). Feasibility Study for Developing an Event Prioritizing System Using CMSs. International Journal of Intelligent Systems and Applications in Engineering, 11(1s), 30–45. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2474

G. Manogaran, J. Ngangmeni, J. Stewart, D. B. Rawat and T. N. Nguyen, "Deep-Learning-Based Concurrent Resource Allocation Method for Improving the Service Response of 6G Network-in-Box Users in UAV," in IEEE Internet of Things Journal, vol. 10, no. 4, pp. 3130-3137, 15 Feb.15, 2023, doi: 10.1109/JIOT.2021.3119336.

M. Liu, F. R. Yu, Y. Teng, V. C. M. Leung and M. Song, "Performance Optimization for Blockchain-Enabled Industrial Internet of Things (IIoT) Systems: A Deep Reinforcement Learning Approach," in IEEE Transactions on Industrial Informatics, vol. 15, no. 6, pp. 3559-3570, June 2019, doi: 10.1109/TII.2019.2897805.

W. Zhang et al., "Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT," in IEEE Transactions on Vehicular Technology, vol. 70, no. 8, pp. 7605-7618, Aug. 2021, doi: 10.1109/TVT.2021.3068255.

Z. Shi, X. Xie, H. Lu, H. Yang, M. Kadoch and M. Cheriet, "Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things," in IEEE Internet of Things Journal, vol. 8, no. 5, pp. 3476-3489, 1 March1, 2021, doi: 10.1109/JIOT.2020.3022861.

Mr. Nikhil Surkar, Ms. Shriya Timande. (2012). Analysis of Analog to Digital Converter for Biomedical Applications. International Journal of New Practices in Management and Engineering, 1(03), 01 - 07. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/6

W. Fan, S. Li, J. Liu, Y. Su, F. Wu and Y. Liu, "Joint Task Offloading and Resource Allocation for Accuracy-Aware Machine-Learning-Based IIoT Applications," in IEEE Internet of Things Journal, vol. 10, no. 4, pp. 3305-3321, 15 Feb.15, 2023, doi: 10.1109/JIOT.2022.3181990.

S. Tang, L. Chen, K. He, J. Xia, L. Fan and A. Nallanathan, "Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT," in IEEE Transactions on Network Science and Engineering, 2022, doi: 10.1109/TNSE.2022.3180632.

Davis, W., Wilson, D., López, A., Gonzalez, L., & González, F. Automated Assessment and Feedback Systems in Engineering Education: A Machine Learning Approach. Kuwait Journal of Machine Learning, 1(1). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/102

Lokesh Bommisetty, T.G. Venkatesh, Resource Allocation in Time Slotted Channel Hopping (TSCH) Networks Based on Phasic Policy Gradient Reinforcement Learning, Internet of Things, Volume 19, 2022, 100522, ISSN 2542-6605, https://doi.org/10.1016/j.iot.2022.100522.

L. Yang, M. Li, P. Si, R. Yang, E. Sun and Y. Zhang, "Energy-Efficient Resource Allocation for Blockchain-Enabled Industrial Internet of Things With Deep Reinforcement Learning," in IEEE Internet of Things Journal, vol. 8, no. 4, pp. 2318-2329, 15 Feb.15, 2021, doi: 10.1109/JIOT.2020.3030646.

Rosenberger, J., Urlaub, M., Rauterberg, F., Lutz, T., Selig, A., Bühren, M., & Schramm, D. (2022). Deep reinforcement learning multi-agent system for resource allocation in industrial internet of things. Sensors, 22(11), 4099.

Wiling, B. (2021). Locust Genetic Image Processing Classification Model-Based Brain Tumor Classification in MRI Images for Early Diagnosis. Machine Learning Applications in Engineering Education and Management, 1(1), 19–23. Retrieved from http://yashikajournals.com/index.php/mlaeem/article/view/6

Boobalan, P., Ramu, S. P., Pham, Q. V., Dev, K., Pandya, S., Maddikunta, P. K. R., ... & Huynh-The, T. (2022). Fusion of federated learning and industrial Internet of Things: A survey. Computer Networks, 212, 109048.

Tang, S., Pan, Z., Hu, G., Wu, Y., & Li, Y. (2022). Deep Reinforcement Learning-Based Resource Allocation for Satellite Internet of Things with Diverse QoS Guarantee. Sensors, 22(8), 2979.

Li, M., Pei, P., Yu, F. R., Si, P., Li, Y., Sun, E., & Zhang, Y. (2022). Cloud–Edge Collaborative Resource Allocation for Blockchain-Enabled Internet of Things: A Collective Reinforcement Learning Approach. IEEE Internet of Things Journal, 9(22), 23115-23129.

Wang Wei, Natural Language Processing Techniques for Sentiment Analysis in Social Media , Machine Learning Applications Conference Proceedings, Vol 1 2021.

Fang, C., Xu, H., Yang, Y., Hu, Z., Tu, S., Ota, K., ... & Liu, Y. (2022). Deep-reinforcement-learning-based resource allocation for content distribution in fog radio access networks. IEEE Internet of Things Journal, 9(18), 16874-16883.

Jayalaxmi, P. L. S., Kumar, G., Saha, R., Conti, M., Kim, T. H., & Thomas, R. (2022). DeBot: A deep learning-based model for bot detection in industrial internet-of-things. Computers and Electrical Engineering, 102, 108214.

Yang, Z., Yang, R., Yu, F. R., Li, M., Zhang, Y., & Teng, Y. (2022). Sharded blockchain for collaborative computing in the Internet of Things: Combined of dynamic clustering and deep reinforcement learning approach. IEEE Internet of Things Journal, 9(17), 16494-16509.

Gong, Y., Yao, H., Wang, J., Li, M., & Guo, S. (2022). Edge intelligence-driven joint offloading and resource allocation for future 6G industrial internet of things. IEEE Transactions on Network Science and Engineering.

Olatinwo, S. O., & Joubert, T. H. (2022). Deep learning for resource management in Internet of Things networks: a bibliometric analysis and comprehensive review. Institute of Electrical and Electronics Engineers.

Tian, K., Chai, H., Liu, Y., & Liu, B. (2022). Edge intelligence empowered dynamic offloading and resource management of MEC for smart city Internet of Things. Electronics, 11(6), 879

Lai, X., Hu, Q., Wang, W., Fei, L., & Huang, Y. (2020). Adaptive resource allocation method based on deep Q network for industrial Internet of Things. IEEE Access, 8, 27426-27434.

Liang, Fan, et al. "Toward Deep Q-Network-Based Resource Allocation in Industrial Internet of Things." IEEE Internet of Things Journal 9.12 (2021): 9138-9150.