Volume 13 Number 6
December 2016
Article Contents
Yuan Ge and Yaoyiran Li. SCHMM-based Compensation for the Random Delays in Networked Control Systems. International Journal of Automation and Computing, vol. 13, no. 6, pp. 643-652, 2016. doi: 10.1007/s11633-016-1001-7
Cite as: Yuan Ge and Yaoyiran Li. SCHMM-based Compensation for the Random Delays in Networked Control Systems. International Journal of Automation and Computing, vol. 13, no. 6, pp. 643-652, 2016.

# SCHMM-based Compensation for the Random Delays in Networked Control Systems

Author Biography:
• Yaoyiran Li,is a senior student majoring in electrical engineering at University of Electronic Science and Technology of China, China. He is an IEEE student member (No. 93258350).
His research interests include robotics, artificial intelligence and automatic control.
E-mail:1622455452@qq.com;
ORCID iD:0000-0001-9529-3878

• Corresponding author: Yuan Ge received the B. Sc., M. Sc., and Ph.D. degrees from University of Science and Technology of China in 2002, 2005 and 2011, respectively. Now, he is a visiting scholar in the Department of Electrical Engineering at Tsinghua University, China, and he is also a professor in the College of Electrical Engineering at Anhui Polytechnic University, China.
His research interests include networked control systems, telerobotic systems and optimal control.
E-mail: ygetoby@mail.ustc.edu.cn ;
ORCID iD: 0000-0003-2037-319X
• Accepted: 2015-10-16
• Published Online: 2016-06-20
Fund Project:

This work was supported by National Natural Science Foundation of China 61203034 and 61572032

• In order to compensate the network-induced random delays in networked control systems (NCSs),the semi-continuous hidden Markov model (SCHMM) is introduced in this paper to model the controller-to-actuator (CA) delay in the forward network channel.The expectation maximization algorithm is used to obtain the optimal estimation of the model s parameters,and the Viterbi algorithm is used to predict the CA delay in the current sampling period.Thus,the predicted CA delay and the measured sensor-tocontroller (SC) delay in the current sampling period are used to design an optimal controller.Under this controller,the exponentially mean square stability of the NCS is guaranteed,and the SC and CA delays are compensated.Finally,the effectiveness of the method proposed in this paper is demonstrated by a simulation example.Moreover,a comparative example is also given to illustrate the superiority of the SCHMM-based optimal controller over the discrete hidden Markov model (DHMM)-based optimal controller.
•  [1] ﻿R. A. Gupta, M. Y. Chow. Networked control system:Overview and research trends. IEEE Transactions on Industrial Electronics, 2010, 57(7): 2527-2535.  doi: 10.1109/TIE.2009.2035462 [2] L. X. Zhang, H. J. Gao, O. Kaynak. Network-induced constraints in networked control systems-A survey. IEEE Transactions on Industrial Informatics, 2013, 9(1): 403-416.  doi: 10.1109/TII.2012.2219540 [3] L. X. Zhang, H. J. Gao, F. Lewis, O. Kaynak. Guest editorial advances in theories and industrial applications of networked control systems. IEEE Transactions on Industrial Informatics, 2013, 9(1): 303-305.  doi: 10.1109/TII.2012.2226898 [4] Y. Ge, Q. G. Chen, M. Jiang, Y. Q. Huang. Modeling of random delays in networked control systems. Journal of Control Science and Engineering, 2013 Article ID 383415, 2013. [5] J. H. Zhang, J. Lam, Y. Q. Xia. Output feedback delay compensation control for networked control systems with random delays. Information Sciences, 2014:265154-166. [6] Y. Ge, Q. G. Chen, M. Jiang, Y. Q. Huang. SCHMM-based modeling and prediction of random delays in networked control systems. Journal of The Franklin Institute, 2014, 351(5): 2430-2453.  doi: 10.1016/j.jfranklin.2013.12.021 [7] R. Luck, A. Ray. An observer-based compensator for distributed delays. Automatica, 1990, 26(5): 903-908.  doi: 10.1016/0005-1098(90)90007-5 [8] F. L. Lian, J. Moyne, D. Tilbury. Modelling and optimal controller design of networked control systems with multiple delays. International Journal of Control, 2003, 76(6): 591-606.  doi: 10.1080/0020717031000098426 [9] L. Dritsas, A. Tzes. Robust stability bounds for networked controlled systems with unknown, bounded and varying delays. IET Control Theory and Applications, 2009, 3(3): 270-280.  doi: 10.1049/iet-cta:20070384 [10] E. G. Tian, D. Yue, T. C. Yang, Z. Gu, G. P. Lu. T-S fuzzy model-based robust stabilization for networked control systems with probabilistic sensor and actuator failure. IEEE Transactions on Fuzzy Systems, 2011, 19(3): 553-561.  doi: 10.1109/TFUZZ.2011.2121069 [11] R. N. Yang, G. P. Liu, P. Shi, C. Thomas, M. V. Basin. Predictive output feedback control for networked control systems. IEEE Transactions on Industrial Electronics, 2014, 61(1): 512-520.  doi: 10.1109/TIE.2013.2248339 [12] Y. Zheng, H. J. Fang, H. O. Wang. Takagi-sugeno fuzzymodel-based fault detection for networked control systems with Markov delays. IEEE Transactions on Systems, Man, and Cybernetics, Part B:Cybernetics, 2006, 36(4): 924-929.  doi: 10.1109/TSMCB.2005.861879 [13] Y. Shi, B. Yu. Output feedback stabilization of networked control systems with random delays modeled by Markov chains. IEEE Transactions on Automatic Control, 2009, 54(7): 1668-1674.  doi: 10.1109/TAC.2009.2020638 [14] J. W. Dong, W. J. Kim. Markov-chain-based output feedback control for stabilization of networked control systems with random time delays and packet losses. International Journal of Control, Automation and Systems, 2012, 10(5): 1013-1022.  doi: 10.1007/s12555-012-0519-x [15] H. Zhang, Y. Shi, J. M. Wang. Observer-based tracking controller design for networked predictive control systems with uncertain Markov delays. International Journal of Control, 2013, 86(10): 1824-1836.  doi: 10.1080/00207179.2013.797107 [16] Y. Ge, S. Cong, W. W. Shang. Compensation for the stochastic delays in networked control systems. Journal of Graduate University of Chinese Academy of Sciences, 30(2): 179-186, 2013. (in Chinese) [17] Y. Ge, S. Cong, W. W. Shang. DTHMM based optimal controller design for networked control systems. Journal of University of Science and Technology of China, 42(2): 161-169, 2012. (in Chinese) [18] T. Liu, D. J. Hill, J. Zhao. Synchronization of dynamical networks by network control. IEEE Transactions on Automatic Control, 2012, 57(6): 1574-1580.  doi: 10.1109/TAC.2011.2174691 [19] K. J. Aström. Introduction to Stochastic Control Theory, New York, USA:Academic Press, 1970. [20] E. Yaz. Control of randomly varying systems with prescribed degree of stability. IEEE Transactions on Automatic Control, 1988, 33(4): 407-411.  doi: 10.1109/9.192203 [21] S. S. Hu, Q. X. Zhu. Stochastic optimal control and analysis of stability of networked control systems with long delay. Automatica, 2003, 39(11): 1877-1884.  doi: 10.1016/S0005-1098(03)00196-1 [22] A. Cervini, M. Ohlin, D. Henriksson. Simulation of networked control systems using TrueTime. In Proceedings of the 3rd International Workshop on Networked Control Systems:Tolerant to Faults, Nancy, France, 2007.
•  [1] Zhan Li, Sheng-Ri Xue, Xing-Hu Yu, Hui-Jun Gao. Controller Optimization for Multirate Systems Based on Reinforcement Learning . International Journal of Automation and Computing, 2020, 17(3): 417-427.  doi: 10.1007/s11633-020-1229-0 [2] Azzedine Yahiaoui. A Practical Approach to Representation of Real-time Building Control Applications in Simulation . International Journal of Automation and Computing, 2020, 17(3): 464-478.  doi: 10.1007/s11633-018-1131-1 [3] Fernando Agustín Pazos, Anibal Zanini, Amit Bhaya. Performance Improvement of Discrete-time Linear Control Systems Subject to Varying Sampling Rates Using the Tikhonov Regularization Method . International Journal of Automation and Computing, 2020, 17(3): 453-463.  doi: 10.1007/s11633-019-1205-8 [4] Ana Paula Batista, Fábio Gonçalves Jota. Analysis of the Most Likely Regions of Stability of an NCS and Design of the Corresponding Event-driven Controller . International Journal of Automation and Computing, 2018, 15(1): 39-51.  doi: 10.1007/s11633-017-1099-2 [5] Chang-Chun Hua,  Shao-Chong Yu,  Xin-Ping Guan. Finite-time Control for a Class of Networked Control Systems with Short Time-varying Delays and Sampling Jitter . International Journal of Automation and Computing, 2015, 12(4): 448-454.  doi: 10.1007/s11633-014-0849-7 [6] Zhong-Da Tian,  Xian-Wen Gao,  Bi-Lian Gong,  Tong Shi. Time-delay Compensation Method for Networked Control System Based on Time-delay Prediction and Implicit PIGPC . International Journal of Automation and Computing, 2015, 12(6): 648-656.  doi: 10.1007/s11633-015-0897-7 [7] Yuan-Qing Xia,  Yu-Long Gao,  Li-Ping Yan,  Meng-Yin Fu. Recent Progress in Networked Control Systems-A Survey . International Journal of Automation and Computing, 2015, 12(4): 343-367.  doi: 10.1007/s11633-015-0894-x [8] Paramita Guha,  Sunita Mishra. Reduced Order Modeling & Controller Design for Mass Transfer in a Grain Storage System . International Journal of Automation and Computing, 2014, 11(4): 399-403.  doi: 10.1007/s11633-014-0805-6 [9] Lal Bahadur Prasad,  Barjeev Tyagi,  Hari Om Gupta. Optimal Control of Nonlinear Inverted Pendulum System Using PID Controller and LQR: Performance Analysis Without and With Disturbance Input . International Journal of Automation and Computing, 2014, 11(6): 661-670.  doi: 10.1007/s11633-014-0818-1 [10] Kin Chung Denny Fu,  Yutaka Nakamura,  Tomoyuki Yamamoto,  Hiroshi Ishiguro. Analysis of Motor Synergies Utilization for Optimal Movement Generation for a Human-like Robotic Arm . International Journal of Automation and Computing, 2013, 10(6): 515-524.  doi: 10.1007/s11633-013-0749-2 [11] Xiao-Ming Tang,  Bao-Cang Ding. Design of Networked Control Systems with Bounded Arbitrary Time Delays . International Journal of Automation and Computing, 2012, 9(2): 182-190.  doi: 10.1007/s11633-012-0632-6 [12] Ming-Yue Zhao, He-Ping Liu, Zhi-Jun Li, De-Hui Sun. Fault Tolerant Control for Networked Control Systems with Packet Loss and Time Delay . International Journal of Automation and Computing, 2011, 8(2): 244-253.  doi: 10.1007/s11633-011-0579-z [13] Xiu-Lan Wang, Chun-Guo Fei, Zheng-Zhi Han. Adaptive Predictive Functional Control for Networked Control Systems with Random Delays . International Journal of Automation and Computing, 2011, 8(1): 62-68.  doi: 10.1007/s11633-010-0555-z [14] Jing Yan, Xin-Ping Guan, Xiao-Yuan Luo, Fu-Xiao Tan. Target Tracking and Obstacle Avoidance for Multi-agent Networks with Input Constraints . International Journal of Automation and Computing, 2011, 8(1): 46-53.  doi: 10.1007/s11633-010-0553-1 [15] Bao-Feng Wang,  Ge Guo. Kalman Filtering with Partial Markovian Packet Losses . International Journal of Automation and Computing, 2009, 6(4): 395-400.  doi: 10.1007/s11633-009-0395-x [16] Xian-Ming Tang,  Jin-Shou Yu. Feedback Scheduling of Model-based Networked Control Systems with Flexible Workload . International Journal of Automation and Computing, 2008, 5(4): 389-394.  doi: 10.1007/s11633-008-0389-0 [17] N. Eva Wu,  Sudha Thavamani,  Xiaohua Li. Reliability and Feedback of Multiple Hop Wireless Networks . International Journal of Automation and Computing, 2007, 4(2): 125-134.  doi: 10.1007/s11633-007-0125-1 [18] B. Bandyopadhyay, Alemayehu G/Egziabher Abera, S. Janardhanan, Victor Sreeram. Sliding Mode Control Design via Reduced Order Model Approach . International Journal of Automation and Computing, 2007, 4(4): 329-334.  doi: 10.1007/s11633-007-0329-4 [19] Jun Wu, Jian Chu, Sheng Chen. On the Dual of a Mixed H2/l1 Optimisation Problem . International Journal of Automation and Computing, 2006, 3(1): 91-98.  doi: 10.1007/s11633-006-0091-z [20] . Modelling and Multi-Objective Optimal Control of Batch Processes Using Recurrent Neuro-fuzzy Networks . International Journal of Automation and Computing, 2006, 3(1): 1-7.  doi: 10.1007/s11633-006-0001-4
###### 通讯作者: 陈斌, bchen63@163.com
• 1.

沈阳化工大学材料科学与工程学院 沈阳 110142

Figures (4)

## SCHMM-based Compensation for the Random Delays in Networked Control Systems

• ###### Corresponding author:Yuan Ge received the B. Sc., M. Sc., and Ph.D. degrees from University of Science and Technology of China in 2002, 2005 and 2011, respectively. Now, he is a visiting scholar in the Department of Electrical Engineering at Tsinghua University, China, and he is also a professor in the College of Electrical Engineering at Anhui Polytechnic University, China. His research interests include networked control systems, telerobotic systems and optimal control. E-mail: ygetoby@mail.ustc.edu.cn ;ORCID iD: 0000-0003-2037-319X
Fund Project:

This work was supported by National Natural Science Foundation of China 61203034 and 61572032

Abstract: In order to compensate the network-induced random delays in networked control systems (NCSs),the semi-continuous hidden Markov model (SCHMM) is introduced in this paper to model the controller-to-actuator (CA) delay in the forward network channel.The expectation maximization algorithm is used to obtain the optimal estimation of the model s parameters,and the Viterbi algorithm is used to predict the CA delay in the current sampling period.Thus,the predicted CA delay and the measured sensor-tocontroller (SC) delay in the current sampling period are used to design an optimal controller.Under this controller,the exponentially mean square stability of the NCS is guaranteed,and the SC and CA delays are compensated.Finally,the effectiveness of the method proposed in this paper is demonstrated by a simulation example.Moreover,a comparative example is also given to illustrate the superiority of the SCHMM-based optimal controller over the discrete hidden Markov model (DHMM)-based optimal controller.

Yuan Ge and Yaoyiran Li. SCHMM-based Compensation for the Random Delays in Networked Control Systems. International Journal of Automation and Computing, vol. 13, no. 6, pp. 643-652, 2016. doi: 10.1007/s11633-016-1001-7
 Citation: Yuan Ge and Yaoyiran Li. SCHMM-based Compensation for the Random Delays in Networked Control Systems. International Journal of Automation and Computing, vol. 13, no. 6, pp. 643-652, 2016.
Reference (22)

/