open access

https://hdl.handle.net/2115/95649

Design of reduced-order and pinning controllers for probabilistic Boolean networks using reinforcement learning

英語

Systems biology

2023-11-15

Elsevier

Applied mathematics and computation

457

128211

In this paper, we study a stabilization method for probabilistic Boolean networks (PBNs) using Q-learning, which is one of the typical methods in reinforcement learning. A PBN is a class of discrete-time stochastic logical systems in which update functions are randomly chosen from the set of the candidates of Boolean functions. In the existing methods using reinforcement learning, a design method of structured controllers has not been studied. In this paper, we propose reward design methods to derive reduced-order controllers and pinning controllers. The key idea is to adjust the structure of controllers by the reward for the structure of the Q-table. The advantage of the proposed method is that implementa-tion is easy, because the proposed method can be embedded in the existing Q-learning -based stabilization algorithm. In design of pinning controllers, we can calculate not only controllers but also pinning nodes in which the control input is assigned. We demonstrate through numerical examples that the controller obtained from our proposed method is simpler than that from the existing method.

学術雑誌論文

Accepted Manuscript

Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International

© <2023>. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/

0096-3003