File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Article: Disturbance-Aware Neuro-Optimal System Control Using Generative Adversarial Control Networks

TitleDisturbance-Aware Neuro-Optimal System Control Using Generative Adversarial Control Networks
Authors
KeywordsAdaptive dynamic programming (DP)
approximate dynamic programming (ADP)
generative adversarial networks (GANs)
inverse reinforcement learning (RL)
neural networks
Issue Date2021
PublisherInstitute of Electrical and Electronics Engineers. The Journal's web site is located at http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=72
Citation
IEEE Transactions on Neural Networks and Learning Systems, 2021, v. 32 n. 10, p. 4565-4576 How to Cite?
AbstractDisturbance, which is generally unknown to the controller, is unavoidable in real-world systems and it may affect the expected system state and output. Existing control methods, like robust model predictive control, can produce robust solutions to maintain the system stability. However, these robust methods trade the solution optimality for stability. In this article, a method called generative adversarial control networks (GACNs) is proposed to train a controller via demonstrations of the optimal controller. By formulating the optimal control problem in the presence of disturbance, the controller trained by GACNs obtains neuro-optimal solutions without knowing the future disturbance and determines the objective function explicitly. A joint loss, composed of the adversarial loss and the least square loss, is designed to be used in the training of the generator. Experimental results on simulated systems with disturbance show that GACNs outperform other compared control methods.
Persistent Identifierhttp://hdl.handle.net/10722/305338
ISSN
2021 Impact Factor: 14.255
2020 SCImago Journal Rankings: 2.882
ISI Accession Number ID

 

DC FieldValueLanguage
dc.contributor.authorCHU, KF-
dc.contributor.authorLam, AYS-
dc.contributor.authorFAN, C-
dc.contributor.authorLi, VOK-
dc.date.accessioned2021-10-20T10:08:00Z-
dc.date.available2021-10-20T10:08:00Z-
dc.date.issued2021-
dc.identifier.citationIEEE Transactions on Neural Networks and Learning Systems, 2021, v. 32 n. 10, p. 4565-4576-
dc.identifier.issn2162-237X-
dc.identifier.urihttp://hdl.handle.net/10722/305338-
dc.description.abstractDisturbance, which is generally unknown to the controller, is unavoidable in real-world systems and it may affect the expected system state and output. Existing control methods, like robust model predictive control, can produce robust solutions to maintain the system stability. However, these robust methods trade the solution optimality for stability. In this article, a method called generative adversarial control networks (GACNs) is proposed to train a controller via demonstrations of the optimal controller. By formulating the optimal control problem in the presence of disturbance, the controller trained by GACNs obtains neuro-optimal solutions without knowing the future disturbance and determines the objective function explicitly. A joint loss, composed of the adversarial loss and the least square loss, is designed to be used in the training of the generator. Experimental results on simulated systems with disturbance show that GACNs outperform other compared control methods.-
dc.languageeng-
dc.publisherInstitute of Electrical and Electronics Engineers. The Journal's web site is located at http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=72-
dc.relation.ispartofIEEE Transactions on Neural Networks and Learning Systems-
dc.rightsIEEE Transactions on Neural Networks and Learning Systems. Copyright © Institute of Electrical and Electronics Engineers.-
dc.rights©20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.-
dc.subjectAdaptive dynamic programming (DP)-
dc.subjectapproximate dynamic programming (ADP)-
dc.subjectgenerative adversarial networks (GANs)-
dc.subjectinverse reinforcement learning (RL)-
dc.subjectneural networks-
dc.titleDisturbance-Aware Neuro-Optimal System Control Using Generative Adversarial Control Networks-
dc.typeArticle-
dc.identifier.emailLam, AYS: ayslam@eee.hku.hk-
dc.identifier.emailLi, VOK: vli@eee.hku.hk-
dc.identifier.authorityLam, AYS=rp02083-
dc.identifier.authorityLi, VOK=rp00150-
dc.description.naturelink_to_subscribed_fulltext-
dc.identifier.doi10.1109/TNNLS.2020.3022950-
dc.identifier.pmid32966221-
dc.identifier.scopuseid_2-s2.0-85117246511-
dc.identifier.hkuros327643-
dc.identifier.volume32-
dc.identifier.issue10-
dc.identifier.spage4565-
dc.identifier.epage4576-
dc.identifier.isiWOS:000704111000026-
dc.publisher.placeUnited States-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats