Skip to content

Cyber-Physical Sysems course Exam: PID, Reinforcement Learning and Temporal Logic

Notifications You must be signed in to change notification settings

nicoleorzan/cps-exam

Repository files navigation

Cyber-Physical Systems exam Repository

In this repository you can find the analysis of the temperature variation for a Chemical Batch Reactor.

  • BatchReactor.py is a class containing variables and the dynamics of the Reactor
  • Simple_PID.py is a class containing a a simple implementation of a PID controller1 (you don't say?)
  • PID_Loop.py contains the application of the PID to the Reactor
  • main.py launches the PID
  • STL.py contains the expression and evaluation of Signal Temporal Logic requirements over the reactor temperature variable2
  • trace_statistics.py contains the Falsification of requirementd over a sample of trajectories with noise
  • ReinforcementLearning.py is a class containing the definition of sates, actions and rewards to perform Reinforcement Learning
  • rl_train_test.py launches a Reinforcement Learning code with SARSA evaluation policy to follow the constant signal

Some Results:

Reactor temperature following a varying signal.

Reactor temperature variation following the policy obtained from SARSA.

References:

  1. A. Shamekh, T. Hussein, and A. Altowati, "Design of Standard PID Controller for Exothermic Batch Process Simulation", 2013 European Modelling Symposium.

  2. Temporal Logic package: https://github.com/mvcisback/py-metric-temporal-logic

About

Cyber-Physical Sysems course Exam: PID, Reinforcement Learning and Temporal Logic

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages