PID Controller Tuning for Heat Exchanger Systems: A Comparative Study of Classical, Model-Based, Optimization, and Reinforcement Learning Approaches

Savaş S.

Black Sea Journal of Engineering and Science, cilt.9, sa.2, ss.952-961, 2026 (TRDizin)

Özet

Heat exchangers are among the fundamental components of industrial processes, and effective temperature control is critical for process efficiency and product quality. This study presents a comparative analysis of PID controller tuning methods for a heat exchanger system from four different paradigms. As the classical approach, Ziegler–Nichols (ZN); as the model-based approach, Internal Model Control (IMC); as the metaheuristic optimization approach, Particle Swarm Optimization (PSO); and as the reinforcement learning approach, Soft Actor-Critic (SAC) are investigated. For the ZN and IMC methods, a single run is executed using fixed hyperparameters, whereas a two-stage methodology is followed for the PSO and SAC methods. Hyperparameter selection is performed via random search, evaluating 20 configurations and selecting the parameters that yield the lowest ITAE. Using the chosen hyperparameters, 20 independent runs are conducted, and statistical analysis is performed. For all tuning methods, the controller's tracking performance for step, sinusoidal, triangular, and square-wave reference signals is computed using RMSE, IAE, ISE, and ITAE metrics. The results show that the PSO-PID method achieves the lowest error metrics for all reference signals. In the step response, PSO provides 90.8% improvement in ITAE and 25.2% improvement in RMSE compared to ZN. The Wilcoxon rank-sum test indicates that the differences between PSO and SAC are statistically significant for most metrics (P<0.05). The controller obtained via the IMC method exhibits a slow response due to the system's large time constant and substantial phase lag for periodic signals. The SAC method shows higher variance than PSO but delivers better performance than classical methods. Overall, the study reveals the strengths and weaknesses of various approaches and provides guidance on method selection for industrial heat exchanger control. The outputs also demonstrate that the PSO algorithm is an effective and reliable method for PID parameter tuning in slow, time-delay systems such as heat exchangers.