Check our recent work: Uncertainty-aware Grounded Action Transformation towards Sim-to-Real Transfer for Traffic Signal Control We intend to mitigate the issue caused by system dynamics difference between simulation and reality, accepted to IEEE-CDC2023 arxiv.org/pdf/2307.12388.pdf