Our training (aka pre-training) software is now the internally developed C/C++ stack, which was written primarily by the Starlink software team. This is awesome and probably best in industry. However, our reinforcement learning stack is still somewhat of a legacy pile of many different third-party software systems. This will get fixed, but isn’t yet.