Turn off automatic backup of checkpoint files
As the title says, we currently backup checkpoints, which can create large amounts of files especially when debugging test cases. We might want to consider turning this off by default and introduce an option to enable it.