Turn off automatic backup of checkpoint files

As the title says, we currently backup checkpoints, which can create large amounts of files especially when debugging test cases. We might want to consider turning this off by default and introduce an option to enable it.