I'm thinking that it should be done when autotest is done generating all the tests, not each time that a new test is created.