SMARTS for Windows NT 4x is a software maintenance and regression testing system. SMARTS/MSW reads a user-designed automated test script. The hierarchically organized tests can be supplemented with test activation commands, comparison arguments and pass/fail evaluation methods. The test script can also be augmented with system calls to other tools. A C-language interpreter provides full user-programmable scripting support. When executed, SMARTS/MSW performs the programmed tests, runs difference checks on the output against the baseline, and accumulates a detailed PASS/FAIL record of test results in an internal database. Four standard reports can be generated by SMARTS/MSW from each current test outcome record. The Status Report lists the most recent test execution outcomes. The History Report includes current and past test results for every test executed. The Regression Report lists any tests whose outcome has changed since any previous test activations. The Certification Report summarizes the total number and percentage of tests that have ever PASSed and FAILed.