During the last several months I put a substantial amount of work into improving the Automated Testing System. Future posts will describe the exciting new features and the benefits to the community. If interested, a brief overview of some of the requirements can be found in the PIFR and PIFT issue queues.
For additional background, the original thoughts can be found at the following links:
- The Future of Automated Patch Testing
- Testbed design change and development
- Automated Testing System Development Clarification
There a number of steps that need to be completed before the Drupal community can reap the benefits of the new system.
- Security review of rewritten Project Issue File Test (PIFT) module that integrates with the project module on drupal.org.
- Someone familiar with SQLite, possibly one of the D7 maintainers, needs to write a PIFR DB driver to implement the required methods. MySQL and PostgresSQL have already been completed and can be used as examples. The driver is relatively simple, but will require manually connecting to SQLite since PIFR runs in D6 which does not support SQLite.
- Update testing client setup/installation script where necessary.
- Deploy current development system to project.drupal.org and the create a parallel testing client network.
- Freeze the current test client network and extract the test ID map for use in drupal.org upgrade.
- Upgrade and finalize test client network and test server (testing.drupal.org). Possibly move testing.drupal.org under the drupal.org infrastructure.
- Confirm upgraded testing network is functional.
- Plan for approximately 15 minutes of downtime on drupal.org.
- Update PIFT code and run data update using extracted test ID map from #4 on drupal.org during downtime.
- Watch deployed system closely and solicit community feedback and bug reports.
- Request additional hardware to use as community test clients (to allow for future expansion into testing contributed modules).
Once the second generation framework is in place and running smoothly I will begin work on finishing the last pieces required to allow for testing of contributed modules (D6 and D7) and Drupal 6 core. I will be writing more on the new features and UX improvements to be looking for in during the upcoming deployment.