Two New Features for Clearer Testing

By Guus der Kinderen

We’ve just released version 1.7.1 of all of our test runners. This release adds two improvements to make interop testing both stricter and easier to set up!

Impossible Tests Can Fail Runs

Some tests can’t be executed if the server lacks required features. Previously, these “impossible” tests were skipped, which could make a run look fully successful when it wasn’t. Now you can configure the suite to treat impossible tests as failures, ensuring that a green run really means every configured test executed and passed.

Flexible Account Provisioning

Our tests act like clients, so they need accounts to log in. You can now choose from three provisioning methods:

  • Admin Account using XEP-0133 to create test accounts.
  • Explicit Test Accounts you configure up front.
  • In-Band Registration via XEP-0077.

Pick the approach that fits your setup best. There is documentation available for you to review the finer details!

Together, these features give you more reliable results and more flexibility in how you run tests!

Splash image courtesy of Mohamed Nohassi, Unsplash