Mobly Release 1.9: UID Support; `AndroidDevice` and General Runner Improvements

New

• Support specifying Unique Identifier (UID) for both static and generated test methods.

Breaking Changes

• Detached logger lifecycle from TestRunner#run. Suite users have to explicitly use the new logger context around TestRunner#run.
• Removed the behavior of BaseTestClass as a context as it has been a no-op for several releases.
• [Deprecation] Removed BaseTestClass#clean_up which was deprecated in 1.8.1.
• [Deprecation] Code path for passing args directly into a test method, which was never used.
• [Deprecation] Service-related APIs deprecated in 1.8 are now removed, including AndroidDevice#load_sl4a.

Fixes

• Bug fixes and reliability improvements in AdbProxy.
• Improved APIs for taking bugreports
• Improvements in AndroidDevice service management
• Improvements in AndroidDevice's getprop calls, including caching.

Full list of changes

Mobly Release 1.8.1: Fix Final Cleanup Stage Error Capture

Fixes

• Errors from the final clean up stage are now properly recorded.
  • NOTE: This may expose errors that have long existed in your tests. They are
    usually caused by your test interrupting controller object life cycle
    management. Fixing these issues would help keep your test env clean.
• Fixed docs config so http://mobly.readthedocs.io show all the classes
  properly.

Mobly 1.8: Controller Management and `AndroidDevice` Service

New

• Modularized controller management logic by introducing ControllerManager.
• Introduced the service mechanism in AndroidDevice for ease of handling life cycles of long-running processes for Android devices.
• Convenience method for creating per-test adb logcat logcat.create_per_test_excerpt.
• AdbError now has serial as a direct attribute.

Deprecated

The following APIs in AndroidDevice are deprecated:

• start_services -> ad.services.start_all
• stop_services -> ad.services.stop_all
• start_adb_logcat -> ad.services.logcat_start
• stop_adb_logcat -> ad.services.logcat_stop

Fixes

• expects APIs crashing in certain execution stages.
• setup_class's record is not recorded correctly in summary yaml.
• Controller info recoding
• adb logcat crashes

Full list of changes

Mobly Release 1.7.5: Dependency Cleanup

Fixes

• Only install test dependencies when running the unit tests.
• Allow CallbackHandler.waitForEvent to wait for longer than the max rpc
  timeout.

Full list of changes.

Mobly Release 1.7.4: Better debug logs

Added framework DEBUG level log generated by Mobly:

• Log test configuration at the beginning.
• Log boundaries of each execution stage.
• Log snippet client calls.

New

• Support suffixing test class name in a suite.
• API to unload a single snippet from AndroidDevice.

Fixes

• Fixes in BaseTestClass.
• Fixes for running on Windows.

Full list of changes.

Mobly Release 1.7.3: Windows support fixes

New

• self.current_test_info now exists for setup_class stage.
• adb calls through AdbProxy can now propagate stderr.
• Instrumentation runner now outputs timestamp for each test.

Fixes

• Fix several bugs for running on Windows.

Full list of changes.

Mobly Release 1.7.2: Custom Info in Test Summary

New

• Support adding additional blocks in test summary file.
• SnippetEvent is now loggable.

Fixes

• Fix several bugs in error reporting.
• Fix log persist crashing Mobly on certain devices.

Full list of changes.

Mobly Release 1.7.1: Bug Fixes

New

• Allow setting up logger before test class execution. Useful for suites.

Fixes

• Fix recording of teardown_class failures in new output format.
• Properly handle calling asserts.abort_all in on_fail.
• Minor fixes for Windows support.

Full list of changes.

Mobly Release 1.7: Expectation APIs and Instrumentation Test Runner

New

• APIs for specifying expectation in test for delayed test termination.
  mobly.expects
• A runner class for easily running regular Instrumentation tests with Mobly.
  Tutorial.
• API to get runtime test info during the test.
• Support specifying file location and timeout in take_bug_report.
• Support changing device serial during test. Needed for remote devices.
• Allow adding custom controller info for AndroidDevice.

Breaking Changes

• Monsoon config format change:
  Old: 'Monsoon': [123, 456]
  New: 'Monsoon': [{'serial': 123}, {'serial': 456'}]

Deprecated

• Old output files.

Full list of changes.

Mobly Release 1.6.1: New Output

New

• New output file scheme, with better clarity and streamable summary file.
• Improved result reporting: more consistent, more debug info, no hiding errors.
• adb commands now support timeout param. E.g. adb.wait_for_device(timeout=10)

Breaking Changes

• Signature change of procedure functions like on_fail.
  • Old: on_fail(test_name, begin_time)
  • New: on_fail(record)

Deprecated

• Old generated test code path
• Support for old snippet protocol (v0)

CHANGELOG