Skip to content

CHANGES.rst

Latest commit

 

History

History
533 lines (325 loc) · 11.7 KB

CHANGES.rst

File metadata and controls

533 lines (325 loc) · 11.7 KB

Changelog

16.2 (unreleased)

  • Fix missing teardown for session and module scoped fixtures when fixture teardown fails. Fixes #314.

16.1 (2025-10-10)

  • Drop support for Python 3.9.
  • Changed "localhost" to "127.0.0.1" to avoid bad hostname resolution.
  • Added --force-reruns to override rerun count globally. Fixes #306.

16.0.1 (2025-09-02)

  • Reverted the ability to access error attributes because of an incompatibility with pytest-xdist. Fixes #302, #303.

16.0 (2025-08-29)

Breaking changes

  • Drop support for pytest < 8.

Features

  • Add support for pytest 8.4.x.
  • Add support for upcoming Python 3.14.
  • Allow @pytest.mark.flaky(condition) to accept a callable or a string to be evaluated. The evaluated string has access to the exception instance via the error object. (#230)

15.1 (2025-05-08)

Bug fixes

  • Fix --fail-on-flaky option to fail the test run with custom exit code only when reruns are detected. (#287)
  • Switched to using the SPDX license identifier in the project metadata.

Other changes

  • Change exception filtering logic to match AssertionError raised via assert statements when filtering by "AssertionError". (#292)

15.0 (2024-11-20)

Breaking changes

  • Drop support for Python 3.8.
  • Drop support for pytest < 7.4.

Features

  • Fix compatibility with pytest 8.2. (#267)
  • Add support for pytest 8.2, 8.3.
  • Add --fail-on-flaky option to fail the test run with custom exit code when test passed on rerun.

14.0 (2024-03-13)

Bug fixes

  • Fix missing teardown for non-function scoped fixtures when using only_rerun or rerun_except queries. (#234) and (#241)

Breaking changes

  • Drop support for Python 3.7.
  • Drop support for pytest < 7.2.

Features

  • Add support for pytest 8.0, 8.1.

13.0 (2023-11-22)

Breaking changes

  • Drop support for pytest < 7.0.

Features

  • Add support for Python 3.12.

Bug fixes

  • Fix crashitem names mismatch between client and server. (#172)
  • Fix crash when setup fails with --rerun-except flag. (#230)

12.0 (2023-07-05)

Breaking changes

  • Drop support for pytest < 6.2.

Features

  • Add only_rerun and rerun_except arguments to @pytest.mark.flaky marker.
  • Add support for pytest 7.3, 7.4.

Bug fixes

  • Failures are now rerun only if they match at least one --only-rerun pattern (if given) and none of the --rerun-except patterns. Previously, using both --only-rerun and --rerun-except together could cause failures to be rerun even if they did not match any --only-rerun pattern, and when using multiple --rerun-except patterns, all failures would be rerun unless they matched every pattern. (#225)

11.1.2 (2023-03-09)

Bug fixes

  • Execute teardown when test was skipped in setup phase of a fixture.

11.1.1 (2023-02-17)

Bug fixes

  • Fix crash during teardown when runtest protocol hook is overwritten by another plugin.
  • Fix crash during teardown when TestCase class is used as base class.

11.1 (2023-02-09)

Bug fixes

  • Run teardown of session, class, ... scoped fixtures only once after rerunning tests

Features

  • Expose reruns and reruns_delay through pytest.ini file.

11.0 (2023-01-12)

Breaking changes

  • Drop support for Python 3.6.
  • Drop support for pytest < 6.

Bug fixes

  • Fix crash when pytest-xdist is installed but disabled. (Thanks to @mgorny for the PR.)
  • Fix crash when xfail(strict=True) mark is used with --rerun-only flag.

Features

  • Added option --rerun-except to rerun failed tests those are other than the mentioned Error.
  • Add support for Python 3.11.
  • Add support for pytest 7.0, 7.1, 7.2.

10.2 (2021-09-17)

Features

  • Allow recovery from crashed tests with pytest-xdist.
  • Add support for Python 3.10 (as of Python 3.10.rc2). (Thanks to @hugovk for the PR.)

10.1 (2021-07-02)

Features

  • Allows using a str as condition for @pytest.mark.flaky(condition) which gets evaluated dynamically similarly to @pytest.mark.skipif(condition). (#162 provided by @15klli)

10.0 (2021-05-26)

Backwards incompatible changes

  • Drop support for Python 3.5.
  • Drop support for pytest < 5.3.

Features

  • Add condition keyword argument to the re-run marker. (Thanks to @BeyondEvil for the PR.)
  • Add support for Python 3.9. (Thanks to @digitronik for the PR.)
  • Add support for pytest 6.3. (Thanks to @bluetech for the PR.)
  • Add compatibility with pytest-xdist >= 2.0. (Thanks to @bluetech for the PR.)

Other changes

  • Check for the resultlog by feature and not by version as pytest master does not provide a consistent version.

9.1.1 (2020-09-29)

Compatibility fix.

  • Ignore --result-log command line option when used together with pytest >= 6.1.0, as it was removed there. This is a quick fix, use an older version of pytest, if you want to keep this feature for now. (Thanks to @ntessore for the PR)
  • Support up to pytest 6.1.0.

9.1 (2020-08-26)

Features

  • Add a new flag --only-rerun to allow for users to rerun only certain errors.

Other changes

  • Drop dependency on mock.
  • Add support for pre-commit and add a linting tox target. (#117) (PR from @gnikonorov)

9.0 (2020-03-18)

Backwards incompatible changes

  • Drop support for pytest version 4.4, 4.5 and 4.6.
  • Drop support for Python 2.7.

Features

  • Add support for pytest 5.4.
  • Add support for Python 3.8.

8.0 (2019-11-18)

Backwards incompatible changes

  • Drop support for pytest version 3.10, 4.0, 4.1, 4.2 and 4.3
  • Drop support for Python 3.4.

Features

  • Add support for pytest version 4.4, 4.5, 4.6, 5.0, 5.1 and 5.2.

Bug fixes

  • Explicitly depend on setuptools to ensure installation when working in environments without it. (#98) (PR from @Eric-Arellano)

7.0 (2019-03-28)

Backwards incompatible changes

  • Drop support for pytest version 3.8 and 3.9.

Features

  • Add support for pytest version 4.2 and 4.3.

Bug fixes

  • Fixed #83 issue about ignored pytest_runtest_logfinish hooks. (#83) (PR from @KillAChicken)

6.0 (2019-01-08)

Backwards incompatible changes

  • Drop support for pytest version 3.6 and 3.7.

Features

  • Add support for pytest version 4.0 and 4.1.

Bug fixes

  • Fixed #77 regression issue introduced in 4.2 related to the rerun attribute on the test report. (#77) (Thanks to @RibeiroAna for the PR).

5.0 (2018-11-06)

  • Drop support for pytest versions < 3.6 to reduce the maintenance burden.
  • Add support up to pytest version 3.10. Thus supporting the newest 5 pytest releases.
  • Add support for Python 3.7.
  • Fix issue can occur when used together with pytest-flake8 (#73)

4.2 (2018-10-04)

  • Fixed #64 issue related to setup_class and fixture executions on rerun (Thanks to @OlegKuzovkov for the PR).
  • Added new execution_count attribute to reflect the number of test case executions according to #67 issue. (Thanks to @OlegKuzovkov for the PR).

4.1 (2018-05-23)

  • Add support for pytest 3.6 by using Node.get_closest_marker() (Thanks to @The-Compiler for the PR).

4.0 (2017-12-23)

  • Added option to add a delay time between test re-runs (Thanks to @Kanguros for the PR).
  • Added support for pytest >= 3.3.
  • Drop support for pytest < 2.8.7.

3.1 (2017-08-29)

  • Restored compatibility with pytest-xdist. (Thanks to @davehunt for the PR)

3.0 (2017-08-17)

  • Add support for Python 3.6.
  • Add support for pytest 2.9 up to 3.2
  • Drop support for Python 2.6 and 3.3.
  • Drop support for pytest < 2.7.

2.2 (2017-06-23)

  • Ensure that other plugins can run after this one, in case of a global setting --rerun=0. (Thanks to @sublee for the PR)

2.1.0 (2016-11-01)

  • Add default value of reruns=1 if pytest.mark.flaky() is called without arguments.
  • Also offer a distribution as universal wheel. (Thanks to @tltx for the PR)

2.0.1 (2016-08-10)

  • Prepare CLI options to pytest 3.0, to avoid a deprecation warning.
  • Fix error due to missing CHANGES.rst when creating the source distribution by adding a MANIFEST.in.

2.0.0 (2016-04-06)

  • Drop support for Python 3.2, since supporting it became too much of a hassle. (Reason: Virtualenv 14+ / PIP 8+ do not support Python 3.2 anymore.)

1.0.2 (2016-03-29)

  • Add support for --resultlog option by parsing reruns accordingly. (#28)

1.0.1 (2016-02-02)

  • Improve package description and include CHANGELOG into description.

1.0.0 (2016-02-02)

  • Rewrite to use newer API of pytest >= 2.3.0
  • Improve support for pytest-xdist by only logging the final result. (Logging intermediate results will finish the test rather rerunning it.)