Sourcing python-remove-tests-dir-hook Sourcing python-catch-conflicts-hook.sh Sourcing python-remove-bin-bytecode-hook.sh Sourcing setuptools-build-hook Using setuptoolsBuildPhase Using setuptoolsShellHook Sourcing pip-install-hook Using pipInstallPhase Sourcing python-imports-check-hook.sh Using pythonImportsCheckPhase Sourcing python-namespaces-hook Sourcing setuptools-check-hook @nix { "action": "setPhase", "phase": "unpackPhase" } unpacking sources unpacking source archive /nix/store/dw4pkvwl98jh2iqx3pxx7jf3bj8001i2-flaky-3.7.0.tar.gz source root is flaky-3.7.0 setting SOURCE_DATE_EPOCH to timestamp 1594243919 of file flaky-3.7.0/setup.cfg @nix { "action": "setPhase", "phase": "patchPhase" } patching sources @nix { "action": "setPhase", "phase": "configurePhase" } configuring no configure script, doing nothing @nix { "action": "setPhase", "phase": "buildPhase" } building Executing setuptoolsBuildPhase running bdist_wheel running build running build_py creating build creating build/lib creating build/lib/flaky copying flaky/defaults.py -> build/lib/flaky copying flaky/names.py -> build/lib/flaky copying flaky/multiprocess_string_io.py -> build/lib/flaky copying flaky/flaky_nose_plugin.py -> build/lib/flaky copying flaky/flaky_decorator.py -> build/lib/flaky copying flaky/__init__.py -> build/lib/flaky copying flaky/utils.py -> build/lib/flaky copying flaky/flaky_pytest_plugin.py -> build/lib/flaky copying flaky/_flaky_plugin.py -> build/lib/flaky installing to build/bdist.linux-x86_64/wheel running install running install_lib creating build/bdist.linux-x86_64 creating build/bdist.linux-x86_64/wheel creating build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/defaults.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/names.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/multiprocess_string_io.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/flaky_nose_plugin.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/flaky_decorator.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/__init__.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/utils.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/flaky_pytest_plugin.py -> build/bdist.linux-x86_64/wheel/flaky copying build/lib/flaky/_flaky_plugin.py -> build/bdist.linux-x86_64/wheel/flaky running install_egg_info running egg_info writing flaky.egg-info/PKG-INFO writing dependency_links to flaky.egg-info/dependency_links.txt writing entry points to flaky.egg-info/entry_points.txt writing top-level names to flaky.egg-info/top_level.txt reading manifest file 'flaky.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' adding license file 'LICENSE' writing manifest file 'flaky.egg-info/SOURCES.txt' Copying flaky.egg-info to build/bdist.linux-x86_64/wheel/flaky-3.7.0-py3.7.egg-info running install_scripts adding license file "LICENSE" (matched pattern "LICEN[CS]E*") creating build/bdist.linux-x86_64/wheel/flaky-3.7.0.dist-info/WHEEL creating 'dist/flaky-3.7.0-py2.py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it adding 'flaky/__init__.py' adding 'flaky/_flaky_plugin.py' adding 'flaky/defaults.py' adding 'flaky/flaky_decorator.py' adding 'flaky/flaky_nose_plugin.py' adding 'flaky/flaky_pytest_plugin.py' adding 'flaky/multiprocess_string_io.py' adding 'flaky/names.py' adding 'flaky/utils.py' adding 'flaky-3.7.0.dist-info/LICENSE' adding 'flaky-3.7.0.dist-info/METADATA' adding 'flaky-3.7.0.dist-info/WHEEL' adding 'flaky-3.7.0.dist-info/entry_points.txt' adding 'flaky-3.7.0.dist-info/top_level.txt' adding 'flaky-3.7.0.dist-info/RECORD' removing build/bdist.linux-x86_64/wheel Finished executing setuptoolsBuildPhase @nix { "action": "setPhase", "phase": "installPhase" } installing Executing pipInstallPhase /build/flaky-3.7.0/dist /build/flaky-3.7.0 Processing ./flaky-3.7.0-py2.py3-none-any.whl Installing collected packages: flaky Successfully installed flaky-3.7.0 /build/flaky-3.7.0 Finished executing pipInstallPhase @nix { "action": "setPhase", "phase": "fixupPhase" } post-installation fixup shrinking RPATHs of ELF executables and libraries in /nix/store/l9mwnf7sq7w0mzv44bvvlllgnahk24zl-python3.7-flaky-3.7.0 strip is /nix/store/v8imx1nvyz0hgvx9cbcmh6gp4ngw3ffj-binutils-2.35.1/bin/strip stripping (with command strip and flags -S) in /nix/store/l9mwnf7sq7w0mzv44bvvlllgnahk24zl-python3.7-flaky-3.7.0/lib patching script interpreter paths in /nix/store/l9mwnf7sq7w0mzv44bvvlllgnahk24zl-python3.7-flaky-3.7.0 checking for references to /build/ in /nix/store/l9mwnf7sq7w0mzv44bvvlllgnahk24zl-python3.7-flaky-3.7.0... Executing pythonRemoveTestsDir Finished executing pythonRemoveTestsDir @nix { "action": "setPhase", "phase": "installCheckPhase" } running install tests ============================= test session starts ============================== platform linux -- Python 3.7.11, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 rootdir: /build/flaky-3.7.0 plugins: flaky-3.7.0 collecting ...  collected 70 items / 52 deselected / 18 selected  test/test_pytest/test_pytest_example.py ..xx.x...s......s [ 88%] test/test_pytest/pytest_generate_example/test_pytest_generate_example.py  [ 94%] . [100%]. [100%] ===Flaky Test Report=== test_something_flaky failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_something_flaky passed 1 out of the required 1 times. Success! test_something_good_with_failing_setup_fixture failed (1 runs remaining out of 2). assert False [] test_something_good_with_failing_setup_fixture failed; it passed 0 out of the required 1 times. assert False [] test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3). assert 0 >= 1 + where 0 = TestExample._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 2 times. Running test again until it passes 2 times. test_flaky_thing_that_fails_then_succeeds passed 2 out of the required 2 times. Success! test_flaky_thing_that_succeeds_then_fails_then_succeeds passed 1 out of the required 2 times. Running test again until it passes 2 times. test_flaky_thing_that_succeeds_then_fails_then_succeeds passed 2 out of the required 2 times. Success! test_flaky_thing_that_always_passes passed 1 out of the required 2 times. Running test again until it passes 2 times. test_flaky_thing_that_always_passes passed 2 out of the required 2 times. Success! test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExampleFlakyTests._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExampleFlakyTestCase._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestMarkedClass._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_requiring_my_fixture failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_requiring_my_fixture passed 1 out of the required 1 times. Success! test_something_flaky failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExampleRerunFilter._threshold [] test_something_flaky passed 1 out of the required 1 times. Success! test_something_flaky[dummy_list0] failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_something_flaky[dummy_list0] passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds[dummy_list0] failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExample._threshold [] test_flaky_thing_that_fails_then_succeeds[dummy_list0] passed 1 out of the required 1 times. Success! ===End Flaky Test Report=== =========== 14 passed, 2 skipped, 52 deselected, 3 xfailed in 0.36s ============ ============================= test session starts ============================== platform linux -- Python 3.7.11, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 rootdir: /build/flaky-3.7.0 plugins: flaky-3.7.0 collecting ...  collected 69 items / 52 deselected / 17 selected  test/test_pytest/test_pytest_example.py .xx.x...s......s [ 88%] test/test_pytest/pytest_generate_example/test_pytest_generate_example.py  [ 94%] . [100%]. [100%] ===Flaky Test Report=== test_something_flaky failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_something_flaky passed 1 out of the required 1 times. Success! test_something_good_with_failing_setup_fixture failed (1 runs remaining out of 2). assert False [] test_something_good_with_failing_setup_fixture failed; it passed 0 out of the required 1 times. assert False [] test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3). assert 0 >= 1 + where 0 = TestExample._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 2 times. Running test again until it passes 2 times. test_flaky_thing_that_fails_then_succeeds passed 2 out of the required 2 times. Success! test_flaky_thing_that_succeeds_then_fails_then_succeeds passed 1 out of the required 2 times. Running test again until it passes 2 times. test_flaky_thing_that_succeeds_then_fails_then_succeeds passed 2 out of the required 2 times. Success! test_flaky_thing_that_always_passes passed 1 out of the required 2 times. Running test again until it passes 2 times. test_flaky_thing_that_always_passes passed 2 out of the required 2 times. Success! test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExampleFlakyTests._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExampleFlakyTestCase._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestMarkedClass._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_requiring_my_fixture failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_requiring_my_fixture passed 1 out of the required 1 times. Success! test_something_flaky failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExampleRerunFilter._threshold [] test_something_flaky passed 1 out of the required 1 times. Success! test_something_flaky[dummy_list0] failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_something_flaky[dummy_list0] passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds[dummy_list0] failed (1 runs remaining out of 2). assert 0 >= 1 + where 0 = TestExample._threshold [] test_flaky_thing_that_fails_then_succeeds[dummy_list0] passed 1 out of the required 1 times. Success! ===End Flaky Test Report=== =========== 13 passed, 2 skipped, 52 deselected, 3 xfailed in 0.34s ============ ============================= test session starts ============================== platform linux -- Python 3.7.11, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 rootdir: /build/flaky-3.7.0 collecting ...  collected 48 items  test/test_pytest/test_flaky_pytest_plugin.py ........................... [ 56%] ..................... [100%] ============================== 48 passed in 0.33s ============================== ... ===Flaky Test Report=== test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3).Traceback (most recent call last): File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 59, in testPartExecutor yield File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 628, in run testMethod() File "/build/flaky-3.7.0/test/test_nose/test_nose_options_example.py", line 54, in test_flaky_thing_that_fails_then_succeeds raise Exception("Threshold is not high enough.") Exception: Threshold is not high enough. test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3).Traceback (most recent call last): File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 59, in testPartExecutor yield File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 628, in run testMethod() File "/build/flaky-3.7.0/test/test_nose/test_nose_options_example.py", line 38, in test_flaky_thing_that_fails_then_succeeds raise Exception("Threshold is not high enough.") Exception: Threshold is not high enough. test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 3).Traceback (most recent call last): File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 59, in testPartExecutor yield File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 628, in run testMethod() File "/build/flaky-3.7.0/test/test_nose/test_nose_options_example.py", line 38, in test_flaky_thing_that_fails_then_succeeds raise Exception("Threshold is not high enough.") Exception: Threshold is not high enough. test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_something_flaky failed (1 runs remaining out of 2).Traceback (most recent call last): File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 59, in testPartExecutor yield File "/nix/store/4z7d194syfyp4ghacl4fbd61q4a13kyn-python3-3.7.11/lib/python3.7/unittest/case.py", line 628, in run testMethod() File "/build/flaky-3.7.0/test/test_nose/test_nose_options_example.py", line 26, in test_something_flaky raise Exception("Threshold is not high enough.") Exception: Threshold is not high enough. test_something_flaky passed 1 out of the required 1 times. Success! ===End Flaky Test Report=== ---------------------------------------------------------------------- Ran 3 tests in 0.002s OK ============================= test session starts ============================== platform linux -- Python 3.7.11, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 rootdir: /build/flaky-3.7.0 plugins: flaky-3.7.0 collecting ...  collected 3 items  test/test_pytest/test_pytest_options_example.py .. [100%] [100%]. [100%] ===Flaky Test Report=== test_something_flaky failed (1 runs remaining out of 2). assert 1 > 1 + where 1 = len([0]) [] test_something_flaky passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3). assert -1 >= 1 + where -1 = TestExample._threshold [] test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 3). assert 0 >= 1 + where 0 = TestExample._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! test_flaky_thing_that_fails_then_succeeds failed (2 runs remaining out of 3). assert -1 >= 1 + where -1 = TestExampleFlakyTests._threshold [] test_flaky_thing_that_fails_then_succeeds failed (1 runs remaining out of 3). assert 0 >= 1 + where 0 = TestExampleFlakyTests._threshold [] test_flaky_thing_that_fails_then_succeeds passed 1 out of the required 1 times. Success! ===End Flaky Test Report=== ============================== 3 passed in 0.12s =============================== @nix { "action": "setPhase", "phase": "pythonCatchConflictsPhase" } pythonCatchConflictsPhase @nix { "action": "setPhase", "phase": "pythonRemoveBinBytecodePhase" } pythonRemoveBinBytecodePhase @nix { "action": "setPhase", "phase": "pythonImportsCheckPhase" } pythonImportsCheckPhase Executing pythonImportsCheckPhase @nix { "action": "setPhase", "phase": "pytestcachePhase" } pytestcachePhase