gh-119050: Add XML support to libregrtest refleak checker #119148
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
regrtest test runner: Add XML support to the refleak checker (-R option). * run_unittest() now stores XML elements as string, rather than objects, in support.junit_xml_list. * runtest_refleak() now saves/restores XML strings before/after checking for reference leaks. Save XML into a temporary file.
|
@Eclips4 @serhiy-storchaka: Would you mind to review my change? When tests are run in parallel, each process is run in its own temporary directory. The temporary XML file is simply created in the current working directory. There is no risk of overriding the file between two processes. |
|
Thanks Victor for writing this PR! I've tested it locally and it seems there's something wrong: ./python.exe -m test --junit-xml xml.out -R 3:3 -j 8
... Many lines
Traceback (most recent call last):
File "/Users/admin/Projects/cpython/Lib/runpy.py", line 198, in _run_module_as_main
return _run_code(code, main_globals, None,
"__main__", mod_spec)
File "/Users/admin/Projects/cpython/Lib/runpy.py", line 88, in _run_code
exec(code, run_globals)
~~~~^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/__main__.py", line 2, in <module>
main(_add_python_opts=True)
~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 739, in main
Regrtest(ns, _add_python_opts=_add_python_opts).main(tests=tests)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 731, in main
exitcode = self.run_tests(selected, tests)
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 568, in run_tests
return self._run_tests(selected, tests)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 528, in _run_tests
self._run_tests_mp(runtests, self.num_workers)
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 426, in _run_tests_mp
RunWorkers(num_workers, runtests, self.logger, self.results).run()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/run_workers.py", line 600, in run
result = self._process_result(item)
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/run_workers.py", line 571, in _process_result
self.results.accumulate_result(result, self.runtests)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/results.py", line 132, in accumulate_result
self.add_junit(xml_data)
~~~~~~~~~~~~~~^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/results.py", line 165, in add_junit
self.testsuite_xml.append(ET.fromstring(e))
~~~~~~~~~~~~~^^^
File "/Users/admin/Projects/cpython/Lib/xml/etree/ElementTree.py", line 1343, in XML
return parser.close()
~~~~~~~~~~~~^^
xml.etree.ElementTree.ParseError: no element found: line 1, column 5239Full output: ./python.exe -m test --junit-xml out.xml -R 3:3 -j 8
== CPython 3.14.0a0 (heads/regrtest_xml:30ee2285ca, May 18 2024, 22:43:31) [Clang 15.0.0 (clang-1500.3.9.4)]
== macOS-14.5-arm64-arm-64bit-Mach-O little-endian
== Python build: debug
== cwd: /Users/admin/Projects/cpython/build/test_python_worker_21561æ
== CPU count: 8
== encodings: locale=UTF-8 FS=utf-8
== resources: all test resources are disabled, use -u option to unskip tests
Using random seed: 360681540
0:00:00 load avg: 5.52 Run 477 tests in parallel using 8 worker processes
0:00:00 load avg: 5.52 [ 1/477] test.test_asyncio.test_buffered_proto passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:00 load avg: 5.52 [ 2/477] test.test_asyncio.test_futures2 passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 ...
0:00:01 load avg: 5.52 [ 3/477] test.test_asyncio.test_context passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:01 load avg: 5.52 [ 4/477] test.test_asyncio.test_pep492 passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ..1
test.test_asyncio.test_pep492 leaked [0, 0, 1] memory blocks, sum=1 (this is fine)
0:00:02 load avg: 5.52 [ 5/477] test.test_asyncio.test_protocols passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:03 load avg: 5.52 [ 6/477] test.test_asyncio.test_proactor_events passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:04 load avg: 5.64 [ 7/477] test.test_asyncio.test_runners passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:06 load avg: 5.64 [ 8/477] test.test_asyncio.test_selector_events passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 ...
0:00:06 load avg: 5.64 [ 9/477] test.test_asyncio.test_queues passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:06 load avg: 5.64 [ 10/477] test.test_asyncio.test_eager_task_factory passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 .1.
test.test_asyncio.test_eager_task_factory leaked [-1, 1, -1] memory blocks, sum=-1 (this is fine)
0:00:09 load avg: 5.91 [ 11/477] test.test_asyncio.test_server passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:09 load avg: 5.91 [ 12/477] test.test_asyncio.test_locks passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:13 load avg: 5.91 [ 13/477] test.test_asyncio.test_base_events passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:15 load avg: 5.76 [ 14/477] test.test_asyncio.test_streams passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:18 load avg: 5.76 [ 15/477] test.test_asyncio.test_sendfile passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 ...
test.test_asyncio.test_sendfile leaked [0, 0, -1] memory blocks, sum=-1 (this is fine)
0:00:21 load avg: 5.38 [ 16/477] test.test_asyncio.test_futures passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:21 load avg: 5.38 [ 17/477] test.test_asyncio.test_threads passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 ...
0:00:23 load avg: 5.38 [ 18/477] test.test_asyncio.test_sock_lowlevel passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 ..1
test.test_asyncio.test_sock_lowlevel leaked [-1, 0, 1] memory blocks, sum=0 (this is fine)
0:00:23 load avg: 5.38 [ 19/477] test.test_asyncio.test_transports passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:24 load avg: 5.19 [ 20/477] test.test_asyncio.test_timeouts passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:28 load avg: 5.19 [ 21/477] test.test_asyncio.test_unix_events passed
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX2 ...
0:00:28 load avg: 5.19 [ 22/477] test.test_asyncio.test_windows_events skipped
test.test_asyncio.test_windows_events skipped -- Windows only
0:00:29 load avg: 5.01 [ 23/477] test.test_asyncio.test_windows_utils skipped
test.test_asyncio.test_windows_utils skipped -- Windows only
0:00:30 load avg: 5.01 [ 24/477] test.test_asyncio.test_waitfor passed -- running (1): test.test_asyncio.test_events (30.7 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:34 load avg: 4.69 [ 25/477] test.test_asyncio.test_sslproto passed -- running (1): test.test_asyncio.test_events (34.5 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX1 ...
0:00:49 load avg: 5.40 [ 26/477] test.test_asyncio.test_ssl passed (42.4 sec) -- running (4): test.test_asyncio.test_subprocess (36.0 sec), test.test_asyncio.test_tasks (30.9 sec), test.test_asyncio.test_events (49.3 sec), test.test_asyncio.test_taskgroups (34.0 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:52 load avg: 5.40 [ 27/477] test.test_asyncio.test_taskgroups passed (37.1 sec) -- running (3): test.test_asyncio.test_subprocess (39.1 sec), test.test_asyncio.test_tasks (34.0 sec), test.test_asyncio.test_events (52.4 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:00:53 load avg: 5.40 [ 28/477] test.test_concurrent_futures.test_future passed -- running (3): test.test_asyncio.test_subprocess (39.7 sec), test.test_asyncio.test_tasks (34.6 sec), test.test_asyncio.test_events (53.0 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ..1
test.test_concurrent_futures.test_future leaked [0, 0, 1] memory blocks, sum=1 (this is fine)
0:00:59 load avg: 6.38 [ 29/477] test.test_concurrent_futures.test_init passed -- running (4): test.test_asyncio.test_subprocess (45.9 sec), test.test_concurrent_futures.test_as_completed (30.1 sec), test.test_asyncio.test_tasks (40.8 sec), test.test_asyncio.test_events (59.2 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
/Users/admin/Projects/cpython/Lib/multiprocessing/resource_tracker.py:276: UserWarning: resource_tracker: There appear to be 6 leaked semaphore objects to clean up at shutdown: {'/mp-cxgv2mh2', '/mp-bmtx0jx_', '/mp-0cxkxijc', '/mp-9__vmdga', '/mp-ctcuaahn', '/mp-xssatz4s'}
warnings.warn(
X/Users/admin/Projects/cpython/Lib/multiprocessing/resource_tracker.py:276: UserWarning: resource_tracker: There appear to be 6 leaked semaphore objects to clean up at shutdown: {'/mp-s_enah44', '/mp-92ulzzud', '/mp-0fnfaqv4', '/mp-_hl3uzp0', '/mp-ywdk8v9k', '/mp-72k_lz88'}
warnings.warn(
X/Users/admin/Projects/cpython/Lib/multiprocessing/resource_tracker.py:276: UserWarning: resource_tracker: There appear to be 6 leaked semaphore objects to clean up at shutdown: {'/mp-0rtjl_xk', '/mp-q2tbv__y', '/mp-k3lx8xya', '/mp-hkvp6rl_', '/mp-y6k9n8u0', '/mp-oa7we0mx'}
warnings.warn(
./Users/admin/Projects/cpython/Lib/multiprocessing/resource_tracker.py:276: UserWarning: resource_tracker: There appear to be 6 leaked semaphore objects to clean up at shutdown: {'/mp-fte3vwka', '/mp-19nou5dh', '/mp-3heiifww', '/mp-v05j4urq', '/mp-05bvy6q7', '/mp-ol3d1zk1'}
warnings.warn(
1/Users/admin/Projects/cpython/Lib/multiprocessing/resource_tracker.py:276: UserWarning: resource_tracker: There appear to be 6 leaked semaphore objects to clean up at shutdown: {'/mp-ojy6xkih', '/mp-xef7sw_l', '/mp-m57s4dho', '/mp-huw80dz1', '/mp-es7s4o_w', '/mp-eqkb2w9q'}
warnings.warn(
2/Users/admin/Projects/cpython/Lib/multiprocessing/resource_tracker.py:276: UserWarning: resource_tracker: There appear to be 6 leaked semaphore objects to clean up at shutdown: {'/mp-51pdt_8k', '/mp-fvj1a4zb', '/mp-2y7_8yp0', '/mp-euv_kj0d', '/mp-szhgpu23', '/mp-7or6gaz1'}
warnings.warn(
.
test.test_concurrent_futures.test_init leaked [1, 2, 0] memory blocks, sum=3 (this is fine)
0:01:01 load avg: 6.38 [ 30/477] test.test_concurrent_futures.test_thread_pool passed -- running (5): test.test_asyncio.test_subprocess (48.4 sec), test.test_concurrent_futures.test_as_completed (32.7 sec), test.test_asyncio.test_tasks (43.3 sec), test.test_asyncio.test_events (1 min 1 sec), test.test_concurrent_futures.test_deadlock (31.0 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:05 load avg: 7.87 [ 31/477] test.test_asyncio.test_subprocess passed (52.2 sec) -- running (4): test.test_concurrent_futures.test_as_completed (36.5 sec), test.test_asyncio.test_tasks (47.2 sec), test.test_asyncio.test_events (1 min 5 sec), test.test_concurrent_futures.test_deadlock (34.9 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:06 load avg: 7.87 [ 32/477] test.test_future_stmt.test_future passed -- running (4): test.test_concurrent_futures.test_as_completed (37.5 sec), test.test_asyncio.test_tasks (48.2 sec), test.test_asyncio.test_events (1 min 6 sec), test.test_concurrent_futures.test_deadlock (35.9 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:06 load avg: 7.87 [ 33/477] test.test_future_stmt.test_future_flags passed -- running (4): test.test_concurrent_futures.test_as_completed (37.9 sec), test.test_asyncio.test_tasks (48.6 sec), test.test_asyncio.test_events (1 min 6 sec), test.test_concurrent_futures.test_deadlock (36.2 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:07 load avg: 7.87 [ 34/477] test.test_future_stmt.test_future_multiple_features passed -- running (4): test.test_concurrent_futures.test_as_completed (38.2 sec), test.test_asyncio.test_tasks (48.8 sec), test.test_asyncio.test_events (1 min 7 sec), test.test_concurrent_futures.test_deadlock (36.5 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:07 load avg: 7.87 [ 35/477] test.test_future_stmt.test_future_multiple_imports passed -- running (4): test.test_concurrent_futures.test_as_completed (38.5 sec), test.test_asyncio.test_tasks (49.2 sec), test.test_asyncio.test_events (1 min 7 sec), test.test_concurrent_futures.test_deadlock (36.9 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:07 load avg: 7.87 [ 36/477] test.test_future_stmt.test_future_single_import passed -- running (4): test.test_concurrent_futures.test_as_completed (38.8 sec), test.test_asyncio.test_tasks (49.5 sec), test.test_asyncio.test_events (1 min 7 sec), test.test_concurrent_futures.test_deadlock (37.1 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:07 load avg: 7.87 [ 37/477] test.test_gdb.test_backtrace skipped -- running (4): test.test_concurrent_futures.test_as_completed (38.9 sec), test.test_asyncio.test_tasks (49.6 sec), test.test_asyncio.test_events (1 min 7 sec), test.test_concurrent_futures.test_deadlock (37.3 sec)
test.test_gdb.test_backtrace skipped -- Couldn't find gdb program on the path: [Errno 2] No such file or directory: 'gdb'
0:01:08 load avg: 7.87 [ 38/477] test.test_gdb.test_cfunction skipped -- running (4): test.test_concurrent_futures.test_as_completed (39.1 sec), test.test_asyncio.test_tasks (49.7 sec), test.test_asyncio.test_events (1 min 8 sec), test.test_concurrent_futures.test_deadlock (37.4 sec)
test.test_gdb.test_cfunction skipped -- Couldn't find gdb program on the path: [Errno 2] No such file or directory: 'gdb'
0:01:08 load avg: 7.87 [ 39/477] test.test_gdb.test_cfunction_full skipped -- running (4): test.test_concurrent_futures.test_as_completed (39.3 sec), test.test_asyncio.test_tasks (50.0 sec), test.test_asyncio.test_events (1 min 8 sec), test.test_concurrent_futures.test_deadlock (37.7 sec)
test.test_gdb.test_cfunction_full skipped -- Couldn't find gdb program on the path: [Errno 2] No such file or directory: 'gdb'
0:01:08 load avg: 7.87 [ 40/477] test.test_gdb.test_misc skipped -- running (4): test.test_concurrent_futures.test_as_completed (39.5 sec), test.test_asyncio.test_tasks (50.1 sec), test.test_asyncio.test_events (1 min 8 sec), test.test_concurrent_futures.test_deadlock (37.8 sec)
test.test_gdb.test_misc skipped -- Couldn't find gdb program on the path: [Errno 2] No such file or directory: 'gdb'
0:01:08 load avg: 7.87 [ 41/477] test.test_gdb.test_pretty_print skipped -- running (4): test.test_concurrent_futures.test_as_completed (39.7 sec), test.test_asyncio.test_tasks (50.4 sec), test.test_asyncio.test_events (1 min 8 sec), test.test_concurrent_futures.test_deadlock (38.1 sec)
test.test_gdb.test_pretty_print skipped -- Couldn't find gdb program on the path: [Errno 2] No such file or directory: 'gdb'
0:01:17 load avg: 7.74 [ 42/477] test.test_inspect.test_inspect passed -- running (4): test.test_concurrent_futures.test_as_completed (48.9 sec), test.test_asyncio.test_tasks (59.6 sec), test.test_asyncio.test_events (1 min 17 sec), test.test_concurrent_futures.test_deadlock (47.3 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
X4. ..1
test.test_inspect.test_inspect leaked [0, 0, 1] memory blocks, sum=1 (this is fine)
0:01:18 load avg: 7.74 [ 43/477] test.test_multiprocessing_fork.test_manager skipped -- running (4): test.test_concurrent_futures.test_as_completed (49.0 sec), test.test_asyncio.test_tasks (59.7 sec), test.test_asyncio.test_events (1 min 18 sec), test.test_concurrent_futures.test_deadlock (47.4 sec)
test.test_multiprocessing_fork.test_manager skipped -- test may crash on macOS (bpo-33725)
0:01:18 load avg: 7.74 [ 44/477] test.test_multiprocessing_fork.test_misc skipped -- running (4): test.test_concurrent_futures.test_as_completed (49.2 sec), test.test_asyncio.test_tasks (59.9 sec), test.test_asyncio.test_events (1 min 18 sec), test.test_concurrent_futures.test_deadlock (47.5 sec)
test.test_multiprocessing_fork.test_misc skipped -- test may crash on macOS (bpo-33725)
0:01:18 load avg: 7.74 [ 45/477] test.test_multiprocessing_fork.test_processes skipped -- running (4): test.test_concurrent_futures.test_as_completed (49.3 sec), test.test_asyncio.test_tasks (1 min), test.test_asyncio.test_events (1 min 18 sec), test.test_concurrent_futures.test_deadlock (47.7 sec)
test.test_multiprocessing_fork.test_processes skipped -- test may crash on macOS (bpo-33725)
0:01:18 load avg: 7.74 [ 46/477] test.test_multiprocessing_fork.test_threads skipped -- running (4): test.test_concurrent_futures.test_as_completed (49.7 sec), test.test_asyncio.test_tasks (1 min), test.test_asyncio.test_events (1 min 18 sec), test.test_concurrent_futures.test_deadlock (48.0 sec)
test.test_multiprocessing_fork.test_threads skipped -- test may crash on macOS (bpo-33725)
0:01:35 load avg: 10.05 [ 47/477] test.test_concurrent_futures.test_process_pool passed (42.7 sec) -- running (6): test.test_concurrent_futures.test_as_completed (1 min 6 sec), test.test_asyncio.test_tasks (1 min 16 sec), test.test_concurrent_futures.test_wait (33.4 sec), test.test_asyncio.test_events (1 min 35 sec), test.test_concurrent_futures.test_deadlock (1 min 4 sec), test.test_concurrent_futures.test_shutdown (42.1 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:01:55 load avg: 13.36 [ 48/477] test.test_asyncio.test_events passed (1 min 55 sec) -- running (6): test.test_multiprocessing_forkserver.test_manager (36.8 sec), test.test_concurrent_futures.test_as_completed (1 min 26 sec), test.test_asyncio.test_tasks (1 min 37 sec), test.test_concurrent_futures.test_wait (53.8 sec), test.test_concurrent_futures.test_deadlock (1 min 24 sec), test.test_concurrent_futures.test_shutdown (1 min 2 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. .1.
test.test_asyncio.test_events leaked [0, 1, 0] memory blocks, sum=1 (this is fine)
0:01:57 load avg: 13.36 [ 49/477] test.test_concurrent_futures.test_as_completed passed (1 min 28 sec) -- running (5): test.test_multiprocessing_forkserver.test_manager (38.8 sec), test.test_asyncio.test_tasks (1 min 39 sec), test.test_concurrent_futures.test_wait (55.8 sec), test.test_concurrent_futures.test_deadlock (1 min 26 sec), test.test_concurrent_futures.test_shutdown (1 min 4 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. .2.
test.test_concurrent_futures.test_as_completed leaked [-2, 2, 0] memory blocks, sum=0 (this is fine)
0:02:09 load avg: 13.75 [ 50/477] test.test_concurrent_futures.test_deadlock passed (1 min 39 sec) -- running (5): test.test_multiprocessing_forkserver.test_manager (51.1 sec), test.test_asyncio.test_tasks (1 min 51 sec), test.test_concurrent_futures.test_wait (1 min 8 sec), test.test_concurrent_futures.test_shutdown (1 min 16 sec), test.test_multiprocessing_forkserver.test_misc (34.7 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:02:36 load avg: 28.97 [ 51/477] test.test_concurrent_futures.test_shutdown passed (1 min 43 sec) -- running (6): test.test_multiprocessing_forkserver.test_manager (1 min 17 sec), test.test_multiprocessing_forkserver.test_threads (38.5 sec), test.test_asyncio.test_tasks (2 min 17 sec), test.test_concurrent_futures.test_wait (1 min 34 sec), test.test_multiprocessing_forkserver.test_processes (40.5 sec), test.test_multiprocessing_forkserver.test_misc (1 min)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:03:06 load avg: 27.55 running (8): test.test_multiprocessing_forkserver.test_manager (1 min 47 sec), test.test_multiprocessing_forkserver.test_threads (1 min 8 sec), test.test_asyncio.test_tasks (2 min 47 sec), test.test_concurrent_futures.test_wait (2 min 4 sec), test.test_multiprocessing_forkserver.test_processes (1 min 10 sec), test.test_multiprocessing_spawn.test_manager (56.2 sec), test.test_multiprocessing_spawn.test_misc (30.0 sec), test.test_multiprocessing_forkserver.test_misc (1 min 30 sec)
0:03:35 load avg: 25.36 [ 52/477] test.test_multiprocessing_forkserver.test_manager passed (2 min 16 sec) -- running (7): test.test_multiprocessing_forkserver.test_threads (1 min 37 sec), test.test_asyncio.test_tasks (3 min 16 sec), test.test_concurrent_futures.test_wait (2 min 33 sec), test.test_multiprocessing_forkserver.test_processes (1 min 39 sec), test.test_multiprocessing_spawn.test_manager (1 min 25 sec), test.test_multiprocessing_spawn.test_misc (59.3 sec), test.test_multiprocessing_forkserver.test_misc (2 min)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:03:53 load avg: 26.97 [ 53/477] test.test_multiprocessing_forkserver.test_threads passed (1 min 56 sec) -- running (6): test.test_asyncio.test_tasks (3 min 35 sec), test.test_concurrent_futures.test_wait (2 min 52 sec), test.test_multiprocessing_forkserver.test_processes (1 min 58 sec), test.test_multiprocessing_spawn.test_manager (1 min 44 sec), test.test_multiprocessing_spawn.test_misc (1 min 17 sec), test.test_multiprocessing_forkserver.test_misc (2 min 18 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:04:23 load avg: 27.22 running (8): test.test_multiprocessing_spawn.test_processes (48.7 sec), test.test_multiprocessing_spawn.test_threads (30.0 sec), test.test_asyncio.test_tasks (4 min 5 sec), test.test_concurrent_futures.test_wait (3 min 22 sec), test.test_multiprocessing_forkserver.test_processes (2 min 28 sec), test.test_multiprocessing_spawn.test_manager (2 min 14 sec), test.test_multiprocessing_spawn.test_misc (1 min 47 sec), test.test_multiprocessing_forkserver.test_misc (2 min 48 sec)
0:04:30 load avg: 25.56 [ 54/477] test.test_multiprocessing_forkserver.test_misc passed (2 min 55 sec) -- running (7): test.test_multiprocessing_spawn.test_processes (55.0 sec), test.test_multiprocessing_spawn.test_threads (36.4 sec), test.test_asyncio.test_tasks (4 min 11 sec), test.test_concurrent_futures.test_wait (3 min 28 sec), test.test_multiprocessing_forkserver.test_processes (2 min 34 sec), test.test_multiprocessing_spawn.test_manager (2 min 20 sec), test.test_multiprocessing_spawn.test_misc (1 min 54 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:00 load avg: 25.17 [ 55/477] test.test_pydoc.test_pydoc passed -- running (7): test.test_multiprocessing_spawn.test_processes (1 min 24 sec), test.test_multiprocessing_spawn.test_threads (1 min 6 sec), test.test_asyncio.test_tasks (4 min 41 sec), test.test_concurrent_futures.test_wait (3 min 58 sec), test.test_multiprocessing_forkserver.test_processes (3 min 4 sec), test.test_multiprocessing_spawn.test_manager (2 min 50 sec), test.test_multiprocessing_spawn.test_misc (2 min 24 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
X7. 1..
test.test_pydoc.test_pydoc leaked [1, 0, 0] memory blocks, sum=1 (this is fine)
0:05:07 load avg: 27.00 [ 56/477] test.test_concurrent_futures.test_wait passed (4 min 6 sec) -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 32 sec), test.test_multiprocessing_spawn.test_threads (1 min 13 sec), test.test_asyncio.test_tasks (4 min 49 sec), test.test_multiprocessing_forkserver.test_processes (3 min 12 sec), test.test_multiprocessing_spawn.test_manager (2 min 57 sec), test.test_multiprocessing_spawn.test_misc (2 min 31 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:08 load avg: 27.00 [ 57/477] test___all__ passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 32 sec), test.test_multiprocessing_spawn.test_threads (1 min 14 sec), test.test_asyncio.test_tasks (4 min 49 sec), test.test_multiprocessing_forkserver.test_processes (3 min 12 sec), test.test_multiprocessing_spawn.test_manager (2 min 58 sec), test.test_multiprocessing_spawn.test_misc (2 min 32 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:08 load avg: 27.00 [ 58/477] test__colorize passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 33 sec), test.test_multiprocessing_spawn.test_threads (1 min 14 sec), test.test_asyncio.test_tasks (4 min 50 sec), test.test_multiprocessing_forkserver.test_processes (3 min 13 sec), test.test_multiprocessing_spawn.test_manager (2 min 58 sec), test.test_multiprocessing_spawn.test_misc (2 min 32 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:18 load avg: 25.66 [ 59/477] test__interpchannels passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 43 sec), test.test_multiprocessing_spawn.test_threads (1 min 24 sec), test.test_asyncio.test_tasks (5 min), test.test_multiprocessing_forkserver.test_processes (3 min 23 sec), test.test_multiprocessing_spawn.test_manager (3 min 9 sec), test.test_multiprocessing_spawn.test_misc (2 min 42 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:20 load avg: 25.12 [ 60/477] test__locale passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 44 sec), test.test_multiprocessing_spawn.test_threads (1 min 26 sec), test.test_asyncio.test_tasks (5 min 1 sec), test.test_multiprocessing_forkserver.test_processes (3 min 24 sec), test.test_multiprocessing_spawn.test_manager (3 min 10 sec), test.test_multiprocessing_spawn.test_misc (2 min 44 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:20 load avg: 25.12 [ 61/477] test__opcode passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 45 sec), test.test_multiprocessing_spawn.test_threads (1 min 26 sec), test.test_asyncio.test_tasks (5 min 2 sec), test.test_multiprocessing_forkserver.test_processes (3 min 25 sec), test.test_multiprocessing_spawn.test_manager (3 min 10 sec), test.test_multiprocessing_spawn.test_misc (2 min 44 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:23 load avg: 25.12 [ 62/477] test__osx_support passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 48 sec), test.test_multiprocessing_spawn.test_threads (1 min 29 sec), test.test_asyncio.test_tasks (5 min 5 sec), test.test_multiprocessing_forkserver.test_processes (3 min 27 sec), test.test_multiprocessing_spawn.test_manager (3 min 13 sec), test.test_multiprocessing_spawn.test_misc (2 min 47 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:24 load avg: 25.12 [ 63/477] test_abc passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 48 sec), test.test_multiprocessing_spawn.test_threads (1 min 30 sec), test.test_asyncio.test_tasks (5 min 5 sec), test.test_multiprocessing_forkserver.test_processes (3 min 28 sec), test.test_multiprocessing_spawn.test_manager (3 min 14 sec), test.test_multiprocessing_spawn.test_misc (2 min 48 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:24 load avg: 24.31 [ 64/477] test_abstract_numbers passed -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 49 sec), test.test_multiprocessing_spawn.test_threads (1 min 30 sec), test.test_asyncio.test_tasks (5 min 6 sec), test.test_multiprocessing_forkserver.test_processes (3 min 28 sec), test.test_multiprocessing_spawn.test_manager (3 min 14 sec), test.test_multiprocessing_spawn.test_misc (2 min 48 sec)
beginning 6 repetitions. Showing number of leaks (. for 0 or less, X for 10 or more)
123:456
XX. ...
0:05:24 load avg: 24.31 [ 65/477] test_android skipped -- running (6): test.test_multiprocessing_spawn.test_processes (1 min 49 sec), test.test_multiprocessing_spawn.test_threads (1 min 30 sec), test.test_asyncio.test_tasks (5 min 6 sec), test.test_multiprocessing_forkserver.test_processes (3 min 29 sec), test.test_multiprocessing_spawn.test_manager (3 min 15 sec), test.test_multiprocessing_spawn.test_misc (2 min 48 sec)
test_android skipped -- Android-specific
['<testsuite start="2024-05-18 20:09:49.256742" tests="75" errors="0" failures="0"><testcase name="test.test__interpreters.CreateTests.test_after_destroy_all" status="run" result="completed" time="0.118789" /><testcase name="test.test__interpreters.CreateTests.test_after_destroy_some" status="run" result="completed" time="0.233059" /><testcase name="test.test__interpreters.CreateTests.test_in_main" status="run" result="completed" time="0.022532" /><testcase name="test.test__interpreters.CreateTests.test_in_subinterpreter" status="run" result="completed" time="0.108044" /><testcase name="test.test__interpreters.CreateTests.test_in_thread" status="run" result="completed" time="0.019757" /><testcase name="test.test__interpreters.CreateTests.test_in_threaded_subinterpreter" status="run" result="completed" time="0.052147" /><testcase name="test.test__interpreters.CreateTests.test_unique_id" status="run" result="completed" time="0.000011"><skipped>enable this test when working on pystate.c</skipped></testcase><testcase name="test.test__interpreters.DestroyTests.test_all" status="run" result="completed" time="0.071651" /><testcase name="test.test__interpreters.DestroyTests.test_already_destroyed" status="run" result="completed" time="0.023423" /><testcase name="test.test__interpreters.DestroyTests.test_bad_id" status="run" result="completed" time="0.000077" /><testcase name="test.test__interpreters.DestroyTests.test_does_not_exist" status="run" result="completed" time="0.000073" /><testcase name="test.test__interpreters.DestroyTests.test_from_current" status="run" result="completed" time="0.024750" /><testcase name="test.test__interpreters.DestroyTests.test_from_other_thread" status="run" result="completed" time="0.024761" /><testcase name="test.test__interpreters.DestroyTests.test_from_sibling" status="run" result="completed" time="0.039342" /><testcase name="test.test__interpreters.DestroyTests.test_main" status="run" result="completed" time="0.000709" /><testcase name="test.test__interpreters.DestroyTests.test_one" status="run" result="completed" time="0.057025" /><testcase name="test.test__interpreters.DestroyTests.test_still_running" status="run" result="completed" time="0.019557" /><testcase name="test.test__interpreters.GetCurrentTests.test_main" status="run" result="completed" time="0.000112" /><testcase name="test.test__interpreters.GetCurrentTests.test_subinterpreter" status="run" result="completed" time="0.032125" /><testcase name="test.test__interpreters.GetMainTests.test_from_main" status="run" result="completed" time="0.000090" /><testcase name="test.test__interpreters.GetMainTests.test_from_subinterpreter" status="run" result="completed" time="0.029055" /><testcase name="test.test__interpreters.IsRunningTests.test_already_destroyed" status="run" result="completed" time="0.017788" /><testcase name="test.test__interpreters.IsRunningTests.test_bad_id" status="run" result="completed" time="0.000071" /><testcase name="test.test__interpreters.IsRunningTests.test_does_not_exist" status="run" result="completed" time="0.000059" /><testcase name="test.test__interpreters.IsRunningTests.test_from_subinterpreter" status="run" result="completed" time="0.024635" /><testcase name="test.test__interpreters.IsRunningTests.test_main" status="run" result="completed" time="0.000046" /><testcase name="test.test__interpreters.IsRunningTests.test_subinterpreter" status="run" result="completed" time="0.000008"><skipped>Fails on FreeBSD</skipped></testcase><testcase name="test.test__interpreters.IsShareableTests.test_default_shareables" status="run" result="completed" time="0.000162" /><testcase name="test.test__interpreters.IsShareableTests.test_not_shareable" status="run" result="completed" time="0.000205" /><testcase name="test.test__interpreters.ListAllTests.test_after_creating" status="run" result="completed" time="0.046799" /><testcase name="test.test__interpreters.ListAllTests.test_after_destroying" status="run" result="completed" time="0.039628" /><testcase name="test.test__interpreters.ListAllTests.test_initial" status="run" result="completed" time="0.000044" /><testcase name="test.test__interpreters.ModuleTests.test_import_in_interpreter" status="run" result="completed" time="0.025252" /><testcase name="36" status="run" result="completed" time="0.041265" /><testcase name="37" status="run" result="completed" time="0.086217" /><testcase name="38" status="run" result="completed" time="0.074877" /><testcase name="39" status="run" result="completed" time="0.058622" /><testcase name="40" status="run" result="completed" time="0.076665" /><testcase name="41" status="run" result="completed" time="0.044967" /><testcase name="42" status="run" result="completed" time="0.052334" /><testcase name="43" status="run" result="completed" time="0.030462" /><testcase name="44" status="run" result="completed" time="0.035534" /><testcase name="45" status="run" result="completed" time="0.028639" /><testcase name="46" status="run" result="completed" time="0.032708" /><testcase name="47" status="run" result="completed" time="0.027576"><system-out /><system-err /><output type="AssertionError" message="AssertionError: ValueError not raised ">Traceback (most recent call last):', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 58, in testPartExecutor', ' yield', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 651, in run', ' self._callTestMethod(testMethod)', ' ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 606, in _callTestMethod', ' if method() is not None:', ' ~~~~~~^^', ' File "/Users/admin/Projects/cpython/Lib/test/test__interpreters.py", line 1115, in test_return_value', ' with self.assertRaises(ValueError):', ' _interpreters.run_func(self.id, script)', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 263, in __exit__', ' self._raiseFailure("{} not raised".format(exc_name))', ' ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 200, in _raiseFailure', ' raise self.test_case.failureException(msg)', 'AssertionError: ValueError not raised', '</output></testcase><testcase name="48" status="run" result="completed" time="0.029612" /><testcase name="49" status="run" result="completed" time="0.038496" /><testcase name="50" status="run" result="completed" time="0.025856" /><testcase name="51" status="run" result="completed" time="0.031141" /><testcase name="52" status="run" result="completed" time="0.026753" /><testcase name="53" status="run" result="completed" time="0.108883" /><testcase name="56" status="run" result="completed" time="0.061177" /><testcase name="58" status="run" result="completed" time="0.026622" /><testcase name="59" status="run" result="completed" time="0.019501" /><testcase name="60" status="run" result="completed" time="0.048249" /><testcase name="61" status="run" result="completed" time="0.028830" /><testcase name="62" status="run" result="completed" time="0.036559" /><testcase name="63" status="run" result="completed" time="0.060463" /><testcase name="64" status="run" result="completed" time="0.110073" /><testcase name="66" status="run" result="completed" time="0.075128" /><testcase name="68" status="run" result="completed" time="0.107278" /><testcase name="69" status="run" result="completed" time="0.106143" /><testcase name="test.test__interpreters.RunStringTests.test_still_running_at_exit" status="run" result="completed" time="0.000010"><skipped>blocking forever</skipped></testcase><testcase name="70" status="run" result="completed" time="0.050872" /><testcase name="71" status="run" result="completed" time="0.071942" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bool" status="run" result="completed" time="0.000093" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bytes" status="run" result="completed" time="0.003459" /><testcase name="test.test__interpreters.ShareableTypeTests.test_float" status="run" result="completed" time="0.000091" /><testcase name="test.test__interpreters.ShareableTypeTests.test_int" status="run" result="completed" time="0.003976" /><testcase name="test.test__interpreters.ShareableTypeTests.test_non_shareable_int" status="run" result="completed" time="0.000106" /><testcase name="test.test__interpreters.ShareableTypeTests.test_singletons" status="run" result="completed" time="0.000036" /><testcase name="test.test__interpreters.ShareableTypeTests.test_strs" status="run" result="completed" time="0.000068" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuple" status="run" result="completed" time="0.000132" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuples_containing_non_shareable_types" status="run" result="completed" time="0.000124" /><testcase name="test.test__interpreters.ShareableTypeTests.test_types" status="run" result="completed" time="0.000049" /></testsuite>', '<testsuite start="2024-05-18 20:09:51.994596" tests="75" errors="0" failures="0"><testcase name="test.test__interpreters.CreateTests.test_after_destroy_all" status="run" result="completed" time="0.165925" /><testcase name="test.test__interpreters.CreateTests.test_after_destroy_some" status="run" result="completed" time="0.213673" /><testcase name="test.test__interpreters.CreateTests.test_in_main" status="run" result="completed" time="0.050671" /><testcase name="test.test__interpreters.CreateTests.test_in_subinterpreter" status="run" result="completed" time="0.079336" /><testcase name="test.test__interpreters.CreateTests.test_in_thread" status="run" result="completed" time="0.019969" /><testcase name="test.test__interpreters.CreateTests.test_in_threaded_subinterpreter" status="run" result="completed" time="0.052856" /><testcase name="test.test__interpreters.CreateTests.test_unique_id" status="run" result="completed" time="0.000008"><skipped>enable this test when working on pystate.c</skipped></testcase><testcase name="test.test__interpreters.DestroyTests.test_all" status="run" result="completed" time="0.056522" /><testcase name="test.test__interpreters.DestroyTests.test_already_destroyed" status="run" result="completed" time="0.020771" /><testcase name="test.test__interpreters.DestroyTests.test_bad_id" status="run" result="completed" time="0.000035" /><testcase name="test.test__interpreters.DestroyTests.test_does_not_exist" status="run" result="completed" time="0.000028" /><testcase name="test.test__interpreters.DestroyTests.test_from_current" status="run" result="completed" time="0.016890" /><testcase name="test.test__interpreters.DestroyTests.test_from_other_thread" status="run" result="completed" time="0.019119" /><testcase name="test.test__interpreters.DestroyTests.test_from_sibling" status="run" result="completed" time="0.031638" /><testcase name="test.test__interpreters.DestroyTests.test_main" status="run" result="completed" time="0.000353" /><testcase name="test.test__interpreters.DestroyTests.test_one" status="run" result="completed" time="0.058885" /><testcase name="test.test__interpreters.DestroyTests.test_still_running" status="run" result="completed" time="0.015065" /><testcase name="test.test__interpreters.GetCurrentTests.test_main" status="run" result="completed" time="0.000049" /><testcase name="test.test__interpreters.GetCurrentTests.test_subinterpreter" status="run" result="completed" time="0.021851" /><testcase name="test.test__interpreters.GetMainTests.test_from_main" status="run" result="completed" time="0.000056" /><testcase name="test.test__interpreters.GetMainTests.test_from_subinterpreter" status="run" result="completed" time="0.029310" /><testcase name="test.test__interpreters.IsRunningTests.test_already_destroyed" status="run" result="completed" time="0.021289" /><testcase name="test.test__interpreters.IsRunningTests.test_bad_id" status="run" result="completed" time="0.000037" /><testcase name="test.test__interpreters.IsRunningTests.test_does_not_exist" status="run" result="completed" time="0.000030" /><testcase name="test.test__interpreters.IsRunningTests.test_from_subinterpreter" status="run" result="completed" time="0.029102" /><testcase name="test.test__interpreters.IsRunningTests.test_main" status="run" result="completed" time="0.000041" /><testcase name="test.test__interpreters.IsRunningTests.test_subinterpreter" status="run" result="completed" time="0.000006"><skipped>Fails on FreeBSD</skipped></testcase><testcase name="test.test__interpreters.IsShareableTests.test_default_shareables" status="run" result="completed" time="0.000157" /><testcase name="test.test__interpreters.IsShareableTests.test_not_shareable" status="run" result="completed" time="0.000214" /><testcase name="test.test__interpreters.ListAllTests.test_after_creating" status="run" result="completed" time="0.031253" /><testcase name="test.test__interpreters.ListAllTests.test_after_destroying" status="run" result="completed" time="0.032172" /><testcase name="test.test__interpreters.ListAllTests.test_initial" status="run" result="completed" time="0.000042" /><testcase name="test.test__interpreters.ModuleTests.test_import_in_interpreter" status="run" result="completed" time="0.022269" /><testcase name="107" status="run" result="completed" time="0.046010" /><testcase name="108" status="run" result="completed" time="0.051487" /><testcase name="109" status="run" result="completed" time="0.036568" /><testcase name="110" status="run" result="completed" time="0.039363" /><testcase name="111" status="run" result="completed" time="0.049805" /><testcase name="112" status="run" result="completed" time="0.042216" /><testcase name="113" status="run" result="completed" time="0.039694" /><testcase name="114" status="run" result="completed" time="0.023917" /><testcase name="115" status="run" result="completed" time="0.017156" /><testcase name="116" status="run" result="completed" time="0.021574" /><testcase name="117" status="run" result="completed" time="0.026406" /><testcase name="118" status="run" result="completed" time="0.016010"><system-out /><system-err /><output type="AssertionError" message="AssertionError: ValueError not raised ">Traceback (most recent call last):', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 58, in testPartExecutor', ' yield', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 651, in run', ' self._callTestMethod(testMethod)', ' ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 606, in _callTestMethod', ' if method() is not None:', ' ~~~~~~^^', ' File "/Users/admin/Projects/cpython/Lib/test/test__interpreters.py", line 1115, in test_return_value', ' with self.assertRaises(ValueError):', ' _interpreters.run_func(self.id, script)', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 263, in __exit__', ' self._raiseFailure("{} not raised".format(exc_name))', ' ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 200, in _raiseFailure', ' raise self.test_case.failureException(msg)', 'AssertionError: ValueError not raised', '</output></testcase><testcase name="119" status="run" result="completed" time="0.026154" /><testcase name="120" status="run" result="completed" time="0.017651" /><testcase name="121" status="run" result="completed" time="0.017134" /><testcase name="122" status="run" result="completed" time="0.016414" /><testcase name="123" status="run" result="completed" time="0.019697" /><testcase name="124" status="run" result="completed" time="0.107270" /><testcase name="127" status="run" result="completed" time="0.073294" /><testcase name="129" status="run" result="completed" time="0.021998" /><testcase name="130" status="run" result="completed" time="0.021426" /><testcase name="131" status="run" result="completed" time="0.065213" /><testcase name="132" status="run" result="completed" time="0.023274" /><testcase name="133" status="run" result="completed" time="0.056633" /><testcase name="134" status="run" result="completed" time="0.062693" /><testcase name="135" status="run" result="completed" time="0.088620" /><testcase name="137" status="run" result="completed" time="0.075342" /><testcase name="139" status="run" result="completed" time="0.064948" /><testcase name="140" status="run" result="completed" time="0.056591" /><testcase name="test.test__interpreters.RunStringTests.test_still_running_at_exit" status="run" result="completed" time="0.000009"><skipped>blocking forever</skipped></testcase><testcase name="141" status="run" result="completed" time="0.030242" /><testcase name="142" status="run" result="completed" time="0.034018" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bool" status="run" result="completed" time="0.000083" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bytes" status="run" result="completed" time="0.003222" /><testcase name="test.test__interpreters.ShareableTypeTests.test_float" status="run" result="completed" time="0.000092" /><testcase name="test.test__interpreters.ShareableTypeTests.test_int" status="run" result="completed" time="0.003045" /><testcase name="test.test__interpreters.ShareableTypeTests.test_non_shareable_int" status="run" result="completed" time="0.000117" /><testcase name="test.test__interpreters.ShareableTypeTests.test_singletons" status="run" result="completed" time="0.000036" /><testcase name="test.test__interpreters.ShareableTypeTests.test_strs" status="run" result="completed" time="0.000067" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuple" status="run" result="completed" time="0.000127" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuples_containing_non_shareable_types" status="run" result="completed" time="0.000124" /><testcase name="test.test__interpreters.ShareableTypeTests.test_types" status="run" result="completed" time="0.000046" /></testsuite>', '<testsuite start="2024-05-18 20:09:54.312354" tests="75" errors="0" failures="0"><testcase name="test.test__interpreters.CreateTests.test_after_destroy_all" status="run" result="completed" time="0.075031" /><testcase name="test.test__interpreters.CreateTests.test_after_destroy_some" status="run" result="completed" time="0.083842" /><testcase name="test.test__interpreters.CreateTests.test_in_main" status="run" result="completed" time="0.021990" /><testcase name="test.test__interpreters.CreateTests.test_in_subinterpreter" status="run" result="completed" time="0.047942" /><testcase name="test.test__interpreters.CreateTests.test_in_thread" status="run" result="completed" time="0.027276" /><testcase name="test.test__interpreters.CreateTests.test_in_threaded_subinterpreter" status="run" result="completed" time="0.063928" /><testcase name="test.test__interpreters.CreateTests.test_unique_id" status="run" result="completed" time="0.000008"><skipped>enable this test when working on pystate.c</skipped></testcase><testcase name="test.test__interpreters.DestroyTests.test_all" status="run" result="completed" time="0.063820" /><testcase name="test.test__interpreters.DestroyTests.test_already_destroyed" status="run" result="completed" time="0.027534" /><testcase name="test.test__interpreters.DestroyTests.test_bad_id" status="run" result="completed" time="0.000081" /><testcase name="test.test__interpreters.DestroyTests.test_does_not_exist" status="run" result="completed" time="0.000060" /><testcase name="test.test__interpreters.DestroyTests.test_from_current" status="run" result="completed" time="0.031410" /><testcase name="test.test__interpreters.DestroyTests.test_from_other_thread" status="run" result="completed" time="0.037032" /><testcase name="test.test__interpreters.DestroyTests.test_from_sibling" status="run" result="completed" time="0.053633" /><testcase name="test.test__interpreters.DestroyTests.test_main" status="run" result="completed" time="0.000314" /><testcase name="test.test__interpreters.DestroyTests.test_one" status="run" result="completed" time="0.074469" /><testcase name="test.test__interpreters.DestroyTests.test_still_running" status="run" result="completed" time="0.048882" /><testcase name="test.test__interpreters.GetCurrentTests.test_main" status="run" result="completed" time="0.000041" /><testcase name="test.test__interpreters.GetCurrentTests.test_subinterpreter" status="run" result="completed" time="0.027510" /><testcase name="test.test__interpreters.GetMainTests.test_from_main" status="run" result="completed" time="0.000052" /><testcase name="test.test__interpreters.GetMainTests.test_from_subinterpreter" status="run" result="completed" time="0.051418" /><testcase name="test.test__interpreters.IsRunningTests.test_already_destroyed" status="run" result="completed" time="0.026539" /><testcase name="test.test__interpreters.IsRunningTests.test_bad_id" status="run" result="completed" time="0.000039" /><testcase name="test.test__interpreters.IsRunningTests.test_does_not_exist" status="run" result="completed" time="0.000030" /><testcase name="test.test__interpreters.IsRunningTests.test_from_subinterpreter" status="run" result="completed" time="0.035757" /><testcase name="test.test__interpreters.IsRunningTests.test_main" status="run" result="completed" time="0.000077" /><testcase name="test.test__interpreters.IsRunningTests.test_subinterpreter" status="run" result="completed" time="0.000013"><skipped>Fails on FreeBSD</skipped></testcase><testcase name="test.test__interpreters.IsShareableTests.test_default_shareables" status="run" result="completed" time="0.000326" /><testcase name="test.test__interpreters.IsShareableTests.test_not_shareable" status="run" result="completed" time="0.000201" /><testcase name="test.test__interpreters.ListAllTests.test_after_creating" status="run" result="completed" time="0.051264" /><testcase name="test.test__interpreters.ListAllTests.test_after_destroying" status="run" result="completed" time="0.154847" /><testcase name="test.test__interpreters.ListAllTests.test_initial" status="run" result="completed" time="0.000082" /><testcase name="test.test__interpreters.ModuleTests.test_import_in_interpreter" status="run" result="completed" time="0.031230" /><testcase name="178" status="run" result="completed" time="0.200552" /><testcase name="179" status="run" result="completed" time="0.119034" /><testcase name="180" status="run" result="completed" time="0.185662" /><testcase name="181" status="run" result="completed" time="0.225770" /><testcase name="182" status="run" result="completed" time="0.147700" /><testcase name="183" status="run" result="completed" time="0.102475" /><testcase name="184" status="run" result="completed" time="0.092813" /><testcase name="185" status="run" result="completed" time="0.028343" /><testcase name="186" status="run" result="completed" time="0.037656" /><testcase name="187" status="run" result="completed" time="0.064272" /><testcase name="188" status="run" result="completed" time="0.044179" /><testcase name="189" status="run" result="completed" time="0.034228"><system-out /><system-err /><output type="AssertionError" message="AssertionError: ValueError not raised ">Traceback (most recent call last):', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 58, in testPartExecutor', ' yield', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 651, in run', ' self._callTestMethod(testMethod)', ' ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 606, in _callTestMethod', ' if method() is not None:', ' ~~~~~~^^', ' File "/Users/admin/Projects/cpython/Lib/test/test__interpreters.py", line 1115, in test_return_value', ' with self.assertRaises(ValueError):', ' _interpreters.run_func(self.id, script)', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 263, in __exit__', ' self._raiseFailure("{} not raised".format(exc_name))', ' ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 200, in _raiseFailure', ' raise self.test_case.failureException(msg)', 'AssertionError: ValueError not raised', '</output></testcase><testcase name="190" status="run" result="completed" time="0.039032" /><testcase name="191" status="run" result="completed" time="0.120111" /><testcase name="192" status="run" result="completed" time="0.074194" /><testcase name="193" status="run" result="completed" time="0.096174" /><testcase name="194" status="run" result="completed" time="0.059671" /><testcase name="195" status="run" result="completed" time="0.220593" /><testcase name="198" status="run" result="completed" time="0.134348" /><testcase name="200" status="run" result="completed" time="0.023482" /><testcase name="201" status="run" result="completed" time="0.054511" /><testcase name="202" status="run" result="completed" time="0.097542" /><testcase name="203" status="run" result="completed" time="0.054988" /><testcase name="204" status="run" result="completed" time="0.048809" /><testcase name="205" status="run" result="completed" time="0.043305" /><testcase name="206" status="run" result="completed" time="0.076466" /><testcase name="208" status="run" result="completed" time="0.116169" /><testcase name="210" status="run" result="completed" time="0.039526" /><testcase name="211" status="run" result="completed" time="0.038671" /><testcase name="test.test__interpreters.RunStringTests.test_still_running_at_exit" status="run" result="completed" time="0.000008"><skipped>blocking forever</skipped></testcase><testcase name="212" status="run" result="completed" time="0.033025" /><testcase name="213" status="run" result="completed" time="0.036963" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bool" status="run" result="completed" time="0.000766" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bytes" status="run" result="completed" time="0.007518" /><testcase name="test.test__interpreters.ShareableTypeTests.test_float" status="run" result="completed" time="0.000100" /><testcase name="test.test__interpreters.ShareableTypeTests.test_int" status="run" result="completed" time="0.003369" /><testcase name="test.test__interpreters.ShareableTypeTests.test_non_shareable_int" status="run" result="completed" time="0.000199" /><testcase name="test.test__interpreters.ShareableTypeTests.test_singletons" status="run" result="completed" time="0.000070" /><testcase name="test.test__interpreters.ShareableTypeTests.test_strs" status="run" result="completed" time="0.000114" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuple" status="run" result="completed" time="0.000123" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuples_containing_non_shareable_types" status="run" result="completed" time="0.000126" /><testcase name="test.test__interpreters.ShareableTypeTests.test_types" status="run" result="completed" time="0.000046" /></testsuite>', '<testsuite start="2024-05-18 20:09:58.108285" tests="75" errors="0" failures="0"><testcase name="test.test__interpreters.CreateTests.test_after_destroy_all" status="run" result="completed" time="0.164019" /><testcase name="test.test__interpreters.CreateTests.test_after_destroy_some" status="run" result="completed" time="0.190837" /><testcase name="test.test__interpreters.CreateTests.test_in_main" status="run" result="completed" time="0.039865" /><testcase name="test.test__interpreters.CreateTests.test_in_subinterpreter" status="run" result="completed" time="0.095141" /><testcase name="test.test__interpreters.CreateTests.test_in_thread" status="run" result="completed" time="0.024889" /><testcase name="test.test__interpreters.CreateTests.test_in_threaded_subinterpreter" status="run" result="completed" time="0.044804" /><testcase name="test.test__interpreters.CreateTests.test_unique_id" status="run" result="completed" time="0.000011"><skipped>enable this test when working on pystate.c</skipped></testcase><testcase name="test.test__interpreters.DestroyTests.test_all" status="run" result="completed" time="0.049512" /><testcase name="test.test__interpreters.DestroyTests.test_already_destroyed" status="run" result="completed" time="0.017110" /><testcase name="test.test__interpreters.DestroyTests.test_bad_id" status="run" result="completed" time="0.000041" /><testcase name="test.test__interpreters.DestroyTests.test_does_not_exist" status="run" result="completed" time="0.000039" /><testcase name="test.test__interpreters.DestroyTests.test_from_current" status="run" result="completed" time="0.015966" /><testcase name="test.test__interpreters.DestroyTests.test_from_other_thread" status="run" result="completed" time="0.015040" /><testcase name="test.test__interpreters.DestroyTests.test_from_sibling" status="run" result="completed" time="0.035867" /><testcase name="test.test__interpreters.DestroyTests.test_main" status="run" result="completed" time="0.000223" /><testcase name="test.test__interpreters.DestroyTests.test_one" status="run" result="completed" time="0.051598" /><testcase name="test.test__interpreters.DestroyTests.test_still_running" status="run" result="completed" time="0.021571" /><testcase name="test.test__interpreters.GetCurrentTests.test_main" status="run" result="completed" time="0.000045" /><testcase name="test.test__interpreters.GetCurrentTests.test_subinterpreter" status="run" result="completed" time="0.025448" /><testcase name="test.test__interpreters.GetMainTests.test_from_main" status="run" result="completed" time="0.000048" /><testcase name="test.test__interpreters.GetMainTests.test_from_subinterpreter" status="run" result="completed" time="0.023968" /><testcase name="test.test__interpreters.IsRunningTests.test_already_destroyed" status="run" result="completed" time="0.021474" /><testcase name="test.test__interpreters.IsRunningTests.test_bad_id" status="run" result="completed" time="0.000073" /><testcase name="test.test__interpreters.IsRunningTests.test_does_not_exist" status="run" result="completed" time="0.000068" /><testcase name="test.test__interpreters.IsRunningTests.test_from_subinterpreter" status="run" result="completed" time="0.028020" /><testcase name="test.test__interpreters.IsRunningTests.test_main" status="run" result="completed" time="0.000042" /><testcase name="test.test__interpreters.IsRunningTests.test_subinterpreter" status="run" result="completed" time="0.000007"><skipped>Fails on FreeBSD</skipped></testcase><testcase name="test.test__interpreters.IsShareableTests.test_default_shareables" status="run" result="completed" time="0.000147" /><testcase name="test.test__interpreters.IsShareableTests.test_not_shareable" status="run" result="completed" time="0.000201" /><testcase name="test.test__interpreters.ListAllTests.test_after_creating" status="run" result="completed" time="0.036359" /><testcase name="test.test__interpreters.ListAllTests.test_after_destroying" status="run" result="completed" time="0.034967" /><testcase name="test.test__interpreters.ListAllTests.test_initial" status="run" result="completed" time="0.000044" /><testcase name="test.test__interpreters.ModuleTests.test_import_in_interpreter" status="run" result="completed" time="0.023237" /><testcase name="249" status="run" result="completed" time="0.034558" /><testcase name="250" status="run" result="completed" time="0.038525" /><testcase name="251" status="run" result="completed" time="0.047931" /><testcase name="252" status="run" result="completed" time="0.056895" /><testcase name="253" status="run" result="completed" time="0.070554" /><testcase name="254" status="run" result="completed" time="0.047777" /><testcase name="255" status="run" result="completed" time="0.072239" /><testcase name="256" status="run" result="completed" time="0.037395" /><testcase name="257" status="run" result="completed" time="0.088366" /><testcase name="258" status="run" result="completed" time="0.052248" /><testcase name="259" status="run" result="completed" time="0.072401" /><testcase name="260" status="run" result="completed" time="0.037188"><system-out /><system-err /><output type="AssertionError" message="AssertionError: ValueError not raised ">Traceback (most recent call last):', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 58, in testPartExecutor', ' yield', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 651, in run', ' self._callTestMethod(testMethod)', ' ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 606, in _callTestMethod', ' if method() is not None:', ' ~~~~~~^^', ' File "/Users/admin/Projects/cpython/Lib/test/test__interpreters.py", line 1115, in test_return_value', ' with self.assertRaises(ValueError):', ' _interpreters.run_func(self.id, script)', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 263, in __exit__', ' self._raiseFailure("{} not raised".format(exc_name))', ' ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 200, in _raiseFailure', ' raise self.test_case.failureException(msg)', 'AssertionError: ValueError not raised', '</output></testcase><testcase name="261" status="run" result="completed" time="0.059009" /><testcase name="262" status="run" result="completed" time="0.026088" /><testcase name="263" status="run" result="completed" time="0.024894" /><testcase name="264" status="run" result="completed" time="0.074289" /><testcase name="265" status="run" result="completed" time="0.070639" /><testcase name="266" status="run" result="completed" time="0.176288" /><testcase name="269" status="run" result="completed" time="0.123971" /><testcase name="271" status="run" result="completed" time="0.052711" /><testcase name="272" status="run" result="completed" time="0.024884" /><testcase name="273" status="run" result="completed" time="0.035654" /><testcase name="274" status="run" result="completed" time="0.020323" /><testcase name="275" status="run" result="completed" time="0.098269" /><testcase name="276" status="run" result="completed" time="0.176192" /><testcase name="277" status="run" result="completed" time="0.078816" /><testcase name="279" status="run" result="completed" time="0.106006" /><testcase name="281" status="run" result="completed" time="0.084233" /><testcase name="282" status="run" result="completed" time="0.058293" /><testcase name="test.test__interpreters.RunStringTests.test_still_running_at_exit" status="run" result="completed" time="0.000019"><skipped>blocking forever</skipped></testcase><testcase name="283" status="run" result="completed" time="0.112492" /><testcase name="284" status="run" result="completed" time="0.084162" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bool" status="run" result="completed" time="0.000175" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bytes" status="run" result="completed" time="0.008387" /><testcase name="test.test__interpreters.ShareableTypeTests.test_float" status="run" result="completed" time="0.000094" /><testcase name="test.test__interpreters.ShareableTypeTests.test_int" status="run" result="completed" time="0.003807" /><testcase name="test.test__interpreters.ShareableTypeTests.test_non_shareable_int" status="run" result="completed" time="0.000097" /><testcase name="test.test__interpreters.ShareableTypeTests.test_singletons" status="run" result="completed" time="0.000032" /><testcase name="test.test__interpreters.ShareableTypeTests.test_strs" status="run" result="completed" time="0.000063" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuple" status="run" result="completed" time="0.000131" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuples_containing_non_shareable_types" status="run" result="completed" time="0.000116" /><testcase name="test.test__interpreters.ShareableTypeTests.test_types" status="run" result="completed" time="0.000044" /></testsuite>', '<testsuite start="2024-05-18 20:10:01.260716" tests="75" errors="0" failures="0"><testcase name="test.test__interpreters.CreateTests.test_after_destroy_all" status="run" result="completed" time="0.084929" /><testcase name="test.test__interpreters.CreateTests.test_after_destroy_some" status="run" result="completed" time="0.095149" /><testcase name="test.test__interpreters.CreateTests.test_in_main" status="run" result="completed" time="0.023965" /><testcase name="test.test__interpreters.CreateTests.test_in_subinterpreter" status="run" result="completed" time="0.059573" /><testcase name="test.test__interpreters.CreateTests.test_in_thread" status="run" result="completed" time="0.025976" /><testcase name="test.test__interpreters.CreateTests.test_in_threaded_subinterpreter" status="run" result="completed" time="0.066842" /><testcase name="test.test__interpreters.CreateTests.test_unique_id" status="run" result="completed" time="0.000009"><skipped>enable this test when working on pystate.c</skipped></testcase><testcase name="test.test__interpreters.DestroyTests.test_all" status="run" result="completed" time="0.059955" /><testcase name="test.test__interpreters.DestroyTests.test_already_destroyed" status="run" result="completed" time="0.019085" /><testcase name="test.test__interpreters.DestroyTests.test_bad_id" status="run" result="completed" time="0.000036" /><testcase name="test.test__interpreters.DestroyTests.test_does_not_exist" status="run" result="completed" time="0.000028" /><testcase name="test.test__interpreters.DestroyTests.test_from_current" status="run" result="completed" time="0.021316" /><testcase name="test.test__interpreters.DestroyTests.test_from_other_thread" status="run" result="completed" time="0.019700" /><testcase name="test.test__interpreters.DestroyTests.test_from_sibling" status="run" result="completed" time="0.052989" /><testcase name="test.test__interpreters.DestroyTests.test_main" status="run" result="completed" time="0.001255" /><testcase name="test.test__interpreters.DestroyTests.test_one" status="run" result="completed" time="0.103670" /><testcase name="test.test__interpreters.DestroyTests.test_still_running" status="run" result="completed" time="0.035278" /><testcase name="test.test__interpreters.GetCurrentTests.test_main" status="run" result="completed" time="0.000151" /><testcase name="test.test__interpreters.GetCurrentTests.test_subinterpreter" status="run" result="completed" time="0.044458" /><testcase name="test.test__interpreters.GetMainTests.test_from_main" status="run" result="completed" time="0.000044" /><testcase name="test.test__interpreters.GetMainTests.test_from_subinterpreter" status="run" result="completed" time="0.034581" /><testcase name="test.test__interpreters.IsRunningTests.test_already_destroyed" status="run" result="completed" time="0.021530" /><testcase name="test.test__interpreters.IsRunningTests.test_bad_id" status="run" result="completed" time="0.000038" /><testcase name="test.test__interpreters.IsRunningTests.test_does_not_exist" status="run" result="completed" time="0.000030" /><testcase name="test.test__interpreters.IsRunningTests.test_from_subinterpreter" status="run" result="completed" time="0.030685" /><testcase name="test.test__interpreters.IsRunningTests.test_main" status="run" result="completed" time="0.000043" /><testcase name="test.test__interpreters.IsRunningTests.test_subinterpreter" status="run" result="completed" time="0.000007"><skipped>Fails on FreeBSD</skipped></testcase><testcase name="test.test__interpreters.IsShareableTests.test_default_shareables" status="run" result="completed" time="0.000148" /><testcase name="test.test__interpreters.IsShareableTests.test_not_shareable" status="run" result="completed" time="0.000201" /><testcase name="test.test__interpreters.ListAllTests.test_after_creating" status="run" result="completed" time="0.063083" /><testcase name="test.test__interpreters.ListAllTests.test_after_destroying" status="run" result="completed" time="0.040496" /><testcase name="test.test__interpreters.ListAllTests.test_initial" status="run" result="completed" time="0.000051" /><testcase name="test.test__interpreters.ModuleTests.test_import_in_interpreter" status="run" result="completed" time="0.044848" /><testcase name="320" status="run" result="completed" time="0.045601" /><testcase name="321" status="run" result="completed" time="0.046830" /><testcase name="322" status="run" result="completed" time="0.138190" /><testcase name="323" status="run" result="completed" time="0.049137" /><testcase name="324" status="run" result="completed" time="0.082212" /><testcase name="325" status="run" result="completed" time="0.080439" /><testcase name="326" status="run" result="completed" time="0.102638" /><testcase name="327" status="run" result="completed" time="0.025606" /><testcase name="328" status="run" result="completed" time="0.019735" /><testcase name="329" status="run" result="completed" time="0.028503" /><testcase name="330" status="run" result="completed" time="0.033393" /><testcase name="331" status="run" result="completed" time="0.019534"><system-out /><system-err /><output type="AssertionError" message="AssertionError: ValueError not raised ">Traceback (most recent call last):', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 58, in testPartExecutor', ' yield', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 651, in run', ' self._callTestMethod(testMethod)', ' ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 606, in _callTestMethod', ' if method() is not None:', ' ~~~~~~^^', ' File "/Users/admin/Projects/cpython/Lib/test/test__interpreters.py", line 1115, in test_return_value', ' with self.assertRaises(ValueError):', ' _interpreters.run_func(self.id, script)', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 263, in __exit__', ' self._raiseFailure("{} not raised".format(exc_name))', ' ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 200, in _raiseFailure', ' raise self.test_case.failureException(msg)', 'AssertionError: ValueError not raised', '</output></testcase><testcase name="332" status="run" result="completed" time="0.028807" /><testcase name="333" status="run" result="completed" time="0.025454" /><testcase name="334" status="run" result="completed" time="0.022579" /><testcase name="335" status="run" result="completed" time="0.066905" /><testcase name="336" status="run" result="completed" time="0.027478" /><testcase name="337" status="run" result="completed" time="0.110836" /><testcase name="340" status="run" result="completed" time="0.101386" /><testcase name="342" status="run" result="completed" time="0.049150" /><testcase name="343" status="run" result="completed" time="0.019634" /><testcase name="344" status="run" result="completed" time="0.035177" /><testcase name="345" status="run" result="completed" time="0.021201" /><testcase name="346" status="run" result="completed" time="0.034741" /><testcase name="347" status="run" result="completed" time="0.034485" /><testcase name="348" status="run" result="completed" time="0.054554" /><testcase name="350" status="run" result="completed" time="0.050132" /><testcase name="352" status="run" result="completed" time="0.042257" /><testcase name="353" status="run" result="completed" time="0.045123" /><testcase name="test.test__interpreters.RunStringTests.test_still_running_at_exit" status="run" result="completed" time="0.000016"><skipped>blocking forever</skipped></testcase><testcase name="354" status="run" result="completed" time="0.041425" /><testcase name="355" status="run" result="completed" time="0.043452" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bool" status="run" result="completed" time="0.000156" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bytes" status="run" result="completed" time="0.005094" /><testcase name="test.test__interpreters.ShareableTypeTests.test_float" status="run" result="completed" time="0.000091" /><testcase name="test.test__interpreters.ShareableTypeTests.test_int" status="run" result="completed" time="0.002971" /><testcase name="test.test__interpreters.ShareableTypeTests.test_non_shareable_int" status="run" result="completed" time="0.000086" /><testcase name="test.test__interpreters.ShareableTypeTests.test_singletons" status="run" result="completed" time="0.000032" /><testcase name="test.test__interpreters.ShareableTypeTests.test_strs" status="run" result="completed" time="0.000061" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuple" status="run" result="completed" time="0.000118" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuples_containing_non_shareable_types" status="run" result="completed" time="0.000111" /><testcase name="test.test__interpreters.ShareableTypeTests.test_types" status="run" result="completed" time="0.000044" /></testsuite>', '<testsuite start="2024-05-18 20:10:03.788573" tests="75" errors="0" failures="0"><testcase name="test.test__interpreters.CreateTests.test_after_destroy_all" status="run" result="completed" time="0.093388" /><testcase name="test.test__interpreters.CreateTests.test_after_destroy_some" status="run" result="completed" time="0.088146" /><testcase name="test.test__interpreters.CreateTests.test_in_main" status="run" result="completed" time="0.030142" /><testcase name="test.test__interpreters.CreateTests.test_in_subinterpreter" status="run" result="completed" time="0.051230" /><testcase name="test.test__interpreters.CreateTests.test_in_thread" status="run" result="completed" time="0.022905" /><testcase name="test.test__interpreters.CreateTests.test_in_threaded_subinterpreter" status="run" result="completed" time="0.051377" /><testcase name="test.test__interpreters.CreateTests.test_unique_id" status="run" result="completed" time="0.000008"><skipped>enable this test when working on pystate.c</skipped></testcase><testcase name="test.test__interpreters.DestroyTests.test_all" status="run" result="completed" time="0.075475" /><testcase name="test.test__interpreters.DestroyTests.test_already_destroyed" status="run" result="completed" time="0.025701" /><testcase name="test.test__interpreters.DestroyTests.test_bad_id" status="run" result="completed" time="0.000043" /><testcase name="test.test__interpreters.DestroyTests.test_does_not_exist" status="run" result="completed" time="0.000030" /><testcase name="test.test__interpreters.DestroyTests.test_from_current" status="run" result="completed" time="0.021923" /><testcase name="test.test__interpreters.DestroyTests.test_from_other_thread" status="run" result="completed" time="0.020078" /><testcase name="test.test__interpreters.DestroyTests.test_from_sibling" status="run" result="completed" time="0.042207" /><testcase name="test.test__interpreters.DestroyTests.test_main" status="run" result="completed" time="0.000547" /><testcase name="test.test__interpreters.DestroyTests.test_one" status="run" result="completed" time="0.064985" /><testcase name="test.test__interpreters.DestroyTests.test_still_running" status="run" result="completed" time="0.035713" /><testcase name="test.test__interpreters.GetCurrentTests.test_main" status="run" result="completed" time="0.000046" /><testcase name="test.test__interpreters.GetCurrentTests.test_subinterpreter" status="run" result="completed" time="0.042408" /><testcase name="test.test__interpreters.GetMainTests.test_from_main" status="run" result="completed" time="0.000045" /><testcase name="test.test__interpreters.GetMainTests.test_from_subinterpreter" status="run" result="completed" time="0.032290" /><testcase name="test.test__interpreters.IsRunningTests.test_already_destroyed" status="run" result="completed" time="0.021381" /><testcase name="test.test__interpreters.IsRunningTests.test_bad_id" status="run" result="completed" time="0.000038" /><testcase name="test.test__interpreters.IsRunningTests.test_does_not_exist" status="run" result="completed" time="0.000147" /><testcase name="test.test__interpreters.IsRunningTests.test_from_subinterpreter" status="run" result="completed" time="0.034041" /><testcase name="test.test__interpreters.IsRunningTests.test_main" status="run" result="completed" time="0.000079" /><testcase name="test.test__interpreters.IsRunningTests.test_subinterpreter" status="run" result="completed" time="0.000013"><skipped>Fails on FreeBSD</skipped></testcase><testcase name="test.test__interpreters.IsShareableTests.test_default_shareables" status="run" result="completed" time="0.000292" /><testcase name="test.test__interpreters.IsShareableTests.test_not_shareable" status="run" result="completed" time="0.000388" /><testcase name="test.test__interpreters.ListAllTests.test_after_creating" status="run" result="completed" time="0.039997" /><testcase name="test.test__interpreters.ListAllTests.test_after_destroying" status="run" result="completed" time="0.034474" /><testcase name="test.test__interpreters.ListAllTests.test_initial" status="run" result="completed" time="0.000044" /><testcase name="test.test__interpreters.ModuleTests.test_import_in_interpreter" status="run" result="completed" time="0.029115" /><testcase name="391" status="run" result="completed" time="0.045306" /><testcase name="392" status="run" result="completed" time="0.049445" /><testcase name="393" status="run" result="completed" time="0.052131" /><testcase name="394" status="run" result="completed" time="0.047487" /><testcase name="395" status="run" result="completed" time="0.050661" /><testcase name="396" status="run" result="completed" time="0.081010" /><testcase name="397" status="run" result="completed" time="0.105005" /><testcase name="398" status="run" result="completed" time="0.043999" /><testcase name="399" status="run" result="completed" time="0.075979" /><testcase name="400" status="run" result="completed" time="0.040846" /><testcase name="401" status="run" result="completed" time="0.051325" /><testcase name="402" status="run" result="completed" time="0.045339"><system-out /><system-err /><output type="AssertionError" message="AssertionError: ValueError not raised ">Traceback (most recent call last):', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 58, in testPartExecutor', ' yield', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 651, in run', ' self._callTestMethod(testMethod)', ' ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 606, in _callTestMethod', ' if method() is not None:', ' ~~~~~~^^', ' File "/Users/admin/Projects/cpython/Lib/test/test__interpreters.py", line 1115, in test_return_value', ' with self.assertRaises(ValueError):', ' _interpreters.run_func(self.id, script)', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 263, in __exit__', ' self._raiseFailure("{} not raised".format(exc_name))', ' ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^', ' File "/Users/admin/Projects/cpython/Lib/unittest/case.py", line 200, in _raiseFailure', ' raise self.test_case.failureException(msg)', 'AssertionError: ValueError not raised', '</output></testcase><testcase name="403" status="run" result="completed" time="0.085147" /><testcase name="404" status="run" result="completed" time="0.039693" /><testcase name="405" status="run" result="completed" time="0.034673" /><testcase name="406" status="run" result="completed" time="0.056609" /><testcase name="407" status="run" result="completed" time="0.029473" /><testcase name="408" status="run" result="completed" time="0.109135" /><testcase name="411" status="run" result="completed" time="0.056012" /><testcase name="413" status="run" result="completed" time="0.019725" /><testcase name="414" status="run" result="completed" time="0.020820" /><testcase name="415" status="run" result="completed" time="0.035424" /><testcase name="416" status="run" result="completed" time="0.016643" /><testcase name="417" status="run" result="completed" time="0.028605" /><testcase name="418" status="run" result="completed" time="0.029691" /><testcase name="419" status="run" result="completed" time="0.042919" /><testcase name="421" status="run" result="completed" time="0.031898" /><testcase name="423" status="run" result="completed" time="0.036822" /><testcase name="424" status="run" result="completed" time="0.032704" /><testcase name="test.test__interpreters.RunStringTests.test_still_running_at_exit" status="run" result="completed" time="0.000007"><skipped>blocking forever</skipped></testcase><testcase name="425" status="run" result="completed" time="0.032048" /><testcase name="426" status="run" result="completed" time="0.086898" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bool" status="run" result="completed" time="0.000291" /><testcase name="test.test__interpreters.ShareableTypeTests.test_bytes" status="run" result="completed" time="0.003550" /><testcase name="test.test__interpreters.ShareableTypeTests.test_float" status="run" result="completed" time="0.000091" /><testcase name="test.test__interpreters.ShareableTypeTests.test_int" status="run" result="completed" time="0.007306" /><testcase name="test.test__interpreters.ShareableTypeTests.test_non_shareable_int" status="run" result="completed" time="0.000196" /><testcase name="test.test__interpreters.ShareableTypeTests.test_singletons" status="run" result="completed" time="0.000168" /><testcase name="test.test__interpreters.ShareableTypeTests.test_strs" status="run" result="completed" time="0.000135" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuple" status="run" result="completed" time="0.000255" /><testcase name="test.test__interpreters.ShareableTypeTests.test_tuples_containing_non_shareable_types" status="run" result="completed" time="0.000324" /><testcase name="test.test__interpreters.ShareableTypeTests.test_types" status="run" result="completed" time="0.000214" /></testsuite>']
Kill <WorkerThread #1 running test=test.test_multiprocessing_spawn.test_processes pid=28887 time=1 min 50 sec> process group
Kill <WorkerThread #2 running test=test.test_multiprocessing_spawn.test_threads pid=29390 time=1 min 32 sec> process group
Kill <WorkerThread #3 running test=test.test_asyncio.test_tasks pid=21784 time=5 min 7 sec> process group
Kill <WorkerThread #4 running test=test_array pid=31666 time=22 ms> process group
Kill <WorkerThread #5 running test=test.test_multiprocessing_forkserver.test_processes pid=25793 time=3 min 30 sec> process group
Kill <WorkerThread #6 running test=test.test_multiprocessing_spawn.test_manager pid=26431 time=3 min 16 sec> process group
Kill <WorkerThread #7 running test=test.test_multiprocessing_spawn.test_misc pid=27170 time=2 min 49 sec> process group
Kill <WorkerThread #8 running test=test_argparse pid=31649 time=1.0 sec> process group
Traceback (most recent call last):
File "/Users/admin/Projects/cpython/Lib/runpy.py", line 198, in _run_module_as_main
return _run_code(code, main_globals, None,
"__main__", mod_spec)
File "/Users/admin/Projects/cpython/Lib/runpy.py", line 88, in _run_code
exec(code, run_globals)
~~~~^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/__main__.py", line 2, in <module>
main(_add_python_opts=True)
~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 739, in main
Regrtest(ns, _add_python_opts=_add_python_opts).main(tests=tests)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 731, in main
exitcode = self.run_tests(selected, tests)
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 568, in run_tests
return self._run_tests(selected, tests)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 528, in _run_tests
self._run_tests_mp(runtests, self.num_workers)
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/main.py", line 426, in _run_tests_mp
RunWorkers(num_workers, runtests, self.logger, self.results).run()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/run_workers.py", line 600, in run
result = self._process_result(item)
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/run_workers.py", line 571, in _process_result
self.results.accumulate_result(result, self.runtests)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/results.py", line 132, in accumulate_result
self.add_junit(xml_data)
~~~~~~~~~~~~~~^^^^^^^^^^
File "/Users/admin/Projects/cpython/Lib/test/libregrtest/results.py", line 165, in add_junit
self.testsuite_xml.append(ET.fromstring(e))
~~~~~~~~~~~~~^^^
File "/Users/admin/Projects/cpython/Lib/xml/etree/ElementTree.py", line 1343, in XML
return parser.close()
~~~~~~~~~~~~^^
xml.etree.ElementTree.ParseError: no element found: line 1, column 5239 |
Fixed by using pickle for serialization. My simple serialization using one XML item as text per line doesn't work since it can contain newline. |
|
Thanks @vstinner for the PR 🌮🎉.. I'm working now to backport this PR to: 3.13. |
miss-islington
pushed a commit
to miss-islington/cpython
that referenced
this pull request
May 20, 2024
…onGH-119148) regrtest test runner: Add XML support to the refleak checker (-R option). * run_unittest() now stores XML elements as string, rather than objects, in support.junit_xml_list. * runtest_refleak() now saves/restores XML strings before/after checking for reference leaks. Save XML into a temporary file. (cherry picked from commit 9257731) Co-authored-by: Victor Stinner <vstinner@python.org>
|
GH-119270 is a backport of this pull request to the 3.13 branch. |
|
Thanks @vstinner for the PR 🌮🎉.. I'm working now to backport this PR to: 3.12. |
|
Sorry, @vstinner, I could not cleanly backport this to |
|
GH-119272 is a backport of this pull request to the 3.12 branch. |
|
Merged, thanks for your review @Eclips4. |
vstinner
added a commit
to vstinner/cpython
that referenced
this pull request
May 20, 2024
…on#119148) regrtest test runner: Add XML support to the refleak checker (-R option). * run_unittest() now stores XML elements as string, rather than objects, in support.junit_xml_list. * runtest_refleak() now saves/restores XML strings before/after checking for reference leaks. Save XML into a temporary file. (cherry picked from commit 9257731)
vstinner
added a commit
that referenced
this pull request
May 20, 2024
…119148) (#119270) gh-119050: Add XML support to libregrtest refleak checker (GH-119148) regrtest test runner: Add XML support to the refleak checker (-R option). * run_unittest() now stores XML elements as string, rather than objects, in support.junit_xml_list. * runtest_refleak() now saves/restores XML strings before/after checking for reference leaks. Save XML into a temporary file. (cherry picked from commit 9257731) Co-authored-by: Victor Stinner <vstinner@python.org>
vstinner
added a commit
that referenced
this pull request
May 20, 2024
…9148) (#119272) gh-119050: Add XML support to libregrtest refleak checker (#119148) regrtest test runner: Add XML support to the refleak checker (-R option). * run_unittest() now stores XML elements as string, rather than objects, in support.junit_xml_list. * runtest_refleak() now saves/restores XML strings before/after checking for reference leaks. Save XML into a temporary file. (cherry picked from commit 9257731)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
regrtest test runner: Add XML support to the refleak checker (-R option).
--durationoption to the test suite #119050