Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

⚠️ CI failed on macos_arm64_wheel ⚠️ #26921

Closed
scikit-learn-bot opened this issue Jul 28, 2023 · 2 comments
Closed

⚠️ CI failed on macos_arm64_wheel ⚠️ #26921

scikit-learn-bot opened this issue Jul 28, 2023 · 2 comments
Labels
Needs Investigation Issue requires investigation

Comments

@scikit-learn-bot
Copy link
Contributor

scikit-learn-bot commented Jul 28, 2023 •
edited

CI is still failing on macos_arm64_wheel (Oct 15, 2023)
@github-actions github-actions bot added the Needs Triage Issue requires triage label Jul 28, 2023
@thomasjpfan thomasjpfan added Needs Investigation Issue requires investigation and removed Needs Triage Issue requires triage labels Aug 11, 2023
@thomasjpfan
Copy link
Member

The CI fails for Python 3.11 because of a failing SciPy import. Here is the backtrack:

+ pytest --pyargs sklearn -n 4
============================= test session starts ==============================
platform darwin -- Python 3.11.4, pytest-7.4.0, pluggy-1.2.0
rootdir: /private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/test_cwd
plugins: xdist-3.3.1
created: 4/4 workers
4 workers [29433 items]
!!!!!!!!!!!!!!!!!!!! <ExceptionInfo _DeadlockError("deadlock detected by _ModuleLock('scipy.sparse._base') at 4373307088") tblen=20>
INTERNALERROR> Traceback (most recent call last):
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/xdist/workermanage.py", line 386, in process_from_remote
INTERNALERROR>     warning_message = unserialize_warning_message(
INTERNALERROR>                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/xdist/workermanage.py", line 416, in unserialize_warning_message
INTERNALERROR>     mod = importlib.import_module(data["message_module"])
INTERNALERROR>           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/importlib/__init__.py", line 126, in import_module
INTERNALERROR>     return _bootstrap._gcd_import(name[level:], package, level)
INTERNALERROR>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1126, in _find_and_load_unlocked
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
INTERNALERROR>   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/sklearn/__init__.py", line 83, in <module>
INTERNALERROR>     from .base import clone
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/sklearn/base.py", line 19, in <module>
INTERNALERROR>     from .utils import _IS_32BIT
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/sklearn/utils/__init__.py", line 15, in <module>
INTERNALERROR>     from scipy.sparse import issparse
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/scipy/sparse/__init__.py", line 273, in <module>
INTERNALERROR>     from ._base import *
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 1173, in _find_and_load
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 171, in __enter__
INTERNALERROR>   File "<frozen importlib._bootstrap>", line 116, in acquire
INTERNALERROR> _frozen_importlib._DeadlockError: deadlock detected by _ModuleLock('scipy.sparse._base') at 4373307088
[gw3] node down: <ExceptionInfo _DeadlockError("deadlock detected by _ModuleLock('scipy.sparse._base') at 4373307088") tblen=20>
F
replacing crashed worker gw3
.INTERNALERROR> Traceback (most recent call last):
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/_pytest/main.py", line 270, in wrap_session
INTERNALERROR>     session.exitstatus = doit(config, session) or 0
INTERNALERROR>                          ^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/_pytest/main.py", line 324, in _main
INTERNALERROR>     config.hook.pytest_runtestloop(session=session)
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/pluggy/_hooks.py", line 433, in __call__
INTERNALERROR>     return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
INTERNALERROR>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/pluggy/_manager.py", line 112, in _hookexec
INTERNALERROR>     return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
INTERNALERROR>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/pluggy/_callers.py", line 155, in _multicall
INTERNALERROR>     return outcome.get_result()
INTERNALERROR>            ^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/pluggy/_result.py", line 108, in get_result
INTERNALERROR>     raise exc.with_traceback(exc.__traceback__)
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/pluggy/_callers.py", line 80, in _multicall
INTERNALERROR>     res = hook_impl.function(*args)
INTERNALERROR>           ^^^^^^^^^^^^^^^^^^^^^^^^^
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/xdist/dsession.py", line 122, in pytest_runtestloop
INTERNALERROR>     self.loop_once()
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/xdist/dsession.py", line 145, in loop_once
INTERNALERROR>     call(**kwargs)
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/xdist/dsession.py", line 292, in worker_runtest_protocol_complete
INTERNALERROR>     self.sched.mark_test_complete(node, item_index, duration)
INTERNALERROR>   File "/private/var/folders/76/zy5ktkns50v6gt5g8r0sf6sc0000gn/T/cibw-run-y7u7mjyl/cp311-macosx_arm64/venv-test/lib/python3.11/site-packages/xdist/scheduler/load.py", line 152, in mark_test_complete
INTERNALERROR>     self.node2pending[node].remove(item_index)
INTERNALERROR>     ~~~~~~~~~~~~~~~~~^^^^^^
INTERNALERROR> KeyError: <WorkerController gw3>

@lesteve
Copy link
Member

lesteve commented Oct 20, 2023

The latest error is the graphical lasso one and has been fixed in #27616.

@lesteve lesteve closed this as completed Oct 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Needs Investigation Issue requires investigation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@lesteve @thomasjpfan @scikit-learn-bot