Pylint takes almost two hours?!

[inducer]

E.g. here: https://github.com/inducer/pytential/actions/runs/5675790498/job/15397715698

It's the longest-running of all the CI jobs. 🤔 If it keeps this up, I might nuke it.

[alexfikl]

I just ran it locally with

time pylint --jobs=4 --recursive y --extension-pkg-whitelist=numpy --disable=all --enable=E --disable=E1136 --ignore=old_diffop_primitives.py,generalized_debye.py,waveguide.py --extension-pkg-whitelist=pytential.qbx.target_specific --enable=I0021 pytential examples test

91.07s user 6.76s system 390% cpu 25.081 total

No idea what might make it do that on the CI, but it is very funny 😁

[inducer]

Maybe out of memory, like the rest of it?

[alexfikl]

Hm, it seems to take about 3-400MB per job on my machine (4 jobs total), so comfortably within CI limits..

As far as I can tell, pylint also doesn't keep any caches (besides some stats to show the previous run: X/Y +Z message) to make it faster locally. Very weird indeed :\

[inducer]

3h is apparently not out of the question? 😱 #217 (comment)

[alexfikl]

On Gitlab it seems to take the usual amount of time (with presumably the same library versions?)
https://gitlab.tiker.net/inducer/pytential/-/jobs/587163

[alexfikl]

@inducer Following @matthiasdiener excellent point in inducer/grudge#317 (comment), I thought that maybe pytential is doing the same thing. That seems to indeed be the case! For the pylint run it gives (see log)

Sun, 27 Aug 2023 03:19:49 GMT +++ conda env create --file .test-conda-env-py3.yml --name testing --quiet
Sun, 27 Aug 2023 03:22:01 GMT Collecting package metadata (repodata.json): ...working... done
Sun, 27 Aug 2023 08:04:38 GMT Solving environment: ...working... done
Sun, 27 Aug 2023 08:05:12 GMT Preparing transaction: ...working... done
Sun, 27 Aug 2023 08:05:20 GMT Verifying transaction: ...working... done
Sun, 27 Aug 2023 08:05:33 GMT Executing transaction: ...working... done
Sun, 27 Aug 2023 08:05:38 GMT +++ conda install --quiet --yes pip

while for the standard pytest run it gives (see log)

Sun, 27 Aug 2023 03:20:02 GMT +++ conda env create --file .test-conda-env-py3.yml --name testing --quiet
Sun, 27 Aug 2023 03:22:42 GMT Collecting package metadata (repodata.json): ...working... done
Sun, 27 Aug 2023 03:24:45 GMT Solving environment: ...working... done
Sun, 27 Aug 2023 03:25:07 GMT Preparing transaction: ...working... done
Sun, 27 Aug 2023 03:25:13 GMT Verifying transaction: ...working... done
Sun, 27 Aug 2023 03:25:24 GMT Executing transaction: ...working... done
Sun, 27 Aug 2023 03:25:33 GMT +++ conda install --quiet --yes pip

So pretty much all of the runtime of the pylint one is taken by conda, not pylint :\