Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow charset normalizer >=2 and <4 #6261

Merged
merged 6 commits into from Oct 20, 2022
Merged

Allow charset normalizer >=2 and <4 #6261

merged 6 commits into from Oct 20, 2022

Conversation

deedy5
Copy link
Contributor

@deedy5 deedy5 commented Oct 20, 2022

charset-normalizer 3.0.0 has been released.

Copy link
Contributor

@sigmavirus24 sigmavirus24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's little value to raising the lower bound and much more grief for users

@deedy5
Copy link
Contributor Author

deedy5 commented Oct 20, 2022

v3.0.0 up to 4x faster than v2.1
https://github.com/Ousret/charset_normalizer/releases/tag/3.0.0
https://charset-normalizer.readthedocs.io/en/latest/community/speedup.html

@deedy5 deedy5 changed the title Allow charset normalizer >=3 and <4 Allow charset normalizer >=2 and <4 Oct 20, 2022
@sigmavirus24
Copy link
Contributor

Yes, and given this isn't critical path for most users it's not critical to force people through a major version change to get that. If they use character detection of any sort and need performance they can force it to upgrade, but that's not our job

@nateprewitt
Copy link
Member

Thanks @deedy5!

@arossert
Copy link

Any estimation on a new release with this fix?

hswong3i added a commit to alvistack/psf-requests that referenced this pull request Oct 27, 2022
    git clean -xdf
    tar zcvf ../python-requests_2.28.1.orig.tar.gz --exclude=.git .
    debuild -uc -us
    cp python-requests.spec ../python-requests_2.28.1-1.spec
    mv ../python*-requests*2.28.1*.{gz,xz,spec,dsc} /osc/home\:alvistack/psf-requests-2.28.1
    rm -rf ../python*-requests_2.28.1*.*

See psf#6261

Signed-off-by: Wong Hoi Sing Edison <hswong3i@pantarei-design.com>
@nateprewitt nateprewitt added this to the 2.29.0 milestone Nov 16, 2022
@nateprewitt
Copy link
Member

This should now be available on PyPI in Requests 2.28.2.

chosak added a commit to cfpb/consumerfinance.gov that referenced this pull request Apr 19, 2023
We currently pin requests to version 2.27.1. This was last bumped in
May of 2022 in 24808f0. Over time its
version has been incremented a few times.

Currently if you run tox you see an error like this:

> /home/runner/work/consumerfinance.gov/consumerfinance.gov/.tox/unittest/lib/python3.8/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.15) or chardet (5.1.0)/charset_normalizer (2.0.12) doesn't match a supported version!

For example, a recent GHA run:

https://github.com/cfpb/consumerfinance.gov/actions/runs/4737203702/jobs/8409716743

I'm not entirely sure why this started showing up now, but it seems to
have to do with psf/requests#6261.

Removing our requests pin seems to work fine.
matthewarmand pushed a commit to matthewarmand/requests that referenced this pull request May 10, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Jan 30, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants