Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TST: Make read_csv tests pyarrow 13 compatable on 2.1.x #55855

Merged
merged 3 commits into from Nov 7, 2023

Conversation

mroeschke
Copy link
Member

No description provided.

@mroeschke mroeschke added Testing pandas testing functions or related to the test suite IO CSV read_csv, to_csv Arrow pyarrow functionality labels Nov 6, 2023
@@ -86,7 +86,9 @@ def test_read_csv_local(all_parsers, csv1):

fname = prefix + str(os.path.abspath(csv1))
result = parser.read_csv(fname, index_col=0, parse_dates=True)

# TODO: make unit check more specific
if parser.engine == "pyarrow":
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we have a pyarrow version compat instead of blanket doing this? I think we should just take whatever precision pyarrow provides?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should just take whatever precision pyarrow provides?

Yeah agreed. We have the same TODO comment on the main branch where ideally we should do a version compat check (IMO it's worth investing the change there as this is just to get the 2.1.x branch green again)

@mroeschke mroeschke added this to the 2.1.3 milestone Nov 7, 2023
@mroeschke
Copy link
Member Author

Since this PR is green going to merge to allow other backport PRs to signal green if possible

@mroeschke mroeschke merged commit c9854d9 into pandas-dev:2.1.x Nov 7, 2023
39 checks passed
@mroeschke mroeschke deleted the tst/pyarrow_failures branch November 7, 2023 20:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Arrow pyarrow functionality IO CSV read_csv, to_csv Testing pandas testing functions or related to the test suite
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants