Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable test recently re-enabled BindingUpdatesFromInteractiveRefresh #28314

Merged
merged 1 commit into from
Mar 11, 2025

Conversation

PureWeen
Copy link
Member

Description of Change

#28137 re-enabled this test a couple of weeks ago and it's still not 100 percent. This test doesn't represent a change/break in behavior

@Copilot Copilot bot review requested due to automatic review settings March 11, 2025 14:33
@PureWeen PureWeen requested a review from a team as a code owner March 11, 2025 14:33
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR disables the unreliable "BindingUpdatesFromInteractiveRefresh" test by extending the preprocessor condition.

  • Extended the conditional compilation to disable the test on Windows (in addition to Catalysts).

@@ -26,7 +26,7 @@ public void BindingUpdatesFromProgrammaticRefresh()
App.Tap("StopRefreshing");
App.WaitForElement("IsNotRefreshing");
}
#if TEST_FAILS_ON_CATALYST //Scroll actions cannot be performed on the macOS test server
#if TEST_FAILS_ON_CATALYST || TEST_FAILS_ON_WINDOWS //Scroll actions cannot be performed on the macOS test server
Copy link
Preview

Copilot AI Mar 11, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The preprocessor condition now includes TEST_FAILS_ON_WINDOWS, but the inline comment only references macOS. Please update the comment to accurately reflect why the test is also disabled on Windows.

Copilot is powered by AI, so mistakes are possible. Review output carefully before use.

@PureWeen PureWeen added this to the .NET 9 SR5 milestone Mar 11, 2025
@@ -26,7 +26,7 @@ public void BindingUpdatesFromProgrammaticRefresh()
App.Tap("StopRefreshing");
App.WaitForElement("IsNotRefreshing");
}
#if TEST_FAILS_ON_CATALYST //Scroll actions cannot be performed on the macOS test server
#if TEST_FAILS_ON_CATALYST || TEST_FAILS_ON_WINDOWS //Scroll actions cannot be performed on the macOS test server
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The message seems not correct. The scroll actions are implement in both, Catalyst and Windows. The test was fixed in Catalyst using the App.DragCoordinates extension method instead App.ScrollDown because sometimes failed (apparently only on CI and requires investigation). On Windows, noticed that failed using the DragCoordinates and applied a small change to fix it here https://github.com/dotnet/maui/pull/28306/files#diff-a4088a095757b5ff1e88b995d447f75adfd3f5afd469cf03ac4bd90126e30f3d

Wouldn't it be better to mark them as FlakyTest and leave a comment with an issue link to re-enable it?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd rather just get rid of the FlakeyTestAttribute
I don't think it's a the safest way to make sure we are addressing tests that start becoming flakey. We don't have any motivation really to just ignore tests in most cases.

In this case, this is a test that was re-added in around 2 weeks ago because it was already flakey
So it's not really a new test

it was already a disabled test and now I'm just re-disabling it, because when it was originally added it was wrong
So this PR is essentially just a revert

If we look at the graph for this test it's been failing since it was originally merged
image

@PureWeen PureWeen merged commit 1f20d6a into main Mar 11, 2025
40 of 76 checks passed
@PureWeen PureWeen deleted the ignore_BindingUpdatesFromInteractiveRefresh_winui branch March 11, 2025 16:48
rmarinho pushed a commit that referenced this pull request Mar 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

None yet

3 participants