Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(GH workflow): migrate postsubmit tests to github actions. Fixes #10747 #10824

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

VDliveson
Copy link

Description of your changes:
Adds Github actions for postsubmit tests on push to master or release branch. Fixes #10747

Checklist:

cc @rimolive

Copy link

Hi @VDliveson. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign chensun for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Signed-off-by: VDliveson <vanshajduggal1234@gmail.com>
@hbelmiro
Copy link
Contributor

/ok-to-test

with:
cluster_name: build-kubeflow
- name: Run tests
run: |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe you would need to add backlashes \ at the end of each line in this command. Here's how you can format it correctly:

run: |
  ./test/postsubmit-tests-with-pipeline-deployment.sh \
    --kfp_deployment mkp \
    --workflow_file e2e_test_gke_v2.yaml \
    --test_result_folder e2e_test \
    --timeout "7200"

or you can format it to be in a single line:

run: ./test/postsubmit-tests-with-pipeline-deployment.sh --kfp_deployment mkp --workflow_file e2e_test_gke_v2.yaml --test_result_folder e2e_test --timeout "7200"

Signed-off-by: VDliveson <vanshajduggal1234@gmail.com>
@DharmitD
Copy link
Contributor

@VDliveson have you tried testing this GH Action on your fork? If yes, could you please provide the link to a successful run?

@@ -39,7 +39,7 @@ jobs:
with:
cluster_name: build-kubeflow
- name: Run tests
run: |
run: >
Copy link
Contributor

@DharmitD DharmitD May 20, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

have you tested this out? I believe backslashes would be required even with the folded style.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will update this but this still must work

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@VDliveson
Copy link
Author

VDliveson commented May 21, 2024

@DharmitD Kindly also take a look at the periodic functional tests and is there any way to disable it. I've been spammed with 100+ mails with failed workflow. Also the old tests need python 3.7 version but we get this error on python 3.7
image

image

@VDliveson
Copy link
Author

@VDliveson have you tried testing this GH Action on your fork? If yes, could you please provide the link to a successful run?

https://github.com/VDliveson/pipelines/actions/workflows/postsubmit.yml
Running some sample tests

@DharmitD
Copy link
Contributor

@DharmitD Kindly also take a look at the periodic functional tests and is there any way to disable it. I've been spammed with 100+ mails with failed workflow. Also the old tests need python 3.7 version but we get this error on python 3.7 image

image

@VDliveson I'm looking into periodic tests GH Action and it looks like it's scheduled to run every 5 minutes, that's the problem. I will bring this up in community but make sure to turn off email notifications for repo GH Actions so it doesn't incessantly ping you with so many notifications.

@DharmitD
Copy link
Contributor

@chensun looks like the postsubmit prow config forwards test results to TestGrid: https://github.com/GoogleCloudPlatform/oss-test-infra/blob/master/prow/prowjobs/kubeflow/pipelines/kubeflow-pipelines-postsubmits.yaml#L14
Do we utilize this notifications’ mechanism? Do we need it in the kind workflows too?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Migrate postsubmit tests to GH Actions
3 participants