Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add profiling step functions #886

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

guilhem-barthes
Copy link
Contributor

@guilhem-barthes guilhem-barthes commented Apr 11, 2024

Description

Allow transferring function profiling steps through the orchestrator, allowing the builder to register event without having to have http(s) requests to the backend api server (involving having access to the db to get credentials). This also allows having duration for the function available on every backend.

Still open on naming for the two new steps for the function. For now we have:

  • build_image
  • save_function

This does not include the API part for the frontend, which woudl be part of another task (FL-1518)

Fixes FL-1519

Companion PR

How has this been tested?

Checklist

  • changelog was updated with notable changes
  • documentation was updated

Copy link

linear bot commented Apr 11, 2024

Copy link
Contributor

@SdgJlbl SdgJlbl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks 👍
Unsure about how the mocks are (re)defined in this PR, I feel like it's contrary to best practices.
Also need a rebase ^^

backend/builder/tests/test_task_build_image.py Outdated Show resolved Hide resolved
backend/orchestrator/resources.py Show resolved Hide resolved
backend/substrapp/tests/compute_tasks/test_outputs.py Outdated Show resolved Hide resolved
backend/substrapp/tests/tasks/test_compute_task.py Outdated Show resolved Hide resolved
Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
…o `orchestrator`

Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
@guilhem-barthes guilhem-barthes force-pushed the feat/add-profiling-step-functions branch from 0887c24 to 115f0aa Compare May 27, 2024 14:20
Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
…ator_client`

Signed-off-by: Guilhem Barthés <guilhem.barthes@owkin.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants