You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I try to delete the InferenceService created by Arena, I found the pod stuck in Terminating state for a very long time. It seems that my python3 process does not receive SIGTERM signal so the Pod keep terminating until it reaches TerminationGracePeriod which is set to 300s by default.
IMO, ability to handle SIGTERM signal is necessary for serving Pods because they may rely on such signals to stop gracefully (e.g. refuse new coming request and wait for running requests to finish).
The text was updated successfully, but these errors were encountered:
I'm running Kserve serving with arena, with the following command:
When I try to delete the
InferenceService
created by Arena, I found the pod stuck in Terminating state for a very long time. It seems that mypython3
process does not receive SIGTERM signal so the Pod keep terminating until it reachesTerminationGracePeriod
which is set to 300s by default.IMO, ability to handle SIGTERM signal is necessary for serving Pods because they may rely on such signals to stop gracefully (e.g. refuse new coming request and wait for running requests to finish).
The text was updated successfully, but these errors were encountered: