Skip to content

refactor: dummy request creation #5192

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

refactor: dummy request creation #5192

wants to merge 4 commits into from
+251 −118

Conversation

lfr-0531
Copy link
Collaborator

Description

  • Move the create_dummy_requests to llm_requests.py
  • Add prepare_dummy_resources to resource managers to prepare resources for dummy requests

@lfr-0531 lfr-0531 requested a review from QiJune June 13, 2025 08:01
@lfr-0531 lfr-0531 requested review from a team as code owners June 13, 2025 08:01
@lfr-0531 lfr-0531 requested a review from mikeiovine June 13, 2025 08:01
@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 0ea7888 to 86b6d1b Compare June 13, 2025 08:02
@lfr-0531
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8767 [ run ] triggered by Bot

@lfr-0531 lfr-0531 removed the request for review from mikeiovine June 13, 2025 08:25
@tensorrt-cicd
Copy link
Collaborator

PR_Github #8767 [ run ] completed with state ABORTED

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 86b6d1b to 8ae8f47 Compare June 15, 2025 00:25
@lfr-0531
Copy link
Collaborator Author

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8902 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8902 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6487 completed with status: 'FAILURE'

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 8ae8f47 to 35380eb Compare June 15, 2025 15:18
@lfr-0531
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8938 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #8938 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6520 completed with status: 'FAILURE'

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 35380eb to 5737ae9 Compare June 17, 2025 02:31
@lfr-0531
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9097 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9097 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6657 completed with status: 'FAILURE'

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 5737ae9 to 36eb521 Compare June 17, 2025 05:17
@lfr-0531
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9136 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9136 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6689 completed with status: 'FAILURE'

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 36eb521 to 6f42498 Compare June 17, 2025 12:39
@lfr-0531
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9206 [ run ] triggered by Bot

@lfr-0531
Copy link
Collaborator Author

/bot kill

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 6f42498 to f2a2dfa Compare June 18, 2025 02:24
@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from f2a2dfa to 249059b Compare June 18, 2025 02:25
@lfr-0531
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9282 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9282 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6811 completed with status: 'FAILURE'

@lfr-0531 lfr-0531 force-pushed the user/fanrongl/refactor_dummy_request branch from 249059b to 6121963 Compare June 18, 2025 09:01
@lfr-0531
Copy link
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9354 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9354 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6866 completed with status: 'FAILURE'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@QiJune QiJune Awaiting requested review from QiJune

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@lfr-0531 @tensorrt-cicd