Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

server: ci: windows build and tests #5968

Merged
merged 10 commits into from Mar 10, 2024

Conversation

phymbert
Copy link
Collaborator

@phymbert phymbert commented Mar 10, 2024

For the windows lovers, CI will be our safebelt 🐧

Tested in:
https://github.com/phymbert/llama.cpp/actions/runs/8220793786/job/22480374971

Attention point

  • unable to have both server stdout and process detached, we will see if it is required to see server logs later on
  • probably need a better approach to manage CR in prompt, but it generates additional tokens in usage.prompt_tokens
  • console colors are awful in github workflow console, good first issue

@phymbert phymbert requested a review from ggerganov March 10, 2024 01:04
@phymbert
Copy link
Collaborator Author

@ggerganov happy to init this new workflow although I would be more confident if we request a new automated test on each new server PR :)

examples/server/tests/features/environment.py Outdated Show resolved Hide resolved
examples/server/tests/features/steps/steps.py Outdated Show resolved Hide resolved
examples/server/tests/features/steps/steps.py Outdated Show resolved Hide resolved
examples/server/tests/features/steps/steps.py Outdated Show resolved Hide resolved
@phymbert
Copy link
Collaborator Author

@cebtenzzre, I appreciate your review, I will integrate your suggestions later on today. Meanwhile, can you figure out a way to have both server stdout logs and be able to kill the process without killing behave parent process ?
Here is the original #5566. Feel free to review it and submit patches.

@phymbert phymbert merged commit fa8a809 into ggerganov:master Mar 10, 2024
27 checks passed
@phymbert phymbert deleted the hp/server/ci/windows/init branch March 10, 2024 17:17
NeoZhangJianyu pushed a commit to NeoZhangJianyu/llama.cpp that referenced this pull request Mar 12, 2024
* server: ci: windows build and tests

* server: ci: remove tmp push branch

* server: ci: EOF EOL

* Use builti

Co-authored-by: Jared Van Bortel <[email protected]>

* server: tests: server graceful shutdown, then kill, then hard kill

* server: tests: remove python2 unicode string

* server: tests: remove wrong comment on server starting,  close_fds is always true

* server: tests: server kill, if pid exists

* server: tests: remove dependency to killall

* server: tests: ci windows: pid exists better handling

---------

Co-authored-by: Jared Van Bortel <[email protected]>
jordankanter pushed a commit to jordankanter/llama.cpp that referenced this pull request Mar 13, 2024
* server: ci: windows build and tests

* server: ci: remove tmp push branch

* server: ci: EOF EOL

* Use builti

Co-authored-by: Jared Van Bortel <[email protected]>

* server: tests: server graceful shutdown, then kill, then hard kill

* server: tests: remove python2 unicode string

* server: tests: remove wrong comment on server starting,  close_fds is always true

* server: tests: server kill, if pid exists

* server: tests: remove dependency to killall

* server: tests: ci windows: pid exists better handling

---------

Co-authored-by: Jared Van Bortel <[email protected]>
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 1, 2024
* server: ci: windows build and tests

* server: ci: remove tmp push branch

* server: ci: EOF EOL

* Use builti

Co-authored-by: Jared Van Bortel <[email protected]>

* server: tests: server graceful shutdown, then kill, then hard kill

* server: tests: remove python2 unicode string

* server: tests: remove wrong comment on server starting,  close_fds is always true

* server: tests: server kill, if pid exists

* server: tests: remove dependency to killall

* server: tests: ci windows: pid exists better handling

---------

Co-authored-by: Jared Van Bortel <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants