Skip to content

docs: clarify multi-GPU runtime setup#24

Open
SufianTA wants to merge 1 commit into
mims-harvard:mainfrom
SufianTA:docs/multigpu-runtime-notes
Open

docs: clarify multi-GPU runtime setup#24
SufianTA wants to merge 1 commit into
mims-harvard:mainfrom
SufianTA:docs/multigpu-runtime-notes

Conversation

@SufianTA

Copy link
Copy Markdown

Summary

  • document that the default examples use the normal TxAgent load_models path
  • add guidance for users who manually initialize vLLM with tensor parallel settings
  • call out the TxAgent initialization steps needed before run_multistep_agent()

Validation

  • git diff --check
  • python -m compileall -q src run_example.py run_txagent_app.py

Addresses #18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant