Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add steps for how to run gpu docker container #191

Closed
chauhang opened this issue Apr 12, 2020 · 2 comments · Fixed by #308
Closed

Add steps for how to run gpu docker container #191

chauhang opened this issue Apr 12, 2020 · 2 comments · Fixed by #308
Assignees
Labels
documentation Improvements or additions to documentation
Milestone

Comments

@chauhang
Copy link
Contributor

Please add the steps for running GPU docker container in the docker readme. Steps should describe how to specify the gpus to be used on a multi-gpu machine

eg

docker run --rm -it --gpus device=0 -p 8080:8080 -p 8081:8081 torchserve:v0.1-gpu-latest

where device=0,1,2,3 selects GPUs indexed by ordinals 0,1,2 and 3, respectively. torchserve will see only these GPUs. If you specify device=all, then the torchserve will see all the available GPUs.

@chauhang chauhang added the documentation Improvements or additions to documentation label Apr 12, 2020
@adityabindal adityabindal marked this as a duplicate and then as not a duplicate of #179 Apr 13, 2020
@fbbradheintz fbbradheintz added this to the v0.1.1 milestone Apr 24, 2020
@adityabindal adityabindal removed this from the v0.1.1 milestone Apr 30, 2020
@fbbradheintz
Copy link
Contributor

I just checked docker/README.md, and it looks like it contains the required examples for GPU usage. @aaronmarkham , I assigned to you so you can verify the content is up to standard - you can close this issue if you're satisfied.

@pytorch pytorch deleted a comment from adityabindal May 8, 2020
@chauhang chauhang added this to the v0.1.1 milestone May 8, 2020
@aaronmarkham aaronmarkham removed their assignment May 13, 2020
@maaquib maaquib self-assigned this May 20, 2020
@maaquib
Copy link
Collaborator

maaquib commented May 21, 2020

Steps added to README as part of #308

@maaquib maaquib closed this as completed May 21, 2020
@maaquib maaquib reopened this May 21, 2020
@maaquib maaquib linked a pull request May 21, 2020 that will close this issue
8 tasks
@maaquib maaquib closed this as completed Jun 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants