Updated docs #314

dtrawins · 2020-10-19T07:29:54Z

No description provided.

…cumentation Added new documentation files

…cumentation OpenVINO model server documentation

…com/shreyas-chaudhari/model_server into OpenVINO-Model-Server-Documentation

…lient

…com/shreyas-chaudhari/model_server into OpenVINO-Model-Server-Documentation

pgierasi · 2020-10-21T20:15:57Z

example_client/README.md

+| -n NETWORK_NAME, --network_name NETWORK_NAME   |   Network name      |
+| -l INPUT_LAYER, --input_layer INPUT_LAYER | Input layer name |
+| -o OUTPUT_LAYER, --output_layer OUTPUT_LAYER | Output layer name | 
+| -d INPUT_DIMENSION, --input_dimension INPUT_DIMENSION | Input image dimension |


--frame_size instead of --input_dimension

pgierasi · 2020-10-21T22:30:29Z

docs/ovms_quickstart.md

 ```

 ### Step 4: Start the Model Server Container

 Start the Model Server container:

 ```bash
-docker run -d -v <folder_with_downloaded_model>:/models/face-detection/1 -p 9000:9000 openvino/model_server:latest \
+docker run -d -v <folder_with_downloaded_model>:/models/face-detection -p 9000:9000 openvino/model_server:latest \


This will not work, no models/face-detection directory

pgierasi · 2020-10-21T22:50:29Z

docs/architecture.md

-gRPC code skeleton is created based on TensorFlow Serving core framework with tunned implementation of requests handling. 
-Services are designed via set of C++ classes managing AI models in Intermediate Representation 
-format. OpenVINO Inference Engine component executes the graphs operations.
+- OpenVINO&trade; Model Server uses [Inference Engine](https://docs.openvinotoolkit.org/latest/openvino_docs_IE_DG_inference_engine_intro.html) libraries from OpenVINO&trade; toolkit in the backend, which speeds up the execution on CPU and enables it on AI accelerators like [Neural Compute Stick 2](https://software.intel.com/content/www/us/en/develop/hardware/neural-compute-stick.html), iGPU(Integrated Graphics Processing Unit), [HDDL](https://docs.openvinotoolkit.org/2018_R5/_docs_IE_DG_supported_plugins_HDDL.html) and FPGAs.


pgierasi · 2020-10-21T22:55:37Z

docs/architecture.md

+
+- OpenVINO&trade; Model Server requires the models to be present in the local file system or they could be hosted remotely on object storage services. Both Google Cloud Storage and S3 compatible storage are supported. Refer to [Preparing the Models Repository](./models_repository.md) for more details.
+
+- OpenVINO&trade; Model Server is suitable for landing in Kubernetes environment. It can be also hosted on a bare metal server, virtual machine or inside a docker container. It is also suitable for landing in Kubernetes environment. 


suitable for landing in Kubernetes environment - mentioned twice

pgierasi · 2020-10-22T11:49:39Z

docs/ModelServerGRPCAPI.md

+ * *PredictResponse* includes a map of outputs serialized by 
+[TensorProto](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/framework/tensor.proto) and information about the used model spec.
+
+There are two ways in which gRPC request can be submitted for Predict API:


This is not true

pgierasi · 2020-10-22T11:50:49Z

docs/docker_container.md

@@ -1,165 +1,115 @@
-# Using the OpenVINO&trade; Model Server in a Docker Container
+# Installing OpenVINO&trade; Model Server for Linux using Docker Container


Installing using docker?

pgierasi · 2020-10-22T12:13:06Z

README.md

@@ -17,23 +17,23 @@ Review the [Architecture concept](docs/architecture.md) document for more detail

 A few key features: 
 - Support for multiple frameworks. Serve models trained in popular formats such as Caffe*, TensorFlow*, MXNet* and ONNX*.
- Deploy new [model versions](https://github.com/openvinotoolkit/model_server/blob/main/docs/docker_container.md#model-version-policy) without changing client code.
+- Deploy new [model versions](docs/ModelVersionPolicy.md) without changing client code.


without OVMS restart

pgierasi · 2020-10-22T12:23:59Z

docs/ensemble_scheduler.md

+    * Pre-defined Node Types
+    * Other Node Types
+* <a href="#example">Example Use Case</a>
+    1. Prepare the models


i, ii, iii, iv, v?

pgierasi · 2020-10-22T12:26:14Z

docs/ensemble_scheduler.md

+### Other node types
+Internal pipeline nodes are created by user. Currently there is only one node type that a user can create:
+* DL model
+    - This node contains underlying OpenVINO&trade; model and performs inference on selected target device. This can be defined in configuration file. Each model input needs to be mapped to some node's `data_item` - be it input from gRPC/REST request or another `DL model` output. Results of this node's inference may be mapped to another node's input or `response` node meaning it will be exposed in gRPC/REST response. 


"be it input from" ?

pgierasi · 2020-10-22T12:39:21Z

docs/ensemble_scheduler.md

-python3 tests/models/argmax_sum.py --input_size 1001 --export_dir ~/models/tf_argmax
+3. Prepare argmax model with `(1, 1001)` input shapes to match output of googlenet and resnet output shapes. Generated model will sum inputs and calculate the index with the highest value. The model output will indicate the most likely predicted class from the ImageNet* dataset. <a name="point-3"></a>
+```
+~$ python3 tests/models/argmax_sum.py --input_size 1001 --export_dir models/public/argmax/saved_model


incorrect export directory, should be under ~/models/

pgierasi · 2020-10-22T21:03:31Z

docs/ModelVersionPolicy.md

+{"specific": { "versions": List }}
+Examples:
+
+{"latest": { "num_versions":2 }} # server will serve only 2 latest versions of model


new lines not visible in browser

pgierasi · 2020-10-22T21:17:56Z

docs/ModelVersionPolicy.md

+## Updating model versions
+- Served versions are updated online by monitoring file system changes in the model storage. OpenVINO Model Server will add new version to the serving list when new numerical subfolder with the model files is added. The default served version will be switched to the one with the highest number. 
+
+- When the model version is deleted from the file system, it will become unavailable on the server and it will release RAM allocation. Updates in the deployed model version files will not be detected and they will not trigger changes in serving.


Updates in the deployed deleted model?

pgierasi · 2020-10-22T21:37:41Z

docs/AgeGenderGuide.md

+
+3. Run the above code snippet to send POST API request to predict results by providing formatted json as request body using the command :
+```Bash
+python3 sample.py


example not working

pgierasi · 2020-10-22T21:49:20Z

docs/FaceDetectionScriptExample.md

+
+```bash
+curl --create-dirs https://download.01.org/opencv/2021/openvinotoolkit/2021.1/open_model_zoo/models_bin/1/face-detection-retail-0004/FP32/face-detection-retail-0004.xml https://download.01.org/opencv/2021/openvinotoolkit/2021.1/open_model_zoo/models_bin/1/face-detection-retail-0004/FP32/face-detection-retail-0004.bin -o model/1/face-detection-retail-0004.xml -o model/1/face-detection-retail-0004.bin
+docker run -d -v $(pwd)/model:/models -p 9000:9000 openvino/model_server:latest  --model_path /models --model_name face-detection --port 9000  --shape auto


[2020-10-22 21:47:38.396] [serving] [error] Couldn't list directories in path: /models
[2020-10-22 21:47:38.396] [serving] [error] Couldn't start model manager
[2020-10-22 21:47:38.396] [serving] [error] ovms::ModelManager::Start() Error: The provided base path is invalid or doesn't exists

pgierasi · 2020-10-22T22:17:53Z

docs/host.md

+> * An internet connection is required to follow the steps in this guide.
+
+## Introduction
+OpenVINO&trade; Model Server is a Python* implementation of gRPC and RESTful API interfaces defined by Tensorflow serving. 


is a Python implementation?

# Conflicts: # docs/models_repository.md

mzegla

From my side it's okay, but I see you didn't make all the changes requested by @pgierasi in example_client/README.md

dtrawins · 2020-10-30T09:09:33Z

@mzegla @pgierasi all requested changes in example_client/README.md are already added

# Conflicts: # docs/contributing.md

shreyas-chaudhari and others added 30 commits October 12, 2020 10:36

Added new documentation files

20cb346

Merge pull request #1 from shreyas-chaudhari/OpenVINO-Model-Server-Do…

a786e9e

…cumentation Added new documentation files

Changes in RESTAPI and installation of OVMS on VM

60a2a46

Fixed colons

05ea718

changes to installation guide

32f331b

Changes installation file

08b8c58

Update InstallationsLinuxDocker.md

b451027

Update InstallationsKubernetes.md

c4b54b7

Update InstallationsKubernetes.md

524944f

Merge pull request #2 from shreyas-chaudhari/OpenVINO-Model-Server-Do…

76e3c2c

…cumentation OpenVINO model server documentation

Changed file names, links and moved images to doc folder

e18762d

Resolved merge conflict

5d0d921

Changed file name

2f86c30

combined guides, changed version policy

8044bae

Merge branch 'OpenVINO-Model-Server-Documentation' of https://github.…

1d2da1d

…com/shreyas-chaudhari/model_server into OpenVINO-Model-Server-Documentation

removed opencv

1534c75

Changed docker image to latest

bbb3777

Merge branch 'OpenVINO-Model-Server-Documentation' of https://github.…

139eded

…com/shreyas-chaudhari/model_server into OpenVINO-Model-Server-Documentation

added ovms quick start

e818143

Merge branch 'OpenVINO-Model-Server-Documentation' of https://github.…

205a9de

…com/shreyas-chaudhari/model_server into OpenVINO-Model-Server-Documentation

Update README.md

620c70d

Made changes to seperate examples from gRPC API doc

3991e21

Made changes in REST API and gRPC API section

70fdef4

Added example_client.md and moved examples from REST API to example c…

7ab1dab

…lient

Merge branch 'OpenVINO-Model-Server-Documentation' of https://github.…

57df2be

…com/shreyas-chaudhari/model_server into OpenVINO-Model-Server-Documentation

Included links for examples

a8e0eb9

Fixed broken links

b159629

Made changes in the links

4c5f22f

Added link and changed heading

64594b0

Restructured README.md

4d9b04b

pgierasi reviewed Oct 21, 2020

View reviewed changes

pgierasi reviewed Oct 22, 2020

View reviewed changes

dtrawins added 3 commits October 27, 2020 00:42

review from piotr

00d8bfa

Merge remote-tracking branch 'remotes/origin/main' into shreyas-docs

ddbe4a0

# Conflicts: # docs/models_repository.md

docker_contaner rearangements

bb32469

dtrawins requested a review from mzegla October 28, 2020 14:44

mzegla approved these changes Oct 30, 2020

View reviewed changes

pgierasi approved these changes Nov 2, 2020

View reviewed changes

dtrawins added 2 commits November 2, 2020 15:07

Merge remote-tracking branch 'remotes/origin/main' into shreyas-docs

cf5bf84

# Conflicts: # docs/contributing.md

merge from master

fd994a3

pgierasi approved these changes Nov 2, 2020

View reviewed changes

pgierasi approved these changes Nov 3, 2020

View reviewed changes

dtrawins merged commit 52d06ef into main Nov 3, 2020

This was referenced Nov 3, 2020

Update ovms_quickstart.md #306

Closed

OpenVINO Model Server Documentation #308

Closed

mgumowsk deleted the shreyas-docs branch December 15, 2020 08:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Updated docs #314

Updated docs #314

dtrawins commented Oct 19, 2020

pgierasi Oct 21, 2020

pgierasi Oct 21, 2020

pgierasi Oct 21, 2020

pgierasi Oct 21, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020 •

edited

Loading

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

pgierasi Oct 22, 2020

mzegla left a comment

dtrawins commented Oct 30, 2020


		- OpenVINO™ Model Server requires the models to be present in the local file system or they could be hosted remotely on object storage services. Both Google Cloud Storage and S3 compatible storage are supported. Refer to [Preparing the Models Repository](./models_repository.md) for more details.

		- OpenVINO™ Model Server is suitable for landing in Kubernetes environment. It can be also hosted on a bare metal server, virtual machine or inside a docker container. It is also suitable for landing in Kubernetes environment.

		@@ -1,165 +1,115 @@
		# Using the OpenVINO™ Model Server in a Docker Container
		# Installing OpenVINO™ Model Server for Linux using Docker Container

Updated docs #314

Updated docs #314

Conversation

dtrawins commented Oct 19, 2020

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

pgierasi Oct 22, 2020 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

mzegla left a comment

Choose a reason for hiding this comment

dtrawins commented Oct 30, 2020

pgierasi Oct 22, 2020 •

edited

Loading