Skip to content

CNTK Evaluate Multiple Models

Alexey Orlov edited this page Mar 30, 2017 · 9 revisions

IMPORTANT! Before reading further you may want to get familiar with the naming scheme of CNTK Shared Library files.

##Overview The CNTK evaluation library (Cntk.Eval and its .Net wrapper Cntk.Eval.Wrapper in Windows and libCntk.Eval in Linux) enables programmatic evaluation of a CNTK model, using a single thread for evaluation. In other words, multiple-concurrent evaluations of a single model instance are not supported. However, it is possible to load multiple instances of a model and evaluate each model with a single thread. This enables multiple models to be evaluated in parallel, yet each model with a single thread.

##Example Refer to the EvaluateMultipleModels method in the CSEvalClient program for an example of a possible implementation for evaluating multiple models concurrently.

Clone this wiki locally