Using Deployment Frameworks with PyTorch
Explore how to convert PyTorch-trained image classification models into ONNX and OpenVINO formats for deployment. Understand the key differences in deployment performance and batch size effects, and learn practical steps to optimize model inference on various hardware platforms using these frameworks.
We'll cover the following...
Deployment with ONNX
The ONNX framework provides us with very handy libraries to convert our PyTorch-implemented image classification model without any difficulties.
Check the onnx_deploy.ipynb file to see how to convert our previously trained PyTorch model to ONNX and run inference faster. This section’s coding tutorial is not for rerunning but only examining the code along with the results produced using our previously trained model.
Note: We can’t put the trained model ( ...