Tag: onnx
All the articles with the tag "onnx".
Serving ML Models in Production with FastAPI + ONNX
Published: at 10:00 AMLearn how to serve machine learning models in production using FastAPI and ONNX Runtime. Export a Hugging Face NLP model to ONNX, build a REST inference endpoint, benchmark performance against native PyTorch, and containerize the service with Docker.