NVIDIA is offering a four-hour, self-paced course on MLOps
NVIDIA Deep Learning Institute (DLI) is offering a four-hour, self-paced course titled “Deploying a Model for Inference at Production Scale” that introduces MLOps coupled with hands-on practice with a live NVIDIA Triton Inference Server. The course’s learning objectives include: Deploying neural networks from a variety of frameworks onto a live NVIDIA TritonServer.Measuring GPU usage and other metrics with Prometheus.Sending asynchronous requests to maximise throughput. Upon completion, developers will deploy their models on an NVIDIA Triton Server. What is Triton Server? NVIDIA Triton Inference Server helps data scientists and system administrators turn the same machines you use to train your models into a web server for model prediction. Though GPU is not required, the server can take advantage of multiple installed GPUs to quickly process large batches of requests. NVIDIA Triton was created with Machine Learning Operations (MLOps). This is a relatively new field evolved from Developer Operations, or DevOps, to focus on scaling and maintaining ML models in a production environment. NVIDIA Triton is equipped with features such as model versioning for easy rollbacks. Triton is also compatible with Prometheus to track and manage server metrics such as latency and request count. Register for this free course on Data & Analytics.
NVIDIA Triton helps data scientists and system administrators turn models into a web server for model prediction using the same training machine
NVIDIA Triton helps data scientists and system administrators turn models into a web server for model prediction using the same training machine
[]
["machine learning", "programming_languages:R", "AI", "neural network", "ML", "MLOps", "deep learning", "analytics", "DevOps", "R"]
["AI", "machine learning", "ML", "deep learning", "neural network", "analytics", "MLOps", "R", "DevOps", "programming_languages:R"]
Poornima Nataraj has worked in the mainstream media as a journalist for 12 years, she is always eager to learn anything new and evolving. Witnessing a revolution in the world of Analytics, she thinks she is in the right place at the right time.