Everything You Need To Know About Google’s Vertex AI
Alphabet CEO Sundar Pichai has introduced Vertex AI, a managed machine learning platform for deploying and maintaining AI models, during his keynote speech at the recently concluded Google I/O conference. The new platform brings AutoML and AI Platform together into a unified API, client library and user interface. “When we were training algorithms before, we would have to run millions of test images,” said Jeff Houghton, chief operating officer of L’Oréal’s ModiFace, which develops augmented reality and AI digital services for the beauty industry. “Now, we can rely on the Vertex technology stack to do the heavy lifting. Vertex has the computing power to figure out complex problems. It can do billions of iterations, and Vertex comes up with the best algorithms,” Houghton added. Features Supports all open source frameworks Vertex AI integrates with popular open-source frameworks such as TensorFlow, PyTorch, and scikit-learn. It also supports all ML frameworks through custom containers for training and prediction. Unified UI for the entire ML workflow It brings together the Google Cloud services for building ML under one unified UI and API. You can efficiently train and compare models using AutoML or custom code training. A central model repository stores all your models that can deploy to the same endpoints. Pre-trained APIs Vertex AI has pre-trained APIs for vision, natural language, video, among others. You can easily incorporate them into existing applications. You can also build new applications across use cases such as Translation and Speech to Text. AutoML allows developers to train high-quality models as per their business needs with a central registry for all datasets, including vision and tabular. Integration Developers can leverage BigQuery ML to create and execute machine learning models using standard SQL queries on existing tools and spreadsheets. Alternatively, they can export datasets from BigQuery into Vertex AI for integration across the data-to-AI life cycle. Benefits According to Google, the Vertex AI platform requires fewer lines of code to train a model. Vertex AI’s custom model tooling supports advanced ML coding. It requires 80% lesser lines of code than other platforms to train a model with custom libraries. Its MLOps tools take away the complexity of self-service model maintenance and streamlines running ML pipelines and Vertex Feature Store to serve, share, and use ML features. According to Google, without requiring formal ML training, data scientists can use Vertex AI as it offers every tool they need and allows them to manage their data, prototype, experiment, deploy, interpret and monitor the models in production. Details of Vertex AI (Credit: Medium) To sum up the benefits, Vertex AI Enables training models without code and less expertiseHelps build advanced ML models with custom toolingRemoves the complexity of self-service model maintenance Vertex AI can be used for: Creation of dataset and uploading data.Training ML model on your dataTraining the modelEvaluating accuracyDeploy trained model to an endpoint for serving predictions.Sending prediction requests to the endpointSpecifying a prediction traffic split Managing models and endpoints Tools Vertex Feature StoreVertex Model MonitoringVertex Matching EngineVertex ML MetadataVertex TensorBoardVertex Pipelines Components of Vertex AI (Credit: Google) Use cases Developers can ingest data from BigQuery and Cloud Storage and use Vertex Data Labeling to annotate high-quality training data and predict with more accuracy. Vertex Feature Store can be used to serve, share, and reuse ML features. They can use Vertex Experiments to track ML experiments and Vertex TensorBoard to visualise ML experiments. Vertex Pipelines can be used to simplify the MLOps process and Vertex Training for fully managed training services. Additionally, Vertex Vizier offers maximum predictive accuracy, and Vertex Prediction simplifies the process of deploying models into production for online serving via HTTP or batch prediction for bulk scoring. Developers can get detailed model evaluation metrics and feature attributions. Moreover, Vertex ML Edge Manager, which is still in the experimental phase, can facilitate seamless deployment and monitoring of edge inferences and automated processes with flexible APIs. This will allow developers to distribute AI across private and public cloud, on-premise and edge devices. For models deployed in the Vertex Prediction service, continuous monitoring offers easy monitoring of model performance. It alerts when the signals deviate, finds out the cause and triggers model-retraining pipelines. Vertex ML Metadata allows easier tracking of inputs and outputs to components in Vertex Pipelines for artefact, lineage, and execution tracking. Lastly, developers can track custom metadata directly from their code and query metadata using a Python SDK.
Alphabet CEO Sundar Pichai has introduced Vertex AI, a managed machine learning platform for deploying and maintaining AI models, during his keynote speech at the recently concluded Google I/O conference. The new platform brings AutoML and AI Platform together into a unified API, client library and user interface. “When we were training algorithms before, we […]
Google Cloud’s Vertex AI brings AutoML and AI Platform together into a unified API, client library and user interface.
["Google Cloud", "vertex AI"]
["vertex AI", "scikit-learn", "machine learning", "Google Cloud", "TPU", "AI", "PyTorch", "ML", "MLOps", "RAG", "model monitoring", "TensorFlow"]
["AI", "machine learning", "ML", "MLOps", "model monitoring", "TensorFlow", "PyTorch", "scikit-learn", "RAG", "TPU"]
Shanthi has been a feature writer for over a decade and has worked in several print and digital media companies. She specialises in writing company profiles, interviews and trends. Through her articles for the Analytics India Magazine, she aims to humanise tech in India. She is also a mom and her favourite pastime is playing a game of monopoly or watching Gilmore Girls with her daughter.