By Deborah Taylor,
Data center infrastructure supplier Nutanix Inc. has released GPT-in-a-Box, a toolkit designed to assist companies in starting artificial intelligence (AI) and machine learning projects without compromising their data or budget. GPT-in-a-Box is described as a full-stack, software-defined AI-ready platform that offers services to help organizations size and configure hardware and software infrastructure. It supports a curated set of large language models using open-source AI and machine learning frameworks.
The new offering addresses the concerns of companies interested in working with AI but worried about intellectual property, compliance, privacy, and the management of costs. According to McKinsey & Co., cybersecurity, regulatory compliance, privacy, and model explainability are the main risks that hinder organizations from investing in AI. Nutanix aims to provide a customer-controlled AI infrastructure package that allows businesses to deploy AI on the edge or in a data center, while also ensuring security and data protection.
Nutanix GPT-in-a-Box includes a range of features such as cloud infrastructure, file and object storage, the Nutanix AHV hypervisor, the Kubernetes platform with Nvidia Corp.’s GPU acceleration, and services for sizing clusters and deploying deep learning and MLOps frameworks. It also offers an inference server and a curated set of large language models, including Llama2, Falcon LLM, and MosaicML. Data scientists can immediately utilize the models with their choice of applications and interface, and the platform allows for the utilization of other GPT models and fine-tuning of models with internal data.
Source: fagenwasanni.com
Original Content:
https://shorturl.at/ilsyG
