AWS re:Invent NVIDIA Corporation announced a generative AI microservice that lets enterprises connect custom large language models to enterprise data to deliver highly accurate responses for their AI applications. NVIDIA NeMo? Retriever -- a new offering in the NVIDIA NeMo family of frameworks and tools for building, customizing and deploying generative AI models -- helps organizations enhance their generative AI applications with enterprise-grade retrieval-augmented generation (RAG) capabilities.
As a semantic-retrieval microservice, NeMo Retriever helps generative AI applications provide more accurate responses through NVIDIA-optimized algorithms. Developers using the microservice can connect their AI applications to business data wherever it resides across clouds and data centers. It adds NVIDIA-optimized RAG capabilities to AI foundries and is part of the NVIDIA AI Enterprise software platform, available in AWS Marketplace. Cadence, Dropbox, SAP and ServiceNow are among the pioneers working with NVIDIA to build production-ready RAG capabilities into their custom generative AI applications and services.
Global Leaders Enhance LLM Accuracy With NeMo Retriever: Electronic systems design leader Cadence serves companies across hyperscale computing, 5G communications, automotive, mobile, aerospace, consumer and healthcare markets. It is working with NVIDIA to develop RAG features for generative AI applications in industrial electronics design. Cracking the Code for Accurate Generative AI Applications: Unlike open-source RAG toolkits, NeMo Retriever supports production-ready generative AI with commercially viable models, API stability, security patches and enterprise support.
NVIDIA-optimized algorithms power the highest accuracy results in Retriever?s embedding models. The optimized embedding models capture relationships between words, enabling LLMs to process and analyze textual data. Using NeMo Retriever, enterprises can connect their LLMs to multiple data sources and knowledge bases, so that users can easily interact with data and receive accurate, up-to-date answers using simple, conversational prompts.
Businesses using Retriever-powered applications can allow users to securely gain access to information spanning numerous data modalities, such as text, PDFs, images and videos. Enterprises can use NeMo Retriever to achieve more accurate results with less training, speeding time to market and supporting energy efficiency in the development of generative AI applications. Reliable, Simple, Secure Deployment With NVIDIA AI Enterprise: Companies can deploy NeMo Retriever-powered applications to run during inference on NVIDIA-accelerated computing on virtually any data center or cloud.
NVIDIA AI Enterprise supports accelerated, high-performance inference with NVIDIA NeMo, NVIDIA Triton Inference Server?, NVIDIA TensorRT?, NVIDIA TensorRT-LLM and other NVIDIA AI software. Availability: Developers can sign up for early access to NVIDIA NeMo Retriever.