Sunday, 14 September 2025
27.7 C
Singapore
28.6 C
Thailand
20.2 C
Indonesia
28.1 C
Philippines

New Relic enhances AI deployment through NVIDIA integration

New Relic integrates with NVIDIA to boost AI deployment and monitoring, ensuring faster ROI and enhanced operational efficiency.

New Relic, renowned for its comprehensive observability platforms, has announced an integration with NVIDIA NIM inference microservices, aimed at simplifying the development, deployment, and monitoring of generative AI applications. This partnership seeks to boost the adoption and return on investment (ROI) of AI technologies by providing advanced monitoring solutions that ensure efficient and secure data management.

By utilising New Relic’s AI monitoring capabilities, users can gain in-depth insights across the entire AI application stack, which facilitates high performance and data security. The integration with NVIDIA’s NIM, celebrated for its strong security features and user-friendly models, enhances the swift deployment of generative AI applications, leading to quicker returns and improved productivity.

The pivotal role of observability in AI advancements

As the adoption of generative AI continues to expand across various industries to enhance digital experiences and boost productivity, the demand for effective observability solutions is increasingly critical. Gartner anticipates that by 2026, over 80% of enterprises will have deployed generative AI applications. In this competitive environment, observability is essential, providing a real-time, comprehensive view of the AI application stack. This visibility ensures that AI-driven operations are both cost-effective and high-performing.

“In today’s hyper-competitive market, organisations cannot afford to wait years for AI ROI,” said New Relic CEO Ashan Willy. “Observability solves this by providing visibility across the AI stack. We are pioneering AI observability by extending our platform to include AI apps built with NVIDIA NIM. Combining NVIDIA’s AI technology with our expertise in observability and APM gives enterprises a competitive edge in the AI race.”

Peter Marelas, Chief Architect at New Relic APJ, also highlighted the significance of visibility for organisations in Asia Pacific as they anticipate a significant increase in generative AI users within the next five years. “Our support for NVIDIA NIM allows organisations to understand how their deployments are performing in real-time,” Marelas noted.

Enhanced management of AI applications with New Relic and NVIDIA

The collaboration between New Relic’s observability platform and NVIDIA NIM assists IT and development teams in optimising AI applications by swiftly identifying and addressing operational insights. According to Amanda Saunders, NVIDIA Director of AI Software, this integration facilitates the rapid deployment and efficient management of AI applications in production settings.

New Relic’s AI monitoring extends to a variety of AI models, boosting the deployment confidence of applications built with NVIDIA NIM. The platform provides a comprehensive view of the AI stack, monitoring throughput, latency, and costs, while ensuring data privacy. It also offers deep trace insights for each AI response, effectively addressing issues such as bias and toxicity.

Furthermore, New Relic has enlarged its AI integration ecosystem to over 60, including NVIDIA GPUs and NVIDIA Triton Inference Server software, thereby offering one of the most comprehensive observability solutions available.

For those interested in utilising New Relic’s enhanced AI monitoring capabilities, the platform is accessible via a usage-based pricing model. Potential users are encouraged to contact a New Relic account representative or sign up for a free account to begin.

Hot this week

Coursera launches Skill Tracks to address workplace skill gaps

Coursera launches Skill Tracks to help organisations close skill gaps with role-based, data-driven learning across IT, data, software, and GenAI.

Mendix deepens collaboration with Snowflake to transform automotive software development

Mendix and Snowflake expand collaboration to drive faster software development, secure data use, and real-time insights in automotive.

Reddit tests in-app article reading with new publisher tools

Reddit is testing in-app article reading with new analytics and AI tools for publishers, aiming to boost content sharing and engagement.

Asus unveils US$4,000 ProArt P16 with 4K tandem OLED and RTX 5090

Asus launches its ProArt P16 laptop with a 4K tandem OLED, RTX 5090 GPU, and creator-focused features, priced from US$1,999.

ASUS routers dominate PCMag awards with record wins

ASUS routers win big at the 2025 PCMag Readers’ and Business Choice awards, sweeping all major home and office networking categories.

Asus unveils US$4,000 ProArt P16 with 4K tandem OLED and RTX 5090

Asus launches its ProArt P16 laptop with a 4K tandem OLED, RTX 5090 GPU, and creator-focused features, priced from US$1,999.

Lenovo unveils Legion Go 2 handheld with OLED display and higher price tag

Lenovo launches the Legion Go 2 handheld with an OLED display, upgraded specs and a higher starting price of €999 at IFA 2025.

Samsung could launch two Galaxy Z Fold8 models in 2026

Samsung may release two Galaxy Z Fold8 models in 2026, including one with a square-like screen, alongside the Galaxy Z Flip8.

Apple brings new health features to older Watch models

Apple adds hypertension notifications and Sleep Score to older Watch models with watchOS 26, expanding health tools beyond its newest devices.

Related Articles

Popular Categories