NVIDIA DeepStream SDK

DeepStream’s multi-platform support gives you a faster, easier way to develop vision AI applications and services. You can even deploy them on premises, on the edge, and in the cloud with just the click of a button.

What is NVIDIA DeepStream?

NVIDIA’s DeepStream SDK is a complete streaming analytics toolkit based on GStreamer for AI-based multi-sensor processing, video, audio, and image understanding. It’s ideal for vision AI developers, software partners, startups, and OEMs building IVA apps and services.

You can now create stream-processing pipelines that incorporate neural networks and other complex processing tasks like tracking, video encoding/decoding, and video rendering. These pipelines enable real-time analytics on video, image, and sensor data.

What is DeepStream and how does the software stack look like

DeepStream is an integral part of NVIDIA Metropolis, the platform for building end-to-end services and solutions that transform pixel and sensor data to actionable insights.

Benefits

Powerful and Flexible SDK

DeepStream SDK is ideal for a wide range of use cases across a broad set of industries.

Multiple Programming Options

Create powerful vision AI applications using C/C++, Python, or Graph Composer’s simple and intuitive UI.

Real-Time Insights

Understand rich and multi-modal real-time sensor data at the edge.

Managed AI Services

Deploy AI services in cloud native containers and orchestrate them using Kubernetes.

Reduced TCO

ncrease stream density by training, adapting, and optimizing models with TAO toolkit and deploying models with DeepStream.

Unique Capabilities

Enjoy Seamless Development From Edge to Cloud

DeepStream gives you a faster, easier way to build seamless streaming pipelines for AI-based video, audio, and image analytics. It ships with 40+ hardware-accelerated plugins and extensions to optimize pre/post processing, inference, multi-object tracking, message brokers, and more. Plus, it offers some of the world's best-performing real-time, multi-object trackers.

Use DeepStream’s off-the-shelf containers to easily build cloud native applications that can be deployed on public and private clouds, on workstations powered with NVIDIA GPUs, or on NVIDIA Jetson. Its “develop once, deploy anywhere” approach simplifies code management and provides great scalability. The DeepStream Container Builder tool also makes it easier to build high-performance, cloud-native AI applications with NVIDIA NGC containers that are easily deployed at scale and managed with Kubernetes and Helm Charts.

DeepStream REST-APIs let you manage multiple parameters at run-time, simplifying the creation of SaaS solutions. With standard REST-API interface, you can build web portals for control and configuration or integrate into your existing applications.

DeepStream helps developers build seamless streaming pipeline for AI based video analytics

DeepStream is integrated with NVIDIA Metropolis for complete end-to-end AI solutions

Build End-to-End AI Solutions

Speed up overall development efforts and unlock greater real-time performance by building an end-to-end vision AI system with NVIDIA Metropolis. Start with production-quality vision AI models, adapt and optimize them with TAO Toolkit, and deploy using DeepStream.

Get incredible flexibility–from rapid prototyping to full production level solutions–and choose your inference path. With native integration to NVIDIA Triton™ Inference Server, you can deploy models in native frameworks such as PyTorch and TensorFlow for inference. Using NVIDIA TensorRT™ for high-throughput inference with options for multi-GPU, multi-stream, and batching support also helps you achieve the best possible performance.

PipeTuner 1.0, a new developer tool, now makes it easy to tune wide range of parameters to optimize AI pipelines for inference and tracking

Accelerate Vision AI Development

The DeepStream SDK is bundled with 30+ sample applications designed to help you kick-start your development efforts. Most samples are available in C/C++, Python, and Graph Composer versions and run on both NVIDIA Jetson and dGPU platforms. With support for Windows Subsystem for Linux (WSL2), you can now develop in Windows environments without the need to access remote Linux systems.

DeepStream Service Maker simplifies the development process by abstracting the complexities of GStreamer to easily build C++ object-oriented applications. Use Service Maker to build complete DeepStream pipelines with a few lines of code

DeepStream Libraries powered by CV-CUDA, NvImageCodec, and PyNvVideoCodec that offers low-level GPU-accelerated operations to optimize pre and post stages of vision AI pipelines.

Graph Composer gives DeepStream developers a powerful, low-code development option to create complex pipelines and quickly deploy them using Container Builder.

<a href=DeepStream is bundled with multiple reference applications" />

Use DeepStream to build next generation AI applications

Siemens, HD Hyundai

Create Next-Generation AI Applications

Tight scheduling control, custom schedulers, and efficient resource management are all critical to integrating with deterministic systems such as robotic arms and automated quality control lines.

With the introduction of Graph eXecution Format (GXF), it’s easy to integrate with control signals that operate on a different time domain than the vision streaming sensors being processed by a DeepStream pipeline.

New reference applications help you jumpstart development of Generative AI applications. And new support for sensor fusion, BEVFusion, adds both lidar and radar inputs that can be fused with camera inputs bringing a new range of use cases for developers.

Get Production-Ready Solution for Vision AI

DeepStream is available as a part of NVIDIA AI Enterprise, an end-to-end, secure, cloud-native AI software platform optimized to accelerate enterprises to the leading edge of AI.
NVIDIA AI Enterprise delivers validation and integration for NVIDIA AI open-source software, access to AI solution workflows to speed time to production, certifications to deploy AI everywhere, and enterprise-grade support, security, and API stability to mitigate the potential risks of open-source software.

<a href=DeepStream is part of NVIDIA AI Enterprise to help deploy AI anywhere." />

Explore Multiple Programming Options

C/C++

Create applications in C/C++, interact directly with GStreamer and DeepStream plug-ins, and use reference applications and templates.