December 25, 2024
NVIDIA Jetson Orin Nano Super Developer Kit Receives Major Upgrade
NVIDIA has just rebranded its Jetson Orin Nano Developer Kit into the Jetson Orin Nano Super Developer Kit - a move that will come with its slate of “super” upgrades in line with ongoing developments in the field of generative AI. Developers need powerful platforms to deploy these advanced models effectively, and NVIDIA aims to meet that demand.
Performance Boost and New Features
The latest upgrade introduces a new power mode that increases GPU, memory, and CPU clock speeds. As a result, the Jetson Orin Nano Super can deliver up to 70% higher generative AI performance. This allows it to handle advanced Transformer-based models, including those with up to 8 billion parameters, like Llama-3.1-8B. The compact kit is now available for just $249, making it an attractive option for developers looking to implement scalable AI solutions.
Key Capabilities
The Jetson Orin Nano Super supports various machine learning frameworks and tools, such as HuggingFace Transformers and NVIDIA TensorRT-LLM. This compatibility enables developers to tailor their solutions for specific applications. The enhanced performance is particularly beneficial for:
- Large Language Models (LLMs): These models excel at generating human-like text and can be paired with NVIDIA Riva for speech recognition.
- Vision Transformers (ViTs): ViTs excel in tasks like classification and segmentation by converting pixel patches into embeddings.
- Visual Language Models (VLMs): Combining ViTs and LLMs, VLMs can understand complex scenes and perform multimodal reasoning.
Accessibility and Affordability
The Jetson Orin Nano Super Developer Kit is powerful and affordable. Thanks to its price drop from $499 to $249, hobbyists and students can now get access to some of the world’s advanced generative AI capabilities. Those who already have the Jetson Orin Nano can enjoy the Super Orin Nano’s features with just a simple software update.
Real-World Applications
The performance improvements of the Jetson Orin Nano Super extend across various applications. It enhances natural language processing, multimodal reasoning, and vision tasks, making it a vital tool in the generative AI landscape. Benchmark tests show significant speed increases across popular models, solidifying its role as a gateway to physical AI.
By combining affordability with high performance, the NVIDIA Jetson Orin Nano Super Developer Kit sets a new standard for developers in the evolving world of generative AI. This enhanced platform offers an excellent opportunity for innovation in embedded applications.