User Guide Leetop_ALP_608_F_ User_Guide_V1.0 Leetop Technology (Shenzhen) Co., Ltd.. http://www.leetop.top Leetop Tech Co., Ltd. Leetop_ALP_608_F_ User_Guide_V1.0 Leetop_ALP_608_F_User_Guide_V1.0 Notice Service and Support Technical Support Warranties Warranty content:
Packing List DOCUMENT CHANGE HISTORY Leetop_ALP_608_F Product description Brief Product specifications Processor module I/O Power Supply Environmental Install Dimension Leetop_ALP_608_F Interface Description Front interface Back interface Board Interface Description Carrier plate specifications Function Introduction Operating system setup 1.Hardware preparation 2.Environment requirements 3.Recovery mode 4. Install system image 5.Switching working modes 6. Install Jetpack components Use of xshell System configuration View System Version Make a backup image Installation of Jtop tools Developer Tools JetPack L4T DeepStream SDK on Jetson Isaac SDK Key Features of Jetpack Sample Applications Developer Tools 002 Notice Please read manual carefully before install, operate, or transport Leetop device. Ensure that the correct power range is being used before powering the device. Avoid hot plugging. To properly turn off the power, please shut down the Ubuntu system first, and then cut off the power. Due to the particularity of the Ubuntu system, on the Nvidia developer kit, if the power is turned off when the startup is not completed, there will be a 0.03% probability of abnormality, which will cause the device to fail to start. Due to the use of the Ubuntu system, the same problem also exists on the Leetop device. Do not use cables or connectors other than described in this manual. Do not use Leetop device near strong magnetic fields. Backup your data before transportation or Leetop device is idle. Recommend to transport Leetop device in its original packaging. Warn! This is a Class A product, in a living environment this product may cause radio interference. In this case, the user may be required to take practicable measures against the interference. Working in a high temperature environment for a long time, it is not recommended to touch the shell to avoid burns. Dismantling the machine without consent is regarded as a waiver of the warranty. 003 Service and Support Technical Support Leetop is glad to help you with any questions you may have about our product, or about the use of the technology for your application. The fastest way is sending us an email: service@leetop.top Warranties Warranty period: One year from the date of delivery. Warranty content:
Leetop warrants the product manufactured by us to be free from defects in material and workmanship during warranty period. Please contact service@leetop.top for return material authorization (RMA) prior to returning any items for repair or exchange. The product must be returned in its original packaging to prevent damage during shipping. Before returning any product for repair, it is recommended to back up your data and delete any confidential or personal data. Packing List Leetop_ALP_608_F Non-standard equipment Power adapter x 1 Power cord x 1 DOCUMENT CHANGE HISTORY Document Version date Description of Change Leetop_ALP_608_F V1.0 20231017 Initial release 004 Leetop_ALP_608_F Product description Brief Leetop_ALP_608_F is an embedded artificial intelligence computer that can provide up to 70/100 TOPS of computing power to many terminal devices. Leetop_ALP_608_F provides fast active heat dissipation design and can meet industrial standards such as shock resistance and anti-static. At the same time, Leetop_ALP_608_F has rich interfaces and high cost performance. 005 Product specifications Processor module Processor Jetson Orin NX 8GB Jetson Orin NX 16GB AI Performance 70 TOPS 100 TOPS GPU CPU 1024-core NVIDIA Ampere GPU 1024-core NVIDIA Ampere GPU with 32 Tensor Cores with32 Tensor Cores 6-core NVIDIA Arm Cortex A78AE v8.2 64-bit CPU 1.5MB L2 + 4MB L3 8-core NVIDIA Arm Cortex A78AE v8.2 64-bit CPU2MB L2 + 4MB L3 Memory 8 GB 128-bit LPDDR5 102.4 GB/s 16 GB 128-bit LPDDR5102.4 GB/s Storage
(Supports external NVMe)
(Supports external NVMe) Power 10W - 20W PCIe 1 x4 + 3 x1
(PCIe Gen4, Root Port & Endpoint) 10W - 25W 1 x4 + 3 x1
(PCIe Gen4, Root Port &
Endpoint) Up to 4 cameras (8 via virtual Up to 4 cameras(8 via virtual CSI Camera channels***) 8 lanes MIPI CSI-2 channels***) 8 lanes MIPI CSI-2D-PHY 2.1 D-PHY 2.1 (up to 20Gbps)
(up to 20Gbps) Video Encode Video Decode Display 1x4K60 | 3x4K30 |
6x1080p60 |
12x1080p30(H.265) 1x4K60 | 2x4K30 |
5x1080p30 |
11x1080p30(H.264) 1x8K30 |2X4K60 |
4X4K30| 9x1080p60 |
18x1080p30(H.265) 1x4K60|2x4K30|
5x1080P60 |
11X1080P30(H.264) 1x 4K60 | 3x 4K30 |
6x 1080p60 |
12x 1080p30 (H.265) 1x 4K60 | 2x 4K30 |
5x 1080p60 |
11x 1080p30 (H.264) 1x 8K30 | 2x 4K60 |
4x 4K30 | 9x 1080p60|
18x 1080p30 (H.265) 1x 4K60 | 2x 4K30 |
5x 1080p60 |
11x 1080p30 (H.264) 1x 8K60 multi-mode DP 1x 8K60 multi-mode DP 1.4a (+MST)/eDP1.4a/HDMI 2.1 1.4a (+MST)/eDP1.4a/HDMI 2.1 Networking 10/100/1000 BASE-T Ethernet 10/100/1000 BASE-T Ethernet Mechanical 69.6mm x 45mm 260-pin SO-DIMM 69.6mm x 45mm260-pin connector SO-DIMM connector 006 Processor Jetson Orin Nano 4GB Jetson Orin Nano 8GB AI Performance 20 TOPS 40 TOPS 512-core NVIDIA Ampere 1024-core NVIDIA Ampere GPU architecture GPU with architecture GPU with 16 Tensor Cores 32 Tensor Cores 6-core Arm Cortex-A78AE v8.2 6-core Arm Cortex-A78AE v8.2 CPU 64-bit CPU 1.5MB L2 + 4MB L3 64-bit CPU 1.5MB L2 + 4MB L3 Memory 4GB 64-bit LPDDR5 8GB 128-bit LPDDR5 34 GB/s 68 GB/s Storage
(Supports external NVMe)
(Supports external NVMe) Power 5W - 10W PCIe 1 x4 + 3 x1 7W - 15W 1 x4 + 3 x1
(PCIe Gen3, Root Port, & Endpoint)
(PCIe Gen3, Root Port, & Endpoint) Up to 4 cameras (8 via virtual Up to 4 cameras (8 via virtual CSI Camera channels***) 8 lanes MIPI CSI-2 channels***) 8 lanes MIPI CSI-2 D-PHY 2.1 (up to 20Gbps) D-PHY 2.1 (up to 20Gbps) Video Encode Video Decode Display 1080p30 supported by 1-2 CPU 1080p30 supported by 1-2 CPU cores cores 1x 4K60 (H.265) 2x 4K30 (H.265) 5x 1080p60 (H.265) 11x 1080p30 (H.265) 1x 4K60 (H.265) 2x 4K30 (H.265) 5x 1080p60 (H.265) 11x 1080p30 (H.265) 1x 4K30 multi-mode DP 1.2 1x 4K30 multi-mode DP 1.2
(+MST)/eDP 1.4/HDMI 1.4**
(+MST)/eDP 1.4/HDMI 1.4**
Networking 10/100/1000 BASE-T Ethernet 10/100/1000 BASE-T Ethernet Mechanical 69.6mm x 45mm 260-pin SO-
69.6mm x 45mm260-pin DIMM connector SO-DIMM connector 007 I/O Inthface Display Ethernet USB M.2 KEY M Camera FAN RTC CON CAN Audio Function CON Specification 1x DP 2x Gigabit Ethernet (10/100/1000) 4x USB 3.2 Type A (Integrated USB 2.0) 1x USB 2.0+3.2 Type C 1x M.2 KEY M(SSD Interface 1X M.2 KEY E(WIFI) Interface 1XM.2 KEY B(4G/5G) Interface 2X CSI Camera 1 x FAN(5V PWM) 1X3.0V RTC 1x CAN (FD) 1x3.5 Audio Jack 2X MIC 2X SPEAKER 1X SPEAKER FEEDBACK 2X IIC;
1X SPI 7X IO 3.3V 2x UART 1X DEBUG 1X POWER 1X RESET 1X RECOVERY Power Requirements
+9--+20V(MAX 60W) DC Input Power Supply Power Supply Specification Input Type DC Input Voltage
+9--+20V(MAX 60W) DC Input Environmental Environmental Specification Operating Temperature
-25 to +65 Storage temperature/humidity
-25-65 10%-90% Non condensation environment 008 Install Dimension Leetop_ALP_608_F Dimensions as below:
Up view (Unit:mm) Front view (Unit:mm) Left view (Unit:mm) Rear view(Unit:mm) 009 Leetop_ALP_608_F Interface Description Front interface Leetop_ALP_608_F Surface interface diagram Interface Interface name Interface description Type-C Type-C interface 1x USB 2.0+3.2 Type C DP USB RJ45 DC DisplayPort 1x DP USB interface 4x USB 3.2 Type A (Integrated USB 2.0) Ethernet Gigabit port 2x Gigabit Ethernet (10/100/1000) DC power interface
+9--+20V(MAX 60W) DC Input Note: This product starts automatically when plugged in 010 Back interface Leetop_ALP_608_F Back interface diagram Interface Interface name Interface description Multifunctional expansion port UART Connect IIC Connect CAN Connect POWER KEY Multifunctional interface Connected I/O Spi UART I2C CAN switch UART communication device I2C device Connect to CAN device On/off button interface Audio Jack Audio Jack Can be connected to 3.5 American standard headphones 011 Board Interface Description Carrier plate specifications Inthface Specification PCB Size / Overall Size 101.5mm x 95mm Display Ethernet USB M.2 KEY M Camera FAN RTC CON CAN Audio Function CON 1x DP 2x Gigabit Ethernet (10/100/1000) 4x USB 3.2 Type A (Integrated USB 2.0) 1x USB 2.0+3.2 Type C 1x M.2 KEY M(SSD Interface 1X M.2 KEY E(WIFI) Interface 1XM.2 KEY B(4G/5G) Interface 2X CSI Camera 1 x FAN(5V PWM) 1X3.0V RTC 1x CAN (FD) 1x3.5 Audio Jack 2X MIC 2X SPEAKER 1X SPEAKER FEEDBACK 2X IIC;
1X SPI 7X IO 3.3V 2x UART 1X DEBUG 1X POWER 1X RESET 1X RECOVERY Power Requirements
+9--+20V(MAX 60W) DC Input Operating Temperature
-25 to +65 Weight 0.10075KG Warranty and Support 1 Year Warranty and Free Support 012 Function Introduction Operating system setup 1.Hardware preparation Ubuntu 18.04 PC x1 Type c data cable x1 2.Environment requirements 1. Download the system image package to the PC host of Ubuntu18.04 system: Programming steps:
1. Use a USB cable to connect the USB Type-A of the Ubuntu18.04 system PC to the Type c of the Leetop_ALP_608_F Development System;
2. Power on the Leetop_ALP_608_F Development System and enter Recovery mode;
3. Open Nvidia-SDK-Manager on the PC, as shown in the figure below, select Jetson Orin NX/Orin NANO in the interface to download the Jetpack5.xx system image package and development tools, or download it from https://developer.nvidia.com/embedded
/downloadsDownloads the latest Jetson Linux release package and the sample file system of the Jetson Development Kit. (Jetson Linux Driver Package (L4T) ) 1 2
#If you cannot find the corresponding version using the latest SDK version, you can use this command to obtain it. sdkmanager --archivedeversions 4. Download supporting driver:
Link: https://pan.baidu.com/s/1fXAcDyI7n5g1VKMc4FQSSw Extraction code: oz9h
(Please download the corresponding driver file according to the actual needs of the device.) For other information, please contact us: service@leetop.top 013 2. Unzip the downloaded image package and enter the Linux for Tegra(L4T) directory 1 2 3 4 5 6 7 8 9 sudo mkdir [$path] #Create a folder and freely name the path cd [$path] #Enter folder tar xf Jetson_Linux_R35.3.1_aarch64.tbz2 cd Linux_for_tegra/rootfs/
sudo tar xpf Tegra_Linux_Sample-Root-Filesystem_R35.3.1_aarch64.tbz2 cd .. sudo ./apply_binaries.sh sudo ./tools/l4t_flash_prerequisites.sh
#Replace Driver Package 10 sudo cp -r 608_xxx/Linux_for_tegra/* Linux_for_tegra/
3. Enter this command on a Linux host to install (flash) the Jetson version into the Jetson development kit. Flash to NVMe:
1 2 3 4 1 2 3 4 5 1 2 3 4
#orin nx/orin nano flash to nvme sudo ./tools/kernel_flash/l4t_initrd_flash.sh --external-device nvme0n1p1 \
-c tools/kernel_flash/flash_l4t_external.xml -p "-c bootloader/t186ref/cfg/flash_t234_qspi.xml" \
--showlogs --network usb0 jetson-orin-nano-devkit internal Flash to USB:
#orin nx/orin nano flash to USB cd Linux_for_tegra/
sudo ./tools/kernel_flash/l4t_initrd_flash.sh --external-device sda1 \
-c tools/kernel_flash/flash_l4t_external.xml -p "-c bootloader/t186ref/cfg/flash_t234_qspi.xml" \
--showlogs --network usb0 jetson-orin-nano-devkit internal Flash to SD:
#orin nx/orin nano flash to SD sudo ./tools/kernel_flash/l4t_initrd_flash.sh --external-device mmcblk1p1 \
-c tools/kernel_flash/flash_l4t_external.xml -p "-c bootloader/t186ref/cfg/flash_t234_qspi.xml" \
--showlogs --network usb0 jetson-orin-nano-devkit internal 014 3.Recovery mode Leetop_ALP_608_F can update the system through USB, and the update needs to enter the USB Recovery mode. In USB Recovery mode, you can perform file system update, kernel update, boot loader update, BCT update and other operations. Steps to enter Recovery Mode:
1. Power off the system, make sure to power off and not go into standby;
2. Connect the carrier and host using the USB Type C to USB Type A cable;
3. Power on the equipment;
4. After pressing the Recovery button and the Reset button for two seconds at the same time, first release the Reset button and then release the Recovery button to make it enter the Rec mode. 5. Open a terminal window on your host computer and enter command lsusb . The Jetson module is in Force Recovery Mode if you see the message:
1 Bus <bbb> Device <ddd>: ID 0955: <nnnn> Nvidia Corp. Where:
= <bbb> is any three-digit number
= <ddd> is any three-digit number
<nnnn> is a four-digit number that represents the type of your Jetson module:
7023 for Jetson AGX Orin (P3701-0000 with 32GB) 7023 for Jetson AGX Orin (P3701-0005 with 64GB) 7023 for Jetson AGX Orin Industrial (P3701-0008 with 64GB) 7223 for Jetson AGX Orin (P3701-0004 with 32GB) 7323 for Jetson Orin NX (P3767-0000 with 16GB) 7423 for Jetson Orin NX (P3767-0001 with 8GB) 7523 for Jetson Orin Nano (P3767-0003 and P3767-0005 with 8GB) 7623 for Jetson Orin Nano (P3767-0004 with 4GB) 7019 for Jetson AGX Xavier (P2888-0001 with 16GB) 7019 for Jetson AGX Xavier (P2888-0004 with 32GB) 7019 for Jetson AGX Xavier (P2888-0005 with 64GB) 7019 for Jetson AGX Xavier Industrial (P2888-0008) 7e19 for Jetson Xavier NX (P3668) Note: In the USB Recovery mode, the system will not start, and the serial port will not have debugging information output 015 4. Install system image a) Connect USB type-A of Ubuntu 18.04 Host to Type-c of Leetop_ALP_608_F ;
b) Power up Leetop_ALP_608_F and enter Recovery mode(RCM);
c) The PC Host enters the L4T directory and executes the flashing instruction 1 2 3 4 5 cd Linux_for_tegra/
#orin nx/orin nano flash to nvme sudo ./tools/kernel_flash/l4t_initrd_flash.sh --external-device nvme0n1p1 \
-c tools/kernel_flash/flash_l4t_external.xml -p "-c bootloader/t186ref/cfg/flash_t234_qspi.xml" \
--showlogs --network usb0 jetson-orin-nano-devkit internal d) After flashing, power on Leetop_ALP_608_F again and log in to the system. 016 5.Switching working modes After logging in to the system, you can click Operation Modification in the upper right corner of the system interface, as shown in the figure:
Or, enter the command in the terminal to switch:
1 2
#Switch to mode 0, use the -q parameter to view the current mode sudo nvpmodel -m 0 6. Install Jetpack components 1 2 3 sudo apt update sudo reboot sudo install nvidia-jetpack 017 Use of xshell Xshell is a powerful security terminal emulation software, it supports SSH1, SSH2, and TELNET protocol of Microsoft Windows platform. Xshell's secure connection to remote hosts through the Internet and its innovative design and features help users enjoy their work in complex network environments. Xshell can be used to access servers under different remote systems under the Windows interface, so as to better achieve the purpose of remote control of the terminal. xshell is not necessary, but it can better assist us in using equipment. It can link your Windows system with your Ubuntu system, allowing you to operate your Linux system under Windows system. To install xshell, you can download and install it by searching Baidu on the Internet. (When the product cannot enter the desktop system, you can also use xshell to perform remote control and modify configuration errors). Open xshell Newly bulit 018 Fill in the name and host ip(normally you can connect through the network ip, if you do not know the ip, you can connect the computer and the OTG port of the device through the usb data cable, fill in the fixed ip to connect) 1 192.168.55.1 Enter user and password 019 Click Connect to enter the command line interface Operate jetson devices remotely through xshell 020 021 System configuration Default username: nvidia Password: nvidia NVIDIA Linux For Tegra (L4T) The load board supports native NVIDIA Linux For Tegra (L4T) Builds. HDMI, Gigabit Ethernet, USB3.0, USB OTG, serial port, GPIO, I2C bus can be supported Detailed instructions and tools download links: https://developer.nvidia.com/embedded/jets on-linux-r3541 Note: The native system does not support PWM fan control. If the native system is used, IPCall-BSP must be deployed NVIDIA Jetpack for L4T Jetpack is a software package released by NVIDIA that contains all of the software tools needed for Orin NX/Orin NANO development using Leetop_ALP_608_F . It includes both host and target tools, including OS images, middleware, sample applications, documentation, and more. The newly released JetPack runs on Ubuntu 20.04 Linux 64-bit hosts. It can be downloaded from the following link:
https://developer.nvidia.com/embedded/jetpack Default configuration system Leetop_ALP_608_F uses Ubuntu 20.04 system, default username: nvidia password: nvidia Development MATERIALS and forums L4T development data: https://developer.nvidia.com/embedded/linux-tegra Developer forum: https://forums.developer.nvidia.com/
022 View System Version View the installed system package version 1 cat /etc/nv_tegra_release View information about the installed JetPack 1 sudo apt show nvidia-jetpack 023 Make a backup image Making a backup image needs to be done in the environment of command line flashing, only the system.img file is backed up 1. Use a USB cable to connect the USB Type-A of the PC computer of the Ubuntu18.04 system to the Type C of the Leetop_ALP_608_F;
2. Power on the Leetop_ALP_608_F and enter Recovery mode;
3. Enter the Linux_for_tegra directory, and refer to README_backup_restore.txt in backup_restore for backup. Instructions for backing up the Jetson Orin Nano/Orin NX system:
1 2 3 4 5 cd Linux_for_Tegra systemctl stop udisks2.service #Automount backup restore for new external storage devices must be temporarily disabled. sudo tools/l4t_flash_prerequisites.sh #For Debian-based Linux sudo service nfs-kernel-server start sudo ./tools/backup_restore/l4t_backup_restore.sh -e nvme0n1 -b jetson-
orin-nano-devkit #Backup image, after the backup is successful, an image file will be generated under Linux_for_Tegra/tools/backup_restore. 6 sudo ./tools/backup_restore/l4t_backup_restore.sh -r jetson-orin-nano-devkit
#Backup image restoration. 4. Use the backup image to flash:
1 2 sudo ./tools/backup_restore/l4t_backup_restore.sh -r jetson-orin-nano-devkit
#Backup image restoration If it can be flashed normally, it means that the created backup image is available. 024 Installation of Jtop tools Jtop is a system monitoring utility for Jetson that can be run on a terminal to view and control the status of NVIDIA Jetson in real time. Installation steps 1. Installing the pip3 tool 1 sudo apt-get install python3-pip 2. Installing jtop packages with pip3 1 sudo -H pip3 install -U jetson-stats 3. Restart to run jtop 1 jtop After running, as shown in the figure below:
025 Developer Tools JetPack NVIDIA JetPack SDK is the most comprehensive solution for building AI applications. It bundles Jetson platform software including TensorRT, cuDNN, CUDA Toolkit, VisionWorks, GStreamer, and OpenCV, all built on top of L4T with LTS Linux kernel. JetPack includes NVIDIA container runtime, enabling cloud-native technologies and workflows at the edge. JetPack SDK Cloud-Native on Jetson L4T NVIDIA L4T provides the Linux kernel, bootloader, NVIDIA drivers, flashing utilities, sample filesystem, and more for the Jetson platform. You can customize L4T software to fit the needs of your project. By following the platform adaptation and bring-up guide, you can optimize your use of the complete Jetson product feature set. Follow the links below for details about the latest software libraries, frameworks, and source packages. DeepStream SDK on Jetson NVIDIAs DeepStream SDK delivers a complete streaming analytics toolkit for AI-based multi-
sensor processing, video and image understanding. DeepStream is an integral part of NVIDIA Metropolis, the platform for building end-to-end services and solutions that transform pixel and sensor data to actionable insights. Learn about the latest 5.1.2 developer preview features in our developer news article. Isaac SDK The NVIDIA Isaac SDK makes it easy for developers to create and deploy AI-powered robotics. The SDK includes the Isaac Engine (application framework), Isaac GEMs (packages with high-
performance robotics algorithms), Isaac Apps (reference applications) and Isaac Sim for Navigation (a powerful simulation platform). These tools and APIs accelerate robot development by making it easier to add artificial intelligence (AI) for perception and navigation into robots. 026 Key Features of Jetpack NVIDIA Jetson Linux 35.4.1 provides the Linux Kernel 5.10, UEFI based bootloader, Ubuntu 20.04 based root file system, NVIDIA drivers, necessary firmwares, toolchain and more.JetPack 5.1.2 includes Jetson Linux 35.4.1 which adds following highlights: (Please refer to release notes for additional details) Adds support for Jetson AGX Orin Industrial module;
Bootloader: Support for Grub as OS Loader in UEFI; Support for PXE boot;
Camera: Enhanced error resiliency for improved stability in Argus;
Support for multiple camera synchronization (sample argus_syncstereo added) Deskew calibration support for high data rate sensors (> 1.5 Gbps) Support for alternating exposures in Argus (sample OS argus_userAlternatingAutoexposure added) Multimedia: Deprecated Nvbuf_utils is removed. Refer to migration guide to migrate from Nvbuf_utils to NvUtils. Security: Support for up to 3 signing keys to sign bootloader in secure boot and ability to revoke the keys Ability to add and revoke UEFI signing keys Enhanced secure boot for encrypting kernel, kernel-dtb and initrd Support for delegated authentication with ability to sign UEFI with platform vendor owned keys Support in disk encryption for encrypting only User Data Partition (UDA) and runtime enabling encryption of UDA partitions Over The Air Updates: Support for Jetson Orin NX and Jetson Orin Nano in Image based OTA tools TensorRT is a high performance deep learning inference runtime for image classification, segmentation, and object detection neural networks. TensorRT is built on CUDA, NVIDIAs parallel programming model, and enables you to TensorRT optimize inference for all deep learning frameworks. It includes a deep learning inference optimizer and runtime that delivers low latency and high-
throughput for deep learning inference applications. JetPack 5.1.2 includes TensorRT 8.5.2 NVIDIA DLA hardware is a fixed-function accelerator engine targeted for deep learning operations. Its designed to do full hardware acceleration of convolutional neural networks, supporting various layers such as convolution, deconvolution, fully connected, activation, pooling, batch DLA normalization, and others DLA software consists of the DLA compiler and the DLA runtime stack. The offline compiler translates the neural network graph into a DLA loadable binary and can be invoked using NVIDIA TensorRT. The runtime stack consists of the DLA firmware, kernel mode driver, and user mode driver. JetPack 5.1.2 includes DLA 3.12.1 cuDNN CUDA Deep Neural Network library provides high-performance primitives for deep learning frameworks. It provides highly tuned implementations for standard routines such as forward and backward convolution, pooling, normalization, and activation layers. JetPack 5.1.2 includes cuDNN 8.6.0 027 CUDA Multimedia API Computer Vision CUDA Toolkit provides a comprehensive development environment for C and C++ developers building GPU-accelerated applications. The toolkit includes a compiler for NVIDIA GPUs, math libraries, and tools for debugging and optimizing the performance of your applications. JetPack 5.1.2 includes CUDA 11.4.19 Starting with JetPack 5.0.2, upgrade to latest and greatest CUDA releases from CUDA 11.8 onwards without the need to update Jetson Linux other JetPack components. Refer to instructions in the CUDA documentation on how to get the latest CUDA on JetPack. The Jetson Multimedia API package provides low level APIs for flexible application development. Camera application API: libargus offers a low-level frame-synchronous API for camera applications, with per frame camera parameter control, multiple (including synchronized) camera support, and EGL stream outputs. RAW output CSI cameras needing ISP can be used with either libargus or GStreamer plugin. In either case, the V4L2 media-
controller sensor driver API is used. Sensor driver API: V4L2 API enables video decode, encode, format conversion and scaling functionality. V4L2 for encode opens up many features like bit rate control, quality presets, low latency encode, temporal tradeoff, motion vector maps, and more. JetPack 5.1.2 Camera highlights include: Enhanced error resiliency for improved stability in Argus; Support for multiple camera synchronization (sample argus_syncstereo added). Deskew calibration support for high data rate sensors (> 1.5 Gbps) .Support for alternating exposures in Argus (sample argus_userAlternatingAutoexposure added) VPI (Vision Programing Interface) is a software library that provides Computer Vision / Image Processing algorithms implemented on multiple hardware accelerators found on Jetson such as PVA (Programmable Vision Accelerator), GPU, NVDEC(NVIDIA Decoder), NVENC (NVIDIA Encoder), VIC
(Video Image Compositor) and so on. OpenCV is an open source library for computer vision, image processing and machine learning. JetPack 5.1.2 includes VPI 2.3 with following highlights: New Brute Force Matcher algorithm supported on CPU and GPU backends ; New Transform Estimator algorithm supported on CPU backend. JetPack 5.1.2 includes OpenCV 4.5.4 028 Graphics JetPack 5.1.2 includes the following graphics libraries: Vulkan 1.3 (including the Roadmap 2022 Profile). Vulkan 1.3 Announcement Vulkan SC 1.0:
Vulkan SC is a low-level, deterministic, robust API that is based on Vulkan 1.2. This API enables state-of-the-art GPU-accelerated graphics and computation that can be deployed in safety-critical systems and that are certified to meet industry functional safety standards. Refer to https://www.khronos.org/vulka nsc/ for more information;Vulkan SC can also be invaluable for real-time non safety critical embedded applications. Vulkan SC increases determinism and reduces application size by shifting preparation of the run-time application environment either offline, or into application setup, as much as possible. This includes offline compilation of graphics pipelines that define how the GPU processes data, together with static memory allocation, that together enable detailed GPU control that can be rigorously specified and tested.Vulkan SC 1.0 is evolved from Vulkan 1.2 and includes: the removal of runtime functionality that is not needed in safety-critical markets, an updated design to provide predictable execution times and results, and clarifications to remove potential ambiguity in its operation. For more details see https://www.khronos.org/blog/vulkan-sc-overview Note: Jetson support for Vulkan SC is not safety certified. OpenWF Display 1.0: OpenWF Display is a Khronos API for low overhead interaction with the native display driver on Jetson and allows interaction with Vulkan SC to display images. Note:
Jetson support for OpenWF Display is not safety certified. CUDA Toolkit provides a comprehensive development environment for C and C++ developers building high-performance GPU-accelerated applications with CUDA libraries. The toolkit includes Nsight Visual Studio Code Edition, Nsight Eclipse Plugins, debugging and profiling tools including Nsight Compute, and a toolchain for cross-compiling applications NVIDIA Nsight Systems is a low overhead system-wide profiling tool, providing the insights developers need to analyze and optimize software performance. Developer NVIDIA Nsight Graphics is a standalone application for debugging and Tools profiling graphics applications. NVIDIA Nsight Deep Learning Designer is an integrated development environment that helps developers efficiently design and develop deep neural networks for in-app inference. Nsight System, Nsight Graphics, and Nsight Compute are all supported on Jetson Orin modules to assist development for autonomous machines. JetPack 5.1.2 includes NVIDIA Nsight Systems v2022.5 ;JetPack 5.1.2 includes NVIDIA Nsight Graphics 2022.6 ;JetPack 5.1.2 includes NVIDIA Nsight Deep Learning Designer 2022.2 029 Supported SDKs and Tools Cloud Native Security NVIDIA DeepStream SDK is a complete analytics toolkit for AI-based multi-
sensor processing and video and audio understanding. DeepStream 6.2 release supports JetPack 5.1.2 NVIDIA Triton Inference Server simplifies deployment of AI models at scale. Triton Inference Server is open source and supports deployment of trained AI models from NVIDIA TensorRT, TensorFlow and ONNX Runtime on Jetson. On Jetson, Triton Inference Server is provided as a shared library for direct integration with C API. PowerEstimator is a webapp that simplifies creation of custom power mode profiles and estimates Jetson module power consumption. JetPack 5.1.2 adds supports for Jetson Orin NX and Jetson Orin Nano in PowerEstimator. NVIDIA Isaac ROS is a collection of hardware-accelerated packages that make it easier for ROS developers to build high-performance solutions on NVIDIA hardware including NVIDIA Jetson. Isaac ROS DP 3.1 supports JetPack 5.1.2 Jetson brings Cloud-Native to the edge and enables technologies like containers and container orchestration. NVIDIA JetPack includes NVIDIA Container Runtime with Docker integration, enabling GPU accelerated containerized applications on Jetson platform. NVIDIA hosts several container images for Jetson on NVIDIA NGC. Some are suitable for software development with samples and documentation and others are suitable for production software deployment, containing only runtime components. Find more information and a list of all container images at the Cloud-Native on Jetson page. NVIDIA Jetson modules include various security features including Hardware Root of Trust, Secure Boot, Hardware Cryptographic Acceleration, Trusted Execution Environment, Disk and Memory Encryption, Physical Attack Protection and more. Learn about the security features by jumping to the security section of the Jetson Linux Developer guide. JetPack 5.1.2 Security highlights include: Support for up to 3 signing keys to sign bootloader in secure boot and ability to revoke the keys;Ability to add and revoke UEFI signing keys;Enhanced secure boot for encrypting kernel, kernel-dtb and initrd;Support for signing kernel modules ;Support for delegated authentication with ability to sign UEFI with platform vendor owned keys
;Support in disk encryption for encrypting only User Data Partition (UDA) and runtime enabling encryption of UDA partitions 030 Sample Applications JetPack includes several samples which demonstrate the use of JetPack components. These are stored in the reference filesystem and can be compiled on the developer kit. JetPack component Sample locations on reference filesystem TensorRT
/usr/src/tensorrt/samples/
cuDNN CUDA
/usr/src/cudnn_samples_/
/usr/local/cuda-/samples/
Multimedia API
/usr/src/tegra_multimedia_api/
VisionWorks
/usr/share/visionworks-tracking/sources/samples/
/usr/share/visionworks-sfm/sources/samples/
/usr/share/visionworks/sources/samples/
OpenCV VPI
/usr/share/OpenCV/samples/
/opt/nvidia/vpi/vpi-/samples 031 Developer Tools JetPack includes the following developer tools. Some are used directly on a Jetson system, and others run on a Linux host computer connected to a Jetson system. Tools for application development and debugging:
NSight Eclipse Edition for development of GPU accelerated applications: Runs on Linux host computer. Supports all Jetson products. CUDA-GDB for application debugging: Runs on the Jetson system or the Linux host computer. Supports all Jetson products. CUDA-MEMCHECK for debugging application memory errors: Runs on the Jetson system. Supports all Jetson products. Tools for application profiling and optimization:
NSight Systems for application multi-core CPU profiling: Runs on the Linux host computer. Helps you improve application performance by identifying slow parts of code. Supports all Jetson products. NVIDIA Nsight Compute kernel profiler: An interactive profiling tool for CUDA applications. It provides detailed performance metrics and API debugging via a user interface and command line tool. NSight Graphics for graphics application debugging and profiling: A console-grade tool for debugging and optimizing OpenGL and OpenGL ES programs. Runs on the Linux host computer. Supports all Jetson products. 032 reasonable frequency harmful FCC Warnning:
This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide protection againstharmful interference in a residential installation. This equipment generates, with energy uses and can radiateradio and, maycause interference the there thatinterference occur is equipment cause determined by turning the equipmentoff interference Reorient or relocate the receiving antenna. Increase the separation between the equipment and receiver. Connect the equipment into an outlet on a circuit different from that to which the receiver is harmfulinterference to radio or television reception, which can be user in communications. installation. instructions, guarantee does accordance However, this If thefollowing measures:
radio a encouraged if to in particular installed correct more used one and and will not not the on, the try no by or to to of is connected. Consult the dealer or an experienced radio/TV technician for help. Any Caution:
could void your authority to operate this equipment. modications changes this or to device not explicitly approved by manufacturer 15 part with complies device This conditions:
(1)This interference received, including interference that may cause undesired operation. interference, Operation harmful subject device device Rules. cause may and FCC this not the
(2) to of is the following two must accept any complies equipment FCC This environment. should between the radiator and your body. equipment with This radiation be installed exposure and limits operated set with forth for an minimum uncontrolled 20cm distance