1.1. OE Document Introduction¶
This section provides a comprehensive guide to the development process for all developers using the D-Robotics X3 processor. To give you a full understanding of the overall process, we recommend that you first go through this section, which briefly describes all the sub-sections.
1.1.1. Product Introduction¶
OE Document Introduction (current section)
This section provides you with an overview of the contents of relevant sections and content jump links, as well as the recommended reading order of the document.
This section introduces OpenExplorer, as well as a brief overview of the contents in the release package and some of the key concepts that may be referenced repeatedly as you read.
This section briefly describes the toolchain and the overall usage process.
1.1.2. Environmental Installation¶
This section describes the environment deployment that needs to be performed in advance in the development and runtime environments.
Version Management of OE Package
This section describes how to use the version management tool (ddk_vc) of the OE package.
1.1.3. Quick Start¶
This section briefly introduces the two quantification methods: QAT and PTQ.
Algorithm Model PTQ + On-board Deployment Quick Start
This section provides a quick start sample of algorithm model quantization + on board using the PTQ scheme to help you understand the basic process of the post-training quantization (PTQ) and on board deployment of the floating-point conversion toolchain.
1.1.4. Floating-point Model Convert to Fixed-point Model Guide¶
Post-training Quantization (PTQ)
To guide you through post-training quantization (PTQ), this section introduces the PTQ principles and desribes how to use the PTQ tool, PTQ sample package, and the appendix.
Quantized Awareness Training (QAT)
This section describe in details horizon_plugin_pytorch, a quantitative training tool developed by D-Robotics based on PyTorch, through the introduction of environmental dependence, quick start, tutorial, API reference, note and the calibration.
1.1.5. Embedded Application Development (Runtime) Manual¶
Embedded Application Development
This section introduces the steps to deploy the quantitative training models to the J5 hardware platform, related considerations, the common multi-model control concepts, and the application tuning recommendations.
This section introduces the API, data, structures, layout and alignment rules of D-Robotics OpenExplorer Toolchain Runtime, so that you can easily perform operations such as loading or releasing models, retrieving information, and performing inference by using APIs on the D-Robotics hardware platform.
This section provides you with the following three reference examples. You can experience these examples and use them to develop your own applications.
1.BPU SDK API teaching example.
2.Custom OP (custom operator) and other special function examples.
3.Miscellaneous examples of non-NV12 input models.
This section provides you with performance and accuracy evaluation samples of common classification, detection, segmentation, and optical flow estimation models for embedded application development.
The sample packages come with pre-built source code, executables, and evaluation scripts that you can experience on the D-Robotics development board and develop applications based on these samples directly.
This section introduces the parameter descriptions, usage and usage examples of the hrt_bin_dump tool, the layer dump tool for model, the parameter descriptions, usage and usage examples of the model execution tool, hrt_model_exec tool, and auxiliary tools and common operations.
1.1.6. Advanced Contents¶
As an advanced content, this section includes general guides and recommendations for you to design efficient models on the X3 processor.
1.1.7. Appendix¶
Benchmark of Model Performance
This section introduces the model Benchmark data under certain test conditions, so that you can clearly understand the model performance.
Model Conversion Toolchain Operator Support Constraint List
This section provides a list of operators supported by D-Robotics, as well as their types, constraints, and general usage restrictions.
This section introduces some common abbreviations and their full names and meanings in this document.
This section provides a brief introduction to the X3 processor, including the functional framework, processor specifications, and video channel capabilities, to facilitate your general understanding of the processor.
Development Board Kit and System Image Description
This chapter provides a detailed description of how to use the development board kit, including the setup of the development environment, running example tutorials, developing applications, and customizing system images.