6.2. PTQ Conversion Tools Guide

The purpose of this section is to introduce the toolkit of the PTQ model conversion scheme provided by the D-Robotics X5 algorithm toolchain.

Tip

It is recommended that you finish the following preparations before reading this section:

1. Read Toolchain Overview about the PTQ and PTQ Conversion Principle And Process to understand the PTQ scheme and model conversion steps.

2. Complete the Docker environment installation and configuration as well as the image pulling according to Docker Container Deployment.

This section introduces the model conversion toolkit for the D-Robotics PTQ scheme. The toolkit can be run on a development PC or in a Docker environment.

If you choose to run the toolkit on your development PC, you should run install.sh under package/host in the horizon_x5_open_explorer installation package to install the toolkit. Once the installation is complete, run hb_mapper --help to verify the installation.

If you choose to run the toolkit in a Docker container, the above installation steps are not required.

Follow Docker Container Deployment to install the toolkit. Enter the Docker container and run hb_mapper --help to verify the installation.

The following sections describe how to use each tool in the toolkit.

• 6.2.1. PTQ Conversion Tool Reading Overview
• 6.2.2. The hb_mapper Tool
  • 6.2.2.1. Model Checking Tool (hb_mapper checker)
  • 6.2.2.2. Model Compiling Tool (hb_mapper makertbin)
  • 6.2.2.3. Inference Tool (hb_mapper infer)
• 6.2.3. The hb_perf Tool
  • 6.2.3.1. How to Use
  • 6.2.3.2. Parameters
  • 6.2.3.3. Output Contents
• 6.2.4. The vec_diff Tool
  • 6.2.4.1. How to Use
  • 6.2.4.2. Parameters
  • 6.2.4.3. Output Contents
• 6.2.5. The hb_model_info Tool
  • 6.2.5.1. How to Use
  • 6.2.5.2. Parameters
  • 6.2.5.3. Output Contents
• 6.2.6. The hb_pack Tool
  • 6.2.6.1. How to Use
  • 6.2.6.2. Parameters
  • 6.2.6.3. Output Contents
• 6.2.7. The hb_verifier Tool
  • 6.2.7.1. How to Use
  • 6.2.7.2. Parameters
  • 6.2.7.3. Examples of Reference Usage
  • 6.2.7.4. Description of the Output Content
• 6.2.8. The hb_model_modifier Tool
  • 6.2.8.1. How to Use
  • 6.2.8.2. Parameters
  • 6.2.8.3. Output Contents
• 6.2.9. The hb_custom_op Tool
  • 6.2.9.1. How to Use
  • 6.2.9.2. Parameters
  • 6.2.9.3. Output Contents
• 6.2.10. The hb_eval_preprocess Tool
  • 6.2.10.1. How to Use
  • 6.2.10.2. Parameters
  • 6.2.10.3. Output Contents
• 6.2.11. The HB_ONNXRuntime Inference Library
  • 6.2.11.1. How to Use
  • 6.2.11.2. Parameters
• 6.2.12. Accuracy Debug Tool
  • 6.2.12.1. Quickstart
  • 6.2.12.2. Function Description