6.2.1. PTQ Conversion Tool Reading Overview

Tools

Tools Introduction

The hb_mapper Tool

The hb_mapper is a tool provided by D-Robotics, which maps floating-point models to quantized models and provides validation feature. It provides the features of model checking, model conversion, and dumping vector outputs of conv layers at various stages.

The hb_perf Tool

The hb_perf is a an analytical tool provided by D-Robotics for analyzing the performance of quantized heterogeneous models (HGMs).

The vec_diff Tool

The vec_diff is vector comparison tool provided by Horizon. By using this tool, you can use it to compare the differences of conv layers outputs at different stages of the model, which can be used to locate accuracy problem.

The hb_model_info Tool

The hb_model_info is a tool provided by D-Robotics, which is used to parse the dependencies and parameters of heterogeneous models (.bin) in compilation.

The hb_pack Tool

The hb_pack is a tool provided by D-Robotics for packing multiple *.bin models into one model file.

The hb_verifier Tool

The hb_verifier is a tool provided by D-Robotics for validating the results of a specified fixed-point model and *.bin runtime model.

The hb_model_modifier Tool

The hb_model_modifier is a tool provided by D-Robotics for deleting some specific types of nodes at the inputs and outputs of the runtime model.

The hb_custom_op Tool

The hb_custom_op is a tool provided by D-Robotics for generating the python template file of user customized ops. The template file contains the calculation definition function of custom ops.

The hb_eval_preprocess Tool

The hb_eval_preprocess is a tool provided by D-Robotics for preprocessing image data on x86 system (certain image data operations before being fed into the model, e.g., image resizing, image cropping, image padding, etc.) when you evaluate model accuracy.

HB_ONNXRuntime Inference Library

The HB_ONNXRuntime is an ONNX model inference library for the x86 side packaged by D-Robotics based on the public version of ONNXRuntime.

Accuracy Debug Tool

The Accuracy Debug Tool is a tool provided by D-Robotics for helping you to locate accuracy problems in the model quantization process on your own. It can help you to analyze the node-granularity quantization error of the calibration model, and finally quickly locate the nodes with accuracy anomalies.