-
Notifications
You must be signed in to change notification settings - Fork 1
Description
@arvcode Dear
I can convert effficient 5 to ONNX success by offset 11 ,but when convert the onnx model to tensorrt 8.2.1 it has error
./trtexec --explicitBatch --workspace=2048 --tacticSources=-cublasLt,+cublas --onnx=outputmodel/tf_efficientnet_b5_ap_set11.onnx --saveEngine=efficientnet5_engine_adabin.trt --verbose=True --fp16=True
&&&& RUNNING TensorRT.trtexec [TensorRT v8202] # ./trtexec --explicitBatch --workspace=2048 --tacticSources=-cublasLt,+cublas --onnx=outputmodel/tf_efficientnet_b5_ap_set11.onnx --saveEngine=efficientnet5_engine_adabin.trt --verbose=True --fp16=True
[01/19/2022-03:52:36] [W] --explicitBatch flag has been deprecated and has no effect!
[01/19/2022-03:52:36] [W] Explicit batch dim is automatically enabled if input model is ONNX or if dynamic shapes are provided when the engine is built.
[01/19/2022-03:52:36] [I] === Model Options ===
[01/19/2022-03:52:36] [I] Format: ONNX
[01/19/2022-03:52:36] [I] Model: outputmodel/tf_efficientnet_b5_ap_set11.onnx
[01/19/2022-03:52:36] [I] Output:
[01/19/2022-03:52:36] [I] === Build Options ===
[01/19/2022-03:52:36] [I] Max batch: explicit batch
[01/19/2022-03:52:36] [I] Workspace: 2048 MiB
[01/19/2022-03:52:36] [I] minTiming: 1
[01/19/2022-03:52:36] [I] avgTiming: 8
[01/19/2022-03:52:36] [I] Precision: FP32+FP16
[01/19/2022-03:52:36] [I] Calibration:
[01/19/2022-03:52:36] [I] Refit: Disabled
[01/19/2022-03:52:36] [I] Sparsity: Disabled
[01/19/2022-03:52:36] [I] Safe mode: Disabled
[01/19/2022-03:52:36] [I] DirectIO mode: Disabled
[01/19/2022-03:52:36] [I] Restricted mode: Disabled
[01/19/2022-03:52:36] [I] Save engine: efficientnet5_engine_adabin.trt
[01/19/2022-03:52:36] [I] Load engine:
[01/19/2022-03:52:36] [I] Profiling verbosity: 0
[01/19/2022-03:52:36] [I] Tactic sources: cublas [ON], cublasLt [OFF],
[01/19/2022-03:52:36] [I] timingCacheMode: local
[01/19/2022-03:52:36] [I] timingCacheFile:
[01/19/2022-03:52:36] [I] Input(s)s format: fp32:CHW
[01/19/2022-03:52:36] [I] Output(s)s format: fp32:CHW
[01/19/2022-03:52:36] [I] Input build shapes: model
[01/19/2022-03:52:36] [I] Input calibration shapes: model
[01/19/2022-03:52:36] [I] === System Options ===
[01/19/2022-03:52:36] [I] Device: 0
[01/19/2022-03:52:36] [I] DLACore:
[01/19/2022-03:52:36] [I] Plugins:
[01/19/2022-03:52:36] [I] === Inference Options ===
[01/19/2022-03:52:36] [I] Batch: Explicit
[01/19/2022-03:52:36] [I] Input inference shapes: model
[01/19/2022-03:52:36] [I] Iterations: 10
[01/19/2022-03:52:36] [I] Duration: 3s (+ 200ms warm up)
[01/19/2022-03:52:36] [I] Sleep time: 0ms
[01/19/2022-03:52:36] [I] Idle time: 0ms
[01/19/2022-03:52:36] [I] Streams: 1
[01/19/2022-03:52:36] [I] ExposeDMA: Disabled
[01/19/2022-03:52:36] [I] Data transfers: Enabled
[01/19/2022-03:52:36] [I] Spin-wait: Disabled
[01/19/2022-03:52:36] [I] Multithreading: Disabled
[01/19/2022-03:52:36] [I] CUDA Graph: Disabled
[01/19/2022-03:52:36] [I] Separate profiling: Disabled
[01/19/2022-03:52:36] [I] Time Deserialize: Disabled
[01/19/2022-03:52:36] [I] Time Refit: Disabled
[01/19/2022-03:52:36] [I] Skip inference: Disabled
[01/19/2022-03:52:36] [I] Inputs:
[01/19/2022-03:52:36] [I] === Reporting Options ===
[01/19/2022-03:52:36] [I] Verbose: Enabled
[01/19/2022-03:52:36] [I] Averages: 10 inferences
[01/19/2022-03:52:36] [I] Percentile: 99
[01/19/2022-03:52:36] [I] Dump refittable layers:Disabled
[01/19/2022-03:52:36] [I] Dump output: Disabled
[01/19/2022-03:52:36] [I] Profile: Disabled
[01/19/2022-03:52:36] [I] Export timing to JSON file:
[01/19/2022-03:52:36] [I] Export output to JSON file:
[01/19/2022-03:52:36] [I] Export profile to JSON file:
[01/19/2022-03:52:36] [I]
[01/19/2022-03:52:36] [I] === Device Information ===
[01/19/2022-03:52:36] [I] Selected Device: GeForce RTX 2080 Ti
[01/19/2022-03:52:36] [I] Compute Capability: 7.5
[01/19/2022-03:52:36] [I] SMs: 68
[01/19/2022-03:52:36] [I] Compute Clock Rate: 1.635 GHz
[01/19/2022-03:52:36] [I] Device Global Memory: 11019 MiB
[01/19/2022-03:52:36] [I] Shared Memory per SM: 64 KiB
[01/19/2022-03:52:36] [I] Memory Bus Width: 352 bits (ECC disabled)
[01/19/2022-03:52:36] [I] Memory Clock Rate: 7 GHz
[01/19/2022-03:52:36] [I]
[01/19/2022-03:52:36] [I] TensorRT version: 8.2.2
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::EfficientNMS_TFTRT_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Proposal version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Split version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[01/19/2022-03:52:36] [I] [TRT] [MemUsageChange] Init CUDA: CPU +297, GPU +0, now: CPU 300, GPU 320 (MiB)
[01/19/2022-03:52:37] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 300 MiB, GPU 320 MiB
[01/19/2022-03:52:37] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 319 MiB, GPU 320 MiB
[01/19/2022-03:52:37] [I] Start parsing network model
[01/19/2022-03:52:37] [I] [TRT] ----------------------------------------------------------------
[01/19/2022-03:52:37] [I] [TRT] Input filename: outputmodel/tf_efficientnet_b5_ap_set11.onnx
[01/19/2022-03:52:37] [I] [TRT] ONNX IR version: 0.0.7
[01/19/2022-03:52:37] [I] [TRT] Opset version: 11
[01/19/2022-03:52:37] [I] [TRT] Producer name: pytorch
[01/19/2022-03:52:37] [I] [TRT] Producer version: 1.10
[01/19/2022-03:52:37] [I] [TRT] Domain:
[01/19/2022-03:52:37] [I] [TRT] Model version: 0
[01/19/2022-03:52:37] [I] [TRT] Doc string:
[01/19/2022-03:52:37] [I] [TRT] ----------------------------------------------------------------
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TFTRT_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Split version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[01/19/2022-03:52:37] [V] [TRT] Adding network input: input0 with dtype: float32, dimensions: (-1, 3, 480, 640)
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: input0 for ONNX tensor: input0
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_reduce.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_reduce.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_expand.weight
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_expand.bias
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1666
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1667
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1669
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1670
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1672
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1673
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1675
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1676
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1678
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1679
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1681
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1682
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1684
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1685
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1687
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1688
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1690
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1691
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1693
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1694
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1696
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1697
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1699
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1700
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1702
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1703
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1705
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1706
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1708
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1709
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1711
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1712
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1714
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1715
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1717
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1718
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1720
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1721
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1723
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1724
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1726
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1727
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1729
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1730
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1732
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1733
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1735
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1736
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1738
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1739
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1741
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1742
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1744
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1745
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1747
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1748
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1750
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1751
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1753
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1754
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1756
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1757
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1759
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1760
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1762
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1763
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1765
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1766
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1768
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1769
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1771
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1772
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1774
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1775
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1777
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1778
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1780
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1781
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1783
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1784
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1786
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1787
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1789
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1790
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1792
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1793
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1795
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1796
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1798
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1799
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1801
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1802
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1804
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1805
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1807
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1808
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1810
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1811
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1813
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1814
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1816
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1817
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1819
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1820
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1822
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1823
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1825
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1826
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1828
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1829
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1831
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1832
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1834
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1835
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1837
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1838
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1840
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1841
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1843
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1844
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1846
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1847
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1849
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1850
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1852
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1853
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1855
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1856
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1858
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1859
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1861
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1862
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1864
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1865
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1867
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1868
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1870
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1871
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1873
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1874
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1876
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1877
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1879
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1880
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1882
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1883
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1885
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1886
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1888
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1889
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1891
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1892
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1894
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1895
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1897
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1898
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1900
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1901
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1903
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1904
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1906
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1907
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1909
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1910
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1912
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1913
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1915
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1916
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1918
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1919
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1921
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1922
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1924
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1925
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1927
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1928
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1930
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1931
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1933
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1934
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1936
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1937
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1939
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1940
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1942
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1943
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1945
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1946
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1948
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1949
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1951
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1952
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1954
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1955
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1957
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1958
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1960
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1961
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1963
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1964
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1966
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1967
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1969
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1970
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1972
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1973
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1975
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1976
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1978
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1979
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1981
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1982
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1984
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1985
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1987
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1988
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1990
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1991
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1993
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1994
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1996
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1997
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1999
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2000
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2002
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2003
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2005
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2006
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2008
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2009
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2011
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2012
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2016
[01/19/2022-03:52:37] [W] [TRT] onnx2trt_utils.cpp:366: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2017
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2021
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2022
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2026
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2027
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2031
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2032
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2036
[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2037
[01/19/2022-03:52:37] [V] [TRT] Parsing node: ConstantOfShape_0 [ConstantOfShape]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 2016
[01/19/2022-03:52:37] [V] [TRT] ConstantOfShape_0 [ConstantOfShape] inputs: [2016 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: 2016 for ONNX node: 2016
[01/19/2022-03:52:37] [V] [TRT] Registering layer: ConstantOfShape_0 for ONNX node: ConstantOfShape_0
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 862 for ONNX tensor: 862
[01/19/2022-03:52:37] [V] [TRT] ConstantOfShape_0 [ConstantOfShape] outputs: [862 -> (4)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Concat_1 [Concat]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 2017
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 862
[01/19/2022-03:52:37] [V] [TRT] Concat_1 [Concat] inputs: [2017 -> (4)[INT32]], [862 -> (4)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: 2017 for ONNX node: 2017
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Concat_1 for ONNX node: Concat_1
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 863 for ONNX tensor: 863
[01/19/2022-03:52:37] [V] [TRT] Concat_1 [Concat] outputs: [863 -> (8)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_2 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_2 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Constant_2 [Constant] outputs: [864 -> (2)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Reshape_3 [Reshape]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 863
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 864
[01/19/2022-03:52:37] [V] [TRT] Reshape_3 [Reshape] inputs: [863 -> (8)[INT32]], [864 -> (2)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Reshape_3 for ONNX node: Reshape_3
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 865 for ONNX tensor: 865
[01/19/2022-03:52:37] [V] [TRT] Reshape_3 [Reshape] outputs: [865 -> (4, 2)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_4 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_4 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Constant_4 [Constant] outputs: [866 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_5 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_5 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Constant_5 [Constant] outputs: [867 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_6 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_6 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Weight at index 0: -9223372036854775807 is out of range. Clamping to: -2147483648
[01/19/2022-03:52:37] [W] [TRT] onnx2trt_utils.cpp:392: One or more weights outside the range of INT32 was clamped
[01/19/2022-03:52:37] [V] [TRT] Constant_6 [Constant] outputs: [868 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_7 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_7 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Constant_7 [Constant] outputs: [869 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Slice_8 [Slice]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 865
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 867
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 868
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 866
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 869
[01/19/2022-03:52:37] [V] [TRT] Slice_8 [Slice] inputs: [865 -> (4, 2)[INT32]], [867 -> (1)[INT32]], [868 -> (1)[INT32]], [866 -> (1)[INT32]], [869 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Slice_8 for ONNX node: Slice_8
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 870 for ONNX tensor: 870
[01/19/2022-03:52:37] [V] [TRT] Slice_8 [Slice] outputs: [870 -> (4, 2)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Transpose_9 [Transpose]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 870
[01/19/2022-03:52:37] [V] [TRT] Transpose_9 [Transpose] inputs: [870 -> (4, 2)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Transpose_9 for ONNX node: Transpose_9
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 871 for ONNX tensor: 871
[01/19/2022-03:52:37] [V] [TRT] Transpose_9 [Transpose] outputs: [871 -> (2, 4)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_10 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_10 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Constant_10 [Constant] outputs: [872 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Reshape_11 [Reshape]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 871
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 872
[01/19/2022-03:52:37] [V] [TRT] Reshape_11 [Reshape] inputs: [871 -> (2, 4)[INT32]], [872 -> (1)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Reshape_11 for ONNX node: Reshape_11
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 873 for ONNX tensor: 873
[01/19/2022-03:52:37] [V] [TRT] Reshape_11 [Reshape] outputs: [873 -> (8)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Cast_12 [Cast]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 873
[01/19/2022-03:52:37] [V] [TRT] Cast_12 [Cast] inputs: [873 -> (8)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Casting to type: int32
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Cast_12 for ONNX node: Cast_12
[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874
[01/19/2022-03:52:37] [V] [TRT] Cast_12 [Cast] outputs: [874 -> (8)[INT32]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_13 [Constant]
[01/19/2022-03:52:37] [V] [TRT] Constant_13 [Constant] inputs:
[01/19/2022-03:52:37] [V] [TRT] Constant_13 [Constant] outputs: [875 -> ()[FLOAT]],
[01/19/2022-03:52:37] [V] [TRT] Parsing node: Pad_14 [Pad]
[01/19/2022-03:52:37] [V] [TRT] Searching for input: input0
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 874
[01/19/2022-03:52:37] [V] [TRT] Searching for input: 875
[01/19/2022-03:52:37] [V] [TRT] Pad_14 [Pad] inputs: [input0 -> (-1, 3, 480, 640)[FLOAT]], [874 -> (8)[INT32]], [875 -> ()[FLOAT]],
[01/19/2022-03:52:37] [V] [TRT] Registering layer: Pad_14 for ONNX node: Pad_14
[01/19/2022-03:52:37] [E] Error[4]: [shuffleNode.cpp::symbolicExecute::387] Error Code 4: Internal Error (Reshape_3: IShuffleLayer applied to shape tensor must have 0 or 1 reshape dimensions: dimensions were [-1,2])
[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:773: While parsing node number 14 [Pad -> "876"]:
[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:774: --- Begin node ---
[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:775: input: "input0"
input: "874"
input: "875"
output: "876"
name: "Pad_14"
op_type: "Pad"
attribute {
name: "mode"
s: "constant"
type: STRING
}
doc_string: "/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/functional.py(4174): _pad\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/padding.py(23): forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1090): _slow_forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\n/home/jliu/.cache/torch/hub/rwightman_gen-efficientnet-pytorch_master/geffnet/conv2d_layers.py(111): forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1090): _slow_forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\n/home/jliu/.cache/torch/hub/rwightman_gen-efficientnet-pytorch_master/geffnet/gen_efficientnet.py(260): features\n/home/jliu/.cache/torch/hub/rwightman_gen-efficientnet-pytorch_master/geffnet/gen_efficientnet.py(278): forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1090): _slow_forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/jit/_trace.py(118): wrapper\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/jit/_trace.py(127): forward\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/jit/_trace.py(1166): _get_trace_graph\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(388): _trace_and_get_graph_from_model\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(437): _create_jit_graph\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(493): _model_to_graph\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(724): _export\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/init.py(28): _export\n/home/jliu/data2/torch2trt/onnx_export.py(106): main\n/home/jliu/data2/torch2trt/onnx_export.py(129): \n"
[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:776: --- End node ---
[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:779: ERROR: ModelImporter.cpp:179 In function parseGraph:
[6] Invalid Node - Pad_14
[shuffleNode.cpp::symbolicExecute::387] Error Code 4: Internal Error (Reshape_3: IShuffleLayer applied to shape tensor must have 0 or 1 reshape dimensions: dimensions were [-1,2])
[01/19/2022-03:52:37] [E] Failed to parse onnx file
[01/19/2022-03:52:37] [I] Finish parsing network model
[01/19/2022-03:52:37] [E] Parsing model failed
[01/19/2022-03:52:37] [E] Failed to create engine from model.
[01/19/2022-03:52:37] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8202] # ./trtexec --explicitBatch --workspace=2048 --tacticSources=-cublasLt,+cublas --onnx=outputmodel/tf_efficientnet_b5_ap_set11.onnx --saveEngine=efficientnet5_engine_adabin.trt --verbose=True --fp16=True