/jjddlmZddlmZddlZddlmZddlmZm Z ddl m Z Gdd e Z dS) ) annotations)PathN)LOGGER)check_requirements is_rockchip) BaseBackendc"eZdZdZd dZd d Zd S) RKNNBackendzRockchip RKNN inference backend for Rockchip NPU hardware. Loads and runs inference with RKNN models (.rknn files) using the RKNN-Toolkit-Lite2 runtime. Only supported on Rockchip devices with NPU hardware (e.g., RK3588, RK3566). weight str | PathreturnNonectstdtjd|dt dddlm}t|}|s"t| d}||_ |j t|}|dkrtd||j }|dkrtd ||jd z }|r0dd lm}|||d Sd S) aJLoad a Rockchip RKNN model from a .rknn file or model directory. Args: weight (str | Path): Path to the .rknn file or directory containing the model. Raises: OSError: If not running on a Rockchip device. RuntimeError: If model loading or runtime initialization fails. z5RKNN inference is only supported on Rockchip devices.zLoading z for RKNN inference...zrknn-toolkit-lite2r)RKNNLitez*.rknnzFailed to load RKNN model: zFailed to init RKNN runtime: z metadata.yaml)YAMLN)rOSErrorrinfor rknnlite.apirris_filenextrglobmodel load_rknnstr RuntimeError init_runtimeparentexistsultralytics.utilsrapply_metadataload)selfr rwret metadata_filers a/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/ultralytics/nn/backends/rknn.py load_modelzRKNNBackend.load_modelsp}} SQRR R =v===>>>/000)))))) LLyy{{ (QWWX&&''AXZZ j""3q66** !88BSBBCC Cj%%'' !88DsDDEE E?2    ! ! : . . . . . .    - 8 8 9 9 9 9 9 : :im torch.Tensorlistc|dzd}t|tt fr|n|g}|j|S)zRun inference on the Rockchip NPU. Args: im (torch.Tensor): Input image tensor in BCHW format, normalized to [0, 1]. Returns: (list): Model predictions as a list of output arrays. uint8)inputs)cpunumpyastype isinstancer,tupler inference)r#r*s r'forwardzRKNNBackend.forward;seffhhnn$ , ,W 5 5b4-00 :RRrdz##2#...r)N)r r rr)r*r+rr,)__name__ __module__ __qualname____doc__r(r7r)r'r r sG #:#:#:#:J / / / / / /r)r ) __future__rpathlibrtorchr rultralytics.utils.checksrrbaser r r<r)r'rBs#""""" $$$$$$DDDDDDDD7/7/7/7/7/+7/7/7/7/7/r)