j3 2 d dl Z d dlZd dlmZ d dlZd dlZd dlmZ d dlm Z d dl
m Z d dl m
Z
g ej _ G d d Zed k rId dlZ eej Zed
k r
ej d
ndZ ee dS dS ) N)Any)YOLO)LOGGER)check_requirements)GITHUB_ASSETS_STEMSc R e Zd ZdZdeddfdZd dZd dZd dZd d Z d d
Z
d d Z dS )
Inferencea A class to perform object detection, image classification, image segmentation and pose estimation inference.
This class provides functionalities for loading models, configuring settings, uploading video files, and performing
real-time inference using Streamlit and Ultralytics YOLO models.
Attributes:
st (module): Streamlit module for UI creation.
temp_dict (dict): Temporary dictionary to store the model path and other configuration.
model_path (str): Path to the loaded model.
model (YOLO): The YOLO model instance.
source (str): Selected video source (webcam or video file).
enable_trk (bool): Enable tracking option.
conf (float): Confidence threshold for detection.
iou (float): IoU threshold for non-maximum suppression.
org_frame (Any): Container for the original frame to be displayed.
ann_frame (Any): Container for the annotated frame to be displayed.
vid_file_name (str | int): Name of the uploaded video file or webcam index.
selected_ind (list[int]): List of selected class indices for detection.
Methods:
web_ui: Set up the Streamlit web interface with custom HTML elements.
sidebar: Configure the Streamlit sidebar for model and inference settings.
source_upload: Handle video file uploads through the Streamlit interface.
configure: Configure the model and load selected classes for inference.
inference: Perform real-time object detection inference.
Examples:
Create an Inference instance with a custom model
>>> inf = Inference(model="path/to/model.pt")
>>> inf.inference()
Create an Inference instance with default settings
>>> inf = Inference()
>>> inf.inference()
kwargsreturnNc ` t d ddl}|| _ d| _ g | _ d| _ d| _ d| _ d| _ d| _ d| _
g | _ d| _ ddi|| _
d| _ | j
d | j
d | _ t j d| j
dS ) zInitialize the Inference class, checking Streamlit requirements and setting up the model path.
Args:
**kwargs (Any): Additional keyword arguments for model configuration.
zstreamlit>=1.29.0r NFg ?g?modelu Ultralytics Solutions: ✅ )r streamlitstsourceimg_file_names
enable_trkconfiou org_frame ann_frame
vid_file_name selected_indr
temp_dict
model_pathr info)selfr
r s n/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/ultralytics/solutions/streamlit_inference.py__init__zInference.__init__7 s ./// !')
!4262 >' " . "nW 5DO B$.BBCCCCC c d}d}d}| j dd | j |d | j |d | j |d d S )
z=Set up the Streamlit web interface with custom HTML elements.z-zUltralytics YOLO Streamlit Application
u Experience real-time object detection on your webcam, videos, and images
with the power of Ultralytics YOLO! 🚀
zUltralytics Streamlit Appwide)
page_titlelayoutT)unsafe_allow_htmlN)r set_page_configmarkdown)r menu_style_cfgmain_title_cfg
sub_title_cfgs r web_uizInference.web_uiS s Lv?
+Fv VVV 4@@@ 4@@@ $?????r c | j j 5 d}| j |d ddd n # 1 swxY w Y | j j d | j j dd | _ | j dv r)| j j d d
d k | _ t | j j d d
d| j
d | _
t | j j dd
d| j d | _ | j dk rQ| j d \ }}|
| _ |
| _ dS dS )zAConfigure the Streamlit sidebar for model and inference settings.z`https://raw.githubusercontent.com/ultralytics/assets/main/logo/Ultralytics_Logotype_Original.svg )widthNzUser ConfigurationSource)webcamvideoimage)r/ r0 zEnable Tracking)YesNor2 zConfidence Thresholdg g ?g{Gz?z
IoU Thresholdr1 )r sidebarr1 title selectboxr radior floatsliderr r columnsemptyr r )r logocol1col2s r r5 zInference.sidebarf s
W_ + +uD GMM$cM * * * + + + + + + + + + + + + + + +
2333go// (
;- - - "go 3 34E} U UY^ ^DO GO " "#93TYPT U U
//c48UYZZ[[ ;' ! ! ++JD$ !ZZ\\DN !ZZ\\DNNN " !s 8<<c \ ddl m}m} d| _ | j dk r| j j d| }|~t j |
}t dd 5 }| |
ddd n # 1 swxY w Y d| _ dS dS | j d
k r d| _ dS | j d k rddl
}| j j d |d
x}r|D ]}| dd|j d d 5 } | |
| j | j |j d ddd n # 1 swxY w Y dS dS dS )z:Handle video file uploads through the Streamlit interface.r ) IMG_FORMATS VID_FORMATS r0 zUpload Video File)typeNzultralytics.mp4wbr/ r1 zUpload Image FilesT)rD accept_multiple_filesF.)deletesuffix)pathname)ultralytics.data.utilsrA rB r r r r5
file_uploaderioBytesIOreadopenwritetempfileNamedTemporaryFilerL splitr append)
r rA rB vid_filegoutrT imgfilesimgfiletfs
r
source_uploadzInference.source_upload} sl CCCCCCCC ;' ! !w445H{4[[H#Jx}}//+T22 (cIIaffhh'''( ( ( ( ( ( ( ( ( ( ( ( ( ( (%6""" $#
[H
$
$!"D
[G
#
# OOO 7?88$;d 9 x
\ ( \ \G!44EJkglN`N`adNeNefhNiJkJk4ll \pr 000 +22BGW\3Z3Z[[[\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ $
#
\
\\ \s% 4(B((B,/B,AF F #F c ~ g dg dct fdt D fd }| j r| d| j | j j d| | j d 5 d st fd
d D r}n
d }t | | _ t | j j d
d
d
n # 1 swxY w Y | j d | j j dd
d }fd|D | _ t' | j t st | j | _ d
S d
S )zz1Inference.configure... s- 661q||A666666r grayscaleyolor )anyreplace)ri rk M_ORDs @r
z'Inference.configure.. se
666666666
z%Inference.configure.. sJ 5;;q!u{{}}55u{{1QRR5;;==CVTV7W7WX r )keyr ModelzModel is downloading...).ptz.onnxz .torchscriptz
.mlpackagez.enginec 3 K | ]}|v V d S rg )ri fmtselected_models r rl z&Inference.configure.. sA i i*-~%i i i i i ir )openvino_model
rknn_modelr{ NzModel loaded successfully!Classes )defaultc : g | ]} | S r} )ru )ri option class_namess r rr z'Inference.configure.. s' V V V6[ . .v 6 6 V V Vr )sortedr r insertr r5 r7 spinnerendswithro rv r r
listnamesvaluessuccess multiselectr
isinstance)r available_modelsr selected_classesrq rw r r s @@@@r configurezInference.configure sX ONNPuPuPu u!
,
YXXXX
? 8 # #At 7 7 7 227 r? resultsannotated_images r image_inferencezInference.image_inference s + D DH 'HJx((E !FHV4D!F!FGGG !W__Q / /
d S SGMM%%AQMRRRS S S S S S S S S S S S S S S **URVRc*dd")!*//"3"3 ^ ^GMM/EK\M]]]^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^Ih''''( D
BCCCC# D Ds6 , BB B % DD D D11
D?>D?c | | | | | j j d r| j dk r8| j r| n| j d dS | j j d }t j | j }|
s | j d dS |
r*| \ }}|s| j d n| j r/| j || j | j | j d }n(| || j | j | j
}|d }|r-| | j | j |d d
| j |d d |
*| t j dS )zEPerform real-time object detection inference on video or webcam feed.Startr1 z1Please upload an image file to perform inference.NStopz&Could not open webcam or video source.zQFailed to read frame from webcam. Please verify the webcam is connected properly.T)r r r persistr r r zOriginal Framer zPredicted Frame) r* r5 r^ r r buttonr r r r r VideoCapturer isOpenedr rQ warningr r
trackr r r r releasestopr r1 r destroyAllWindows)r stop_buttoncapr framer annotated_frames r inferencezInference.inference sA
7? ! !' * * % {g%%& V((****GLL!TUUU '/0088K"4#566C<<>>
FGGG,,..
a!$ GOO$wxxx ? i "j . . DI48TEV`d / GG #jjTYDHVZVgj h hG")!*//"3"3 #KKMMMGLLNNN$$UUDT$UUU$$_uN_$```+ ,,..
a.
KKMMM r )r N) __name__
__module__ __qualname____doc__r r r* r5 r^ r r r r} r r r r s " "HD D D D D D8@ @ @ @&* * * *.\ \ \ \2 8 8 8 8DD D D D*- - - - - - r r __main__ )r
)rO r typingr r torch ultralyticsr ultralytics.utilsr ultralytics.utils.checksr ultralytics.utils.downloadsr r __path__r r syslenargvargsr
r r} r r r s+
$ $ $ $ $ $ 7 7 7 7 7 7 ; ; ; ; ; ;
h h h h h h h h V zJJJ 3sx==D !88CHQKKE
IE$$&&&&& r