jC2 &ddlmZddlZddlmZddlmZddlmZddl m Z m Z m Z m Z mZmZddlmZmZdd lmZmZdd lmZdd lmZd Zd"d Zd"dZd"dZd"dZd"dZd"dZ d"dZ!d"dZ" d#dZ# d$dZ$eeeeee e!e"ee e!e"d Z%d%d!Z&dS)&)partialN)attempt_download_asset) torch_load) MaskDecoder)FpnNeckHiera ImageEncoderImageEncoderViT MemoryEncoder PromptEncoder)MemoryAttentionMemoryAttentionLayer) SAM2ModelSAMModel)TinyViT)TwoWayTransformerc||St|}t|d5}t|}dddn #1swxYwYd|vr#t|dtr|d}|||S)z*Load checkpoint into model from file path.Nrbmodel)ropenr isinstancedictload_state_dict)r checkpointf state_dicts a/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/ultralytics/models/sam/build.py_load_checkpointrs ' 33J j$  #1]] ###############*Jw,?!F!F(  *%%% LsAAAc.tdddgd|S)z_Build and return a Segment Anything Model (SAM) h-size model with specified encoder parameters. encoder_embed_dim encoder_depthencoder_num_headsencoder_global_attn_indexesr _build_samrs rbuild_sam_vit_hr1', $3OO    c.tdddgd|S)z_Build and return a Segment Anything Model (SAM) l-size model with specified encoder parameters.r#) r'r)r.r0s rbuild_sam_vit_lr:2r2r3c.tdddgd|S)z_Build and return a Segment Anything Model (SAM) b-size model with specified encoder parameters. )r7r8r)r.r0s rbuild_sam_vit_br@=s, $1MM    r3c8tgdgdgddd|S)z_Build and return a Mobile Segment Anything Model (Mobile-SAM) for efficient image segmentation.)@i@)r>r>r>)r>r7 NT)r*r+r,r- mobile_samrr.r0s rbuild_mobile_samrIHs9 ---"ll'--$(    r3c >tdgddgdgdgd|S)zjBuild and return a Segment Anything Model 2 (SAM2) tiny-size model with specified architecture parameters.`)rr>r%r>r)r7r% r?rFr%r<irKr*encoder_stagesr,encoder_global_att_blocksencoder_window_specencoder_backbone_channel_listr _build_sam2r0s r build_sam2_trXTs@ #||"+)))MM&9&9&9   r3c >tdgddgdgdgd|S)zeBuild and return a small-size Segment Anything Model 2 (SAM2) with specified architecture parameters.rK)rr>r8r>r)r%rG rMrOrQrVr0s r build_sam2_sr[as@ $}}"-++)MM&9&9&9   r3c Dtdgddgdgdddggd|S) zjBuild and return a Segment Anything Model 2 (SAM2) base-size model with specified architecture parameters.p)r>r#r^r>)r=r#rMrN)iir])r*rRr,rSrTencoder_window_spatial_sizerUrrVr0s r build_sam2_brbnsG $}}".,,)MM%'H&:&:&:    r3c >tdgddgdgdgd|S)zeBuild and return a large-size Segment Anything Model 2 (SAM2) with specified architecture parameters.r>rE$rFr>)r'!+r?rFr#r?ii@i rdrQrVr0s r build_sam2_lrk|s@ $}}".,,)MM&;&;&;   r3Fcd}d}d}||z} |rtddd|||gddddd ddd n8t|||d ttjjd ||dd|d| } t | t|| | f||fdtdtd|dd|ddgdgd} |t| |} | | S)aOBuild a Segment Anything Model (SAM) with specified encoder parameters. Args: encoder_embed_dim (int | list[int]): Embedding dimension for the encoder. encoder_depth (int | list[int]): Depth of the encoder. encoder_num_heads (int | list[int]): Number of attention heads in the encoder. encoder_global_attn_indexes (list[int] | None): Indexes for global attention in the encoder. checkpoint (str | None, optional): Path to the model checkpoint file. mobile_sam (bool, optional): Whether to build a Mobile-SAM model. Returns: (SAMModel): A Segment Anything Model instance with the specified architecture. Examples: >>> sam = _build_sam(768, 12, 12, [2, 5, 8, 11]) >>> sam = _build_sam([64, 128, 160, 320], [2, 2, 6, 2], [2, 4, 5, 10], None, mobile_sam=True) r5r#r^i)r%r%rNr%g@gFg?)img_sizein_chans num_classes embed_dimsdepths num_heads window_sizes mlp_ratio drop_ratedrop_path_rateuse_checkpointmbconv_expand_ratiolocal_conv_sizelayer_lr_decayrFgư>)epsTrN) depth embed_dimrnru norm_layerrs patch_sizeqkv_bias use_rel_posglobal_attn_indexes window_size out_chans)r~image_embedding_sizeinput_image_size mask_in_chansr>ir?)r} embedding_dimmlp_dimrs)num_multimask_outputs transformertransformer_dimiou_head_depthiou_head_hidden_dim)g33333^@gR]@gRY@)g(\2M@g(\L@gL@) image_encoderprompt_encoder mask_decoder pixel_mean pixel_std) rr rtorchnn LayerNormrr rrreval) r*r+r,r-rrHprompt_embed_dim image_sizevit_patch_sizerrsams rr/r/s|2JN%7$ ! ( '& #    "'ux1t<<<'% ;&    %B #$&"68L!M(*5    !"#).  - #    -,,)))+   C.sJ//HHJJJ Jr3r!rer>r$rjr%r%ric  tt||||||td|ddgdd}tdd d t } t d } |duod|v} t d5id|d| d| dddddddddd dd dd dd dd d d d!d d"d d#d d$d d%d d&d d'd d(d)d*dd+d d,d-d.| d/| d0| d1td d2d34} |t| |} | | S)6a`Build and return a Segment Anything Model 2 (SAM2) with specified architecture parameters. Args: encoder_embed_dim (int, optional): Embedding dimension for the encoder. encoder_stages (list[int], optional): Number of blocks in each stage of the encoder. encoder_num_heads (int, optional): Number of attention heads in the encoder. encoder_global_att_blocks (list[int], optional): Indices of global attention blocks in the encoder. encoder_backbone_channel_list (list[int], optional): Channel dimensions for each level of the encoder backbone. encoder_window_spatial_size (list[int], optional): Spatial size of the window for position embeddings. encoder_window_spec (list[int], optional): Window specifications for each stage of the encoder. checkpoint (str | None, optional): Path to the checkpoint file for loading pre-trained weights. Returns: (SAM2Model): A configured and initialized SAM2 model. Examples: >>> sam2_model = _build_sam2(encoder_embed_dim=96, encoder_stages=[1, 2, 7, 2]) >>> sam2_model.eval() )r~rsstagesglobal_att_blocks!window_pos_embed_bkg_spatial_size window_specrmr>r^nearest)d_modelbackbone_channel_listfpn_top_down_levelsfpn_interp_modelr)trunkneckscalpTrF)rpos_enc_at_input num_layerslayerrB)out_dimNzsam2.1rmemory_attentionmemory_encoder num_maskmemr%rr5sigmoid_scale_for_mem_encg4@sigmoid_bias_for_mem_encg$$use_mask_input_as_output_without_samdirectly_add_no_mem_embeduse_high_res_features_in_sammultimask_output_in_samiou_prediction_use_sigmoiduse_obj_ptrs_in_encoderadd_tpos_enc_to_obj_ptrs"only_obj_ptrs_in_the_past_for_evalpred_obj_scorespred_obj_scores_mlpfixed_no_obj_ptrmultimask_output_for_trackinguse_multimask_token_for_obj_ptrmultimask_min_pt_numrmultimask_max_pt_numuse_mlp_for_obj_ptr_projcompile_image_encoderFno_obj_embed_spatialproj_tpos_enc_in_obj_ptrsuse_signed_tpos_enc_to_obj_ptrssam_mask_decoder_extra_argsg?g\(\?)dynamic_multimask_via_stability!dynamic_multimask_stability_delta"dynamic_multimask_stability_thresh) r r rrrr rrrr) r*rRr,rSrUrarTrrrr is_sam2_1sam2s rrWrWsP:!''!7.I+    "?!"A&    M"'sTVW_s_u_uvvv"2...N$&A8z+AI ! ! ! #m! ))! &~! A !  4 !  #'$ ! "'! .2T! #'$! &*T! !%! $(4! !%! "&! ,04!  !! "!D#! $%! &'+d'! ()-)! *Q+! ,Q-! ."&/! 0$e1! 2'Y3! 4#,)5! 6)2 7! 8%),0.2/3% % % % 9! DFj11IIKKK Kr3) zsam_h.ptzsam_l.ptsam_b.ptz mobile_sam.ptz sam2_t.ptz sam2_s.ptz sam2_b.ptz sam2_l.ptz sam2.1_t.ptz sam2.1_s.ptz sam2.1_b.ptz sam2.1_l.ptrc*d}t|}tD]1}||rt|}2|s+t |dt||S)aBuild and return a Segment Anything Model (SAM) based on the provided checkpoint. Args: ckpt (str | Path, optional): Path to the checkpoint file or name of a pre-defined SAM model. Returns: (SAMModel | SAM2Model): A configured and initialized SAM or SAM2 model instance. Raises: FileNotFoundError: If the provided checkpoint is not a supported SAM model. Examples: >>> sam_model = build_sam("sam_b.pt") >>> sam_model = build_sam("path/to/custom_checkpoint.pt") Notes: Supported pre-defined models include: - SAM: 'sam_h.pt', 'sam_l.pt', 'sam_b.pt', 'mobile_sam.pt' - SAM2: 'sam2_t.pt', 'sam2_s.pt', 'sam2_b.pt', 'sam2_l.pt' Nz7 is not a supported SAM model. Available models are: )str sam_model_mapkeysendswithgetFileNotFoundError)ckpt model_builderks r build_samrOs*M t99D    ! !11 ==   1)--a00M y4 w wanasasauau w wxxx =  r3)N)NF)r!rer>r$rjrriN)r)' functoolsrrultralytics.utils.downloadsrultralytics.utils.patchesrmodules.decodersrmodules.encodersrr r r r r modules.memory_attentionrr modules.samrrmodules.tiny_encoderrmodules.transformerrrr1r:r@rIrXr[rbrkr/rWrrrr3rrs/ >>>>>>000000))))))iiiiiiiiiiiiiiiiKKKKKKKK,,,,,,,,))))))222222                       $ XXXXx -"7 &%XXXXx %   r3