jgddlZddlZddlmZddlmZddlmZmZm Z m Z m Z m Z m Z mZmZmZmZmZdZdZdZdedejfd Zdedejfd Zdedejfd Zdejjjfd Zd ZdZdZ dZ!dZ"dZ#dZ$dS)N)_ConvNd) calculate_adaptive_avgcalculate_avgpoolcalculate_convcalculate_conv2d_flopscalculate_linearcalculate_normcalculate_parameterscalculate_relucalculate_relu_flopscalculate_softmaxcalculate_upsamplecalculate_zero_opsc\t|d|jd<dS)zWCalculate and return the total number of learnable parameters in a given PyTorch model.F)recurserN)r parameters total_paramsmxys \/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/thop/vision/basic_hooks.pycount_parametersrs*,Q\\%\-H-HIIAN1c>|xjtz c_dS)zHIncrementally add zero operations to the model's total operations count.N) total_opsrrs rzero_opsr sKK%'''KKKKrrrc |d}|xjtt|jt|jt|jj|j|jdz c_dS)mCalculate and add the number of convolutional operations (FLOPs) for a ConvNd layer to the model's total ops.rF input_size output_size kernel_sizegroupsbias transposeNrrlistshapeweightr%r&rs r count_convNdr,%sc !AKK)==MM((x V KKKKrc |d}|xjtt|jt|jt|jj|j|jdz c_dS)r rTr!Nr(rs r count_convtNdr.;sc !AKK)==MM((x V KKKKrcj|d}tj|dd|ddz}|xjt |j|j|z c_dS)z]Calculates and updates total operations (FLOPs) for a convolutional layer in a PyTorch model.rNr) torchzerossizenumelrrr&nelementr+)rrrr#s rcount_convNd_ver2r6Is !A+affhhrrlQVVXXabb\9::@@BBKKK>!&//"3"3QX5F5F5H5H+VVVKKKKrc|d}t|}t|ddst|ddr|dz}|xj|z c_dS)ziCalculate and add the FLOPs for a batch normalization layer, including elementwise and affine operations.raffineFelementwise_affiner0N)r r4getattrr)rrrflopss rcount_normalizationr<Ysg !A 17799 % %Eq(E""ga1Eu&M&M  KK5KKKKrc|d}|}|js|xjt|z c_dSdS)z]Calculate and update the total operation counts for a PReLU layer using input element number.rN)r4trainingrr )rrr nelementss r count_prelur@osH !A I :1 ~i000 11rct|d}|xjtt|jz c_dS)zACalculate and update the total operation counts for a ReLU layer.rN)rr r)r*rs r count_relurBxs0 !AKK'QW 666KKKKrc|d}||j}||z}|xjt ||z c_dS)zWCalculate and update the total operation counts for a Softmax layer in a PyTorch model.rN)r3dimr4rr )rrr nfeatures batch_sizes r count_softmaxrG~sO !AIi'JKK$Z;;;KKKKrch|}|xjt|z c_dS)znCalculate and update the total number of operations (FLOPs) for an AvgPool layer based on the output elements.N)r4rr)rrr num_elementss r count_avgpoolrJs.7799LKK$\222KKKKrc Ltjtjg|djddtjg|jdd}tj|}|}|xjt||z c_dS)zmCalculate and update the total operation counts for an AdaptiveAvgPool layer using kernel and element counts.rr0N)r1div DoubleTensorr*prodr4rr)rrrkernel total_addrIs rcount_adap_avgpoolrQs Yu)*=QqTZ^*=>>@RScVWV]^_^`^`VaSc@d@d e eF 6""I7799LKK))\BBBKKKKrc|jdvr/tjd|jd|xjdz c_dS|d}|xjt |j|z c_dS)zMUpdate total operations counter for upsampling layers based on the mode used.)nearestlinearbilinearbicubic trilinearzmode z* is not implemented yet, take it a zero oprN)modeloggingwarningrrr5rs rcount_upsampler[s|v RRRRSSS q aD )!&!**,,??? rcx|j}|}|xjt||z c_dS)zWCounts total operations for nn.Linear layers using input and output element dimensions.N) in_featuresr4rr)rrr total_mulrIs r count_linearr_s7 I7799LKK#I|<<rjs ))))))                             JJJ ((( G 5<    , W EL     W W W W W W 2:/:    ,111777 <<<333CCC @ @ @"=====r