jgddlZddlmZddlmZddZdejdejdejfdZdd Z dej dejdejfd Z dd Z dej dejdejfd Zdejfd ZdejfdZdejfdZdS)N)PackedSequenceTc0|||zz|z}|r||dzz }|S)z`Calculate the total operations for an RNN cell given input size, hidden size, and optional bias.) input_size hidden_sizebias total_opss S/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/thop/rnn_hooks.py_count_rnn_cellr s2zK78;FI %[1_$ mxyct|j|j|j}|dd}||z}|xjt jt|gz c_dS)z^Counts the total RNN cell operations based on input tensor, hidden size, bias, and batch size.rN) r rrr sizer torch DoubleTensorintrrrr batch_sizes r count_rnn_cellr^ amQVDDI11J IKK5%s9~~&6777KKKKr cd}||z|z|z}|r||dzz }||dzz }|||z|z|zz }|r||dzz }||z }||dzz }|S)zdCounts the total operations for a GRU cell based on input size, hidden size, and bias configuration.rrrrrr r state_opss r _count_gru_cellrsIz)[8;FI %[1_$  QI+ *k9KGGI %[1_$  Iq I r ct|j|j|j}|dd}||z}|xjt jt|gz c_dS)z\Calculates and updates the total operations for a GRU cell in a mini-batch during inference.rN) rrrr rr rrrrs r count_gru_cellr 3rr c^d}||z|z|z}|r||dzz }||dzz }||dzz }||z }|S)zfCounts LSTM cell operations during inference based on input size, hidden size, and bias configuration.rrrrrs r _count_lstm_cellr#=scI k)[8;FI %[1_$  QIq II r ct|j|j|j}|dd}||z}|xjt jt|gz c_dS)zZCounts and updates the total operations for an LSTM cell in a mini-batch during inference.rN) r#rrr rr rrrrs r count_lstm_cellr%Ts^ q}afEEI11J IKK5%s9~~&6777KKKKr cH|j}|j}|j}|j}t |dt r@t j|dj}|dj d}nt|j r7|d d}|d d}n6|d d}|d d}d} |j r| t|||dzz } n| t|||z } t|dz D]4} | |j rt|dz||dznt|||z } 5| |z} | |z} |xjt jt!| gz c_dS)zWCalculate and update the total number of operations for each RNN cell in a given batch.rrN)r rr num_layers isinstancerrmax batch_sizesr batch_first bidirectionalr ranger rr rrrr rrr(r num_stepsr _s r count_rnnr2^ 6DJ-KJ!A$''!Yqt/00 aD$))!,, !qTYYq\\ aDIIaLL qTYYq\\ aDIIaLL ID_ZdCCaGG _ZdCCC :> " "   AOK!O[$ ? ?! C C k4@@ I IKK5%s9~~&6777KKKKr cH|j}|j}|j}|j}t |dt r@t j|dj}|dj d}nt|j r7|d d}|d d}n6|d d}|d d}d} |j r| t|||dzz } n| t|||z } t|dz D]4} | |j rt|dz||dznt|||z } 5| |z} | |z} |xjt jt!| gz c_dS)zfCalculates total operations for a GRU layer, updating the model's operation count based on batch size.rr'rN)r rrr(r)rrr*r+rr,r-rr.r rrr/s r count_grur5r3r cH|j}|j}|j}|j}t |dt r@t j|dj}|dj d}nt|j r7|d d}|d d}n6|d d}|d d}d} |j r| t|||dzz } n| t|||z } t|dz D]4} | |j rt|dz||dznt|||z } 5| |z} | |z} |xjt jt!| gz c_dS)zgCalculate total operations for LSTM layers, including bidirectional, updating model's total operations.rr'rN)r rrr(r)rrr*r+rr,r-r#r.r rrr/s r count_lstmr7s 6DJ-KJ!A$''!Yqt/00 aD$))!,, !qTYYq\\ aDIIaLL qTYYq\\ aDIIaLL IE%j+tDDqHH %j+tDDD :> " "   B [1_k4 @ @1 D D!+{DAA I IKK5%s9~~&6777KKKKr )T)rtorch.nnnntorch.nn.utils.rnnrr RNNCellTensorrrGRUCellr r#LSTMCellr%RNNr2GRUr5LSTMr7rr r rBs` ------8bj8U\8el888808bj8U\8el8888.8r{8u|8 8888"8"8"8"8"8J"8"8"8"8"8J"8"'"8"8"8"8"8"8r