§ ’j«ãóD—dZddlZddlmZGd„dej¦«ZdS)zActivation modules.éNcóJ‡—eZdZdZddˆfd„ Zdejdejfd„ZˆxZS) ÚAGLUaFUnified activation function module from AGLU. This class implements a parameterized activation function with learnable parameters lambda and kappa, based on the AGLU (Adaptive Gated Linear Unit) approach. Attributes: act (nn.Softplus): Softplus activation function with negative beta. lambd (nn.Parameter): Learnable lambda parameter initialized with uniform distribution. kappa (nn.Parameter): Learnable kappa parameter initialized with uniform distribution. Methods: forward: Compute the forward pass of the Unified activation function. Examples: >>> import torch >>> m = AGLU() >>> input = torch.randn(2) >>> output = m(input) >>> print(output.shape) torch.Size([2]) References: https://github.com/kostas1515/AGLU NÚreturnc 󨕗t¦« ¦«tjd¬¦«|_tjtj tj d||¬¦«¦«¦«|_ tjtj tj d||¬¦«¦«¦«|_ dS)zEInitialize the Unified activation function with learnable parameters.gð¿)Úbetaé)ÚdeviceÚdtypeN) ÚsuperÚ__init__ÚnnÚSoftplusÚactÚ ParameterÚinitÚuniform_ÚtorchÚemptyÚlambdÚkappa)Úselfr r Ú __class__s €úf/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/ultralytics/nn/modules/activation.pyr z AGLU.__init__"s—ø€å ‰Œ×ÒÑÔÐÝ”; DÐ)Ñ)Ô)ˆŒÝ”\¥"¤'×"2Ò"2µ5´;¸qÈÐW\Ð3]Ñ3]Ô3]Ñ"^Ô"^Ñ_Ô_ˆŒ Ý”\¥"¤'×"2Ò"2µ5´;¸qÈÐW\Ð3]Ñ3]Ô3]Ñ"^Ô"^Ñ_Ô_ˆŒ ˆ ˆ óÚxc óÌ—tj|jd¬¦«}tjd|z | |j|ztj|¦«z ¦«z¦«S)a Apply the Adaptive Gated Linear Unit (AGLU) activation function. This forward method implements the AGLU activation function with learnable parameters lambda and kappa. The function applies a transformation that adaptively combines linear and non-linear components. Args: x (torch.Tensor): Input tensor to apply the activation function to. Returns: (torch.Tensor): Output tensor after applying the AGLU activation function, with the same shape as the input. g-Cëâ6?)Úminr)rÚclamprÚexprrÚlog)rrÚlams rÚforwardz AGLU.forward)sR€õŒk˜$œ*¨&Ð1Ñ1Ô1ˆÝŒy˜!˜c™' T§X¢X¨t¬z¸A©~ÅÄÈ3ÁÄÑ.OÑ%PÔ%PÑPÑQÔQÐQr)NN)rN) Ú__name__Ú __module__Ú __qualname__Ú__doc__r rÚTensorr"Ú __classcell__)rs@rrrsƒø€€€€€ððð2`ð`ð`ð`ð`ð`ð`ð R˜œð R¨%¬,ð Rð Rð Rð Rð Rð Rð Rð Rrr)r&rÚtorch.nnr ÚModuler©rrúr,sfðàÐà € € € ØÐÐÐÐÐð.Rð.Rð.Rð.Rð.Rˆ2Œ9ñ.Rô.Rð.Rð.Rð.Rr