ajEXddlZddlZddlZddlmZddlZddlZddlm Z ddl m Z m Z m Z ddlmZddlmZddlmZddlmZdd lmZd d lmZd d lmZmZgd ZejeZ de!de"fdZ#de"de!fdZ$dej%de&e"fdZ'dej%de&e!fdZ(dej%de&efdZ)iej*dde'fej+dde'fej,dde'fej-dde)fej!dde)fej.dde)fej/dde)fej0dde)fej1d de)fej2d de)fej3d!de)fej4d!de)fej"d"de)fej5d"de)fej6d"de)fej7d#d$e)fej8d%d&e(fej9d%d&e(fej:d'd&e(fej;d'd&e(fej<d(d)e)fej=d*d+e(fej>d*d+e(fej1d d,e)fej?d d,e)fej@d d,e)fi ZAde"fd-ZB dLd0ZCdMd1ZDdNd3ZEd4ZFd5ZGdOd6ZHdOd7ZIdPd9ZJ dQd;ZKdOd<ZLdRd=ZMdSd?ZNd@ZOdTdBZPdCZQdDZR dUdFZSdUdGZTdVdHZUdIZVdJZW dVdKZXdS)WN)Any) struct_pb2)HistogramProtoSummarySummaryMetadata) TensorProto)TensorShapeProto) layout_pb2)PrCurvePluginData)TextPluginData)make_np)_prepare_videoconvert_to_HWC) half_to_int int_to_halfhparamsscalar histogram_raw histogrammake_histogramimage image_boxes draw_boxes make_imagevideo make_videoaudiocustom_scalarstext tensor_proto pr_curve_rawpr_curve compute_curvemeshfreturncbtjd|}tjd|dS)aACasts a half-precision float value into an integer. Converts a half precision floating point value, such as `torch.half` or `torch.bfloat16`, into an integer value which can be written into the half_val field of a TensorProto for storage. To undo the effects of this conversion, use int_to_half(). r&irstructpackunpack)r&bufs d/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/torch/utils/tensorboard/summary.pyrr6s, +c1  C =c " "1 %%r)cbtjd|}tjd|dS)zCasts an integer value to a half-precision float. Converts an integer value obtained from half_to_int back into a floating point value. r)r&rr*)r)r.s r/rrCs, +c1  C =c " "1 %%r0tcbd|DS)Nc,g|]}t|S)r.0xs r/ z'_tensor_to_half_val..Ns 9 9 9qKNN 9 9 9r0flattentolistr2s r/_tensor_to_half_valr>Ms* 9 9AIIKK$6$6$8$8 9 9 99r0crtj|SN)torch view_as_realr;r<r=s r/_tensor_to_complex_valrCPs+  a ( ( * * 1 1 3 33r0cN|Sr@r:r=s r/_tensor_to_listrESs 99;;    r0DT_HALFhalf_val DT_BFLOAT16DT_FLOAT float_val DT_DOUBLE double_valDT_INT8int_valDT_UINT8DT_INT16DT_INT32DT_INT64 int64_val DT_COMPLEX32 scomplex_val DT_COMPLEX64DT_BOOLbool_val DT_COMPLEX128 dcomplex_val uint32_valct|tjs|n|}|jtjkrdndS)Nr ) isinstancenpndarraynumpydtypeuint8)tensor converteds r/_calc_scale_factorrfus<&0&D&DP &I28++114r0blackc ddlm} m} | } | |} ||||f\} }}}| | |f| |f||f||f| |fg|||r|}| |\}}}}||z ||z }}tjd|z}| | ||z d|zz f| |z|fg|| | |z||z |z f||| |S)Nr) ImageDraw ImageFont)widthfillg?rh)rm)rmfont) PILrjrk load_defaultDrawlinegetbboxr_ceil rectangler )rxminyminxmaxymax display_strcolor color_text thicknessrjrkrndrawleftrighttopbottom text_bottom_left_top_right_bottom text_width text_heightmargins r/_draw_single_boxrzsq)(((((((  ! ! # #D >>% D"&dD!9T5#vII tVnufos|dC[Q    '+||K'@'@$tVW"(5.'D.K  +,, {[01v:=> "K0      F]K+5> ?     Lr0c  ddl}ddlm}m}m}mmm}ddlm }m } m } m } m } ddlm} m}m}t%t&s)t(dt-dt%|t&s)t(dt-d|pi}t%|t&st-d|D]P\}vs1t%|t0rt3fd |Dst-d d d Qg}|}D](\}| t%|t4t6frs||j_|vr&t=jd |D}nd}| ||!d|t%|tDrt||j_#|vr&t=jd|D}nd}| ||!d|!t%|tHrt||j_%|vr&t=jd|D}nd}| ||!d|t%||j&r\tO|d}||j_| ||!dtQd| || }tStSj*| |+}tYtYj!| |g}fd|D}|||}| || }tStSj*| |+}tYtYj!||g}||!d }| || !}tStSj*| |+}tYtYj!| |g}|||fS)"a2Output three `Summary` protocol buffers needed by hparams plugin. `Experiment` keeps the metadata of an experiment, such as the name of the hyperparameters and the name of the metrics. `SessionStartInfo` keeps key-value pairs of the hyperparameters `SessionEndInfo` describes status of the experiment e.g. STATUS_SUCCESS Args: hparam_dict: A dictionary that contains names of the hyperparameters and their values. metric_dict: A dictionary that contains names of the metrics and their values. hparam_domain_discrete: (Optional[Dict[str, List[Any]]]) A dictionary that contains names of the hyperparameters and all discrete values they can hold Returns: The `Summary` protobufs for Experiment, SessionStartInfo and SessionEndInfo rN)DataType Experiment HParamInfo MetricInfo MetricNameStatus)EXPERIMENT_TAGPLUGIN_DATA_VERSION PLUGIN_NAMESESSION_END_INFO_TAGSESSION_START_INFO_TAG)HParamsPluginDataSessionEndInfoSessionStartInfoz>parameter: hparam_dict should be a dictionary, nothing logged.z>parameter: metric_dict should be a dictionary, nothing logged.zIparameter: hparam_domain_discrete should be a dictionary, nothing logged.c3^K|]'}t|tV(dSr@)r^type)r7d hparam_dictks r/ zhparams..s9FFqz!T+a.%9%9::FFFFFFr0z"parameter: hparam_domain_discrete[z/] should be a list of same type as hparam_dict[z].c8g|]}tj|S)) number_valuerValuer7rs r/r9zhparams..6#(a888r0)valuesDATA_TYPE_FLOAT64)namerdomain_discretec8g|]}tj|S)) string_valuerrs r/r9zhparams..rr0DATA_TYPE_STRINGc8g|]}tj|S)) bool_valuerrs r/r9zhparams..*s6#(A666r0DATA_TYPE_BOOL)rrz=value should be one of int, float, str, bool, or torch.Tensor)session_start_infoversion plugin_namecontent plugin_data)tagmetadatavaluec<g|]}|S)r)rr5)r7rrrs r/r9zhparams..Ps3 C C C!::::!,,, - - - C C Cr0) hparam_infos metric_infos) experimentrSTATUS_SUCCESS)status)session_end_infor)-rA#tensorboard.plugins.hparams.api_pb2rrrrrr$tensorboard.plugins.hparams.metadatarrrrr+tensorboard.plugins.hparams.plugin_data_pb2rrrr^dictloggerwarning TypeErroritemslistallintfloatrrr ListValueappendrstrrboolrTensorr ValueErrorr PluginDataSerializeToStringr)r metric_dicthparam_domain_discreterArrrrrrrrrrrrvhpsssirrsmdmtsexpseirrrs` @@@r/rrs(LLL k4 ( ( WXXX L    k4 ( ( WXXX L   49r ,d 3 3  W   ',,..1 [ a&& !FFFFFAFFFFF !lQllghlll  ! C    C!!##P P 1 9  a#u & & *+CKN '***?I?S!7!:@@@#' JJ !(;<<$3      a   *+CKN '***","6!7!:####' JJ !(:;;$3      a   ()CKN %***","6!7!:####' JJ !(899$3      a & &  1 A*+CKN ' JJzzqx~~>Q/R/RSSS T T T  K    3@STTTG #.#W-F-F-H-H      C +ACPPPQ R R RC C C C C C{ C C CC *#C 8 8 8C38KLLLG #.#W-F-F-H-H      C >CHHHI J J JC . -= > > ? ? ?C>QRRRG #.#W-F-F-H-H      C +?#NNNO P P PC S=r0Fct|}|jdkr td|jd|jdt |}|rqt |gd}|rt |gd}tjd }t| }ttj ||| g Sttj ||g S)aOutput a `Summary` protocol buffer containing a single scalar value. The generated Summary has a Tensor.proto containing the input Tensor. Args: name: A name for the generated node. Will also serve as the series name in TensorBoard. tensor: A real numeric Tensor containing a single value. collections: Optional list of graph collections keys. The new summary op is added to these collections. Defaults to `[GraphKeys.SUMMARIES]`. new_style: Whether to use new style (tensor field) or old style (simple_value field). New style could lead to faster data loading. Returns: A scalar `Tensor` of type `string`. Which contains a `Summary` protobuf. Raises: ValueError: If tensor has the wrong shape or type. rzNTensor should contain one element (0 dimensions). Was given size: z and z dimensions.rI)rJrbrK)rLrbscalarsrrrrdrr)r simple_value) rsqueezendimAssertionErrorsizerrrrrr) rrd collections new_styledouble_precisionrr!rrs r/rrms7"V__ $ $ & &F {aI#[II/5{IIIJJ J6]]FM"fXZHHH  O&6(+NNNL&0YGGG +666 '     gm6JJJKLLLLr0c ||jzdkrtd|jtvrOt|j\}}}t d id|dt d|jD|||i}nt|d|jtj d }t| }ttj ||| g S)aOutputs a `Summary` protocol buffer containing the full tensor. The generated Summary has a Tensor.proto containing the input Tensor. Args: tag: A name for the generated node. Will also serve as the series name in TensorBoard. tensor: Tensor to be converted to protobuf Returns: A tensor protobuf in a `Summary` protobuf. Raises: ValueError: If tensor is too big to be converted to protobuf, or tensor data type is not supported lzAtensor is bigger than protocol buffer's hard limit of 2GB in sizerb tensor_shapec8g|]}tj|S)r)r Dimr6s r/r9z tensor_proto..s'LLL!)-1555LLLr0dimz has unsupported tensor dtype rdrrrrrdrr5) numelitemsizerrb_TENSOR_TYPE_MAPrr shaperrrr)rrdrb field_name conversion_fnr!rrs r/r!r!s||~~'G44 O   |'''+;FL+I(z="    0LLv|LLL!!!MM&11    CMMv|MMNNN",BBBK k 2 2 2C '-C#lSSST U U UUr0c xt|||||||}ttj||gS)aOutput a `Summary` protocol buffer with a histogram. The generated [`Summary`](https://www.tensorflow.org/code/tensorflow/core/framework/summary.proto) has one summary value containing a histogram for `values`. Args: name: A name for the generated node. Will also serve as a series name in TensorBoard. min: A float or int min value max: A float or int max value num: Int number of values sum: Float or int sum of all values sum_squares: Float or int sum of squares for all values bucket_limits: A numeric `Tensor` with upper value per bucket bucket_counts: A numeric `Tensor` with number of values per bucket Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. minmaxnumsum sum_squares bucket_limitbucketrhistor)rrr) rrrrrr bucket_limits bucket_countshists r/rrsR*     "   D '-D===> ? ? ??r0ct|}t|t||}t t j||gS)adOutput a `Summary` protocol buffer with a histogram. The generated [`Summary`](https://www.tensorflow.org/code/tensorflow/core/framework/summary.proto) has one summary value containing a histogram for `values`. This op reports an `InvalidArgument` error if any value is not finite. Args: name: A name for the generated node. Will also serve as a series name in TensorBoard. values: A real numeric `Tensor`. Any shape. Values to use to build the histogram. Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. rr)rrastyperrr)rrbinsmax_binsrs r/rrsO"V__F &--..h ? ?D '-D===> ? ? ??r0c |jdkrtd|d}tj||\}}t |}|||kr||z}||z}|dkrtj|d||z ggdd}|d|d}tj|jd zf|j }|dd||dd<|d|d<|}tj tj |d} tj | d| dd z gd \} } t| } t| d z} ~ | dkr || d z | ntjdg|d| g}|| | d z}|jdks |jdkrtd ||} t!||t ||| || S)zDConvert values into a histogram proto using logic from histogram.cc.rzThe input has no element.)r Nconstant) pad_widthmodeconstant_values)axisr r)sidez1The histogram is empty, please file a bug report.r)rrreshaper_rlenpadremptyrbcumsumgreater searchsortedr concatenatedotrrrr<) rr r countslimitsnum_bins subsamplingsubsampling_remainder new_limits cum_countsstartendsum_sqs r/rrsd {a4555 ^^B  F\&t444NFF6{{H8 3 3(* (; 6 A % %V{-BBCD ! F K0044"4==Xv{Q0&,??  "[1 3B3 22:fa0011JaB!1C-D7SSSJE3 JJE c((Q,C$)199uqy3".1#vdsd|AT2U2U EC!GO $F {a6;!++LMMM ZZ  F  JJLL JJLL KK JJLL]]__}}   r0NCHWctt|}t||}t|}|tj}||zddtj}t||}ttj ||gS)aJOutput a `Summary` protocol buffer with images. The summary has up to `max_images` summary values containing images. The images are built from `tensor` which must be 3-D with shape `[height, width, channels]` and where `channels` can be: * 1: `tensor` is interpreted as Grayscale. * 3: `tensor` is interpreted as RGB. * 4: `tensor` is interpreted as RGBA. The `name` in the outputted Summary.Value protobufs is generated based on the name, with a suffix depending on the max_outputs setting: * If `max_outputs` is 1, the summary value tag is '*name*/image'. * If `max_outputs` is greater than 1, the summary value tags are generated sequentially as '*name*/image/0', '*name*/image/1', etc. Args: tag: A name for the generated node. Will also serve as a series name in TensorBoard. tensor: A 3-D `uint8` or `float32` `Tensor` of shape `[height, width, channels]` where `channels` is 1, 3, or 4. 'tensor' can either have values in [0, 1] (float32) or [0, 255] (uint8). The image() function will scale the image values to [0, 255] by applying a scale factor of either 1 (uint8) or 255 (float32). Out-of-range values will be clipped. Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. rr])rescalerrr) rrrfr r_float32cliprcrrr)rrdr* dataformats scale_factorrs r/rr4s6V__F FK 0 0F%f--L ]]2: & &F|# ) )!S 1 1 8 8 B BF vw / / /E '-Cu===> ? ? ??r0CHWct|}t||}t|}|tjt |z}t |ddtj|||}ttj ||gS)z/Output a `Summary` protocol buffer with images.rr])r*roislabelsr+r) rrr r_r,rfrr-rcrr)r tensor_image tensor_boxesr*r.r3rs r/rrZs<((L!, < ? ? ??r0c |jd}t|}|D]B}t|||df||df||df||df|dn||d}C|S)Nrr rhRed)rzr{)rranger) disp_imageboxesr3 num_boxeslist_gtr)s r/rrls AIIG    %  !Q$K !Q$K !Q$K !Q$K &F1I    r0cddlm}|j\}}}t||z}t||z} ||} |t | ||} |jj} | | |f| } ddl } | } | | d| }| tj||||S)z=Convert a numpy representation of an image to Image protobuf.r)ImageN)r3PNG)formatheightrl colorspaceencoded_image_string)ror?rr fromarrayr ResamplingLANCZOSresizeioBytesIOsavegetvaluecloser)rdr*r2r3r?rCrlchannel scaled_height scaled_widthr ANTIALIASrJoutput image_strings r/rr}s#\FE7())Muw''L OOF # #E 5$v666 (I LL, 6 B BE III ZZ\\F JJveJ$$$??$$L LLNNN =)    r0cpt|}t|}t|}|tj}||zddtj}t||}ttj ||gS)Nrr]r+r) rrrfr r_r,r-rcrrr)rrdfpsr/rs r/rrs V__F F # #F%f--L ]]2: & &F|# ) )!S 1 1 8 8 B BF vs # #E '-Cu===> ? ? ??r0c ddl}n #t$rtdYdSwxYw ddlm}n!#t$rtddYdSwxYwddl}|j\}}}}|t||} |d5} | j } | | d d nQ#t$rD | | d d n'#t$r| | d YnwxYwYnwxYw| d| } tj|||| cdddS#1swxYwYdS)Nrzadd_video needs package moviepy)editorz6moviepy is installed, but can't import moviepy.editor.z2Some packages could be missing [imageio, requests])rWz.gif)suffixF)verboser)r[ progress_bar)r[rB)moviepy ImportErrorprintrYtempfilerImageSequenceCliprNamedTemporaryFiler write_gifrseekreadrr?) rdrWr]mpyr`_thwcr-r&filename tensor_strings r/rrs#  /000)))))))  D @      OOO,KB1a  f3 7 7D  $ $F $ 3 3 q6 8 NN8U4N @ @ @ @ 8 8 8 8xUKKKK 8 8 8x77777 8 8 q  }A!-                     sv$$/A  A E#B<;E< D C D  !DD DD E D  AEE!EDct|}|}t|dkr%t d|dd}|jdkrtd|tj tj jz d}ddl }ddl }|}||d5}|d|d||||jdddn #1swxYwY|}|t/j|d|jd|d } t/t/j|| g S) Nr z4warning: audio amplitude out of range, auto clipped.rz%input tensor should be 1 dimensional.z>LIIKKK Mk"o)    E '-Cu===> ? ? ??s3AEE Ec g}|D] \}}g}|D]\}}|d}|ddkrt|dkrtdtjtj|d|d|dg}tj|| } n+tj| } tj|| } || |tj || "tj | }tj d} t| } td|gt} t!t!jd| | gS)Nr rMarginr7zlen(tags) != 3rh)rlowerupper)series)titlerr)r multiline)rchart)categoryrrr DT_STRINGrb string_valrcustom_scalars__config__rr)rrrr MarginChartContentSeriesChartMultilineChartContentrCategoryLayoutrrrrr rr)layout categoriesrrcharts chart_namechart_metadatatagsmgccrmlccrrrds r/rrsJ FF1*+'')) ! ! &J!!$Da H,,t99>>()9:::!4#5<<"&q'aQ=#(z$GGG!7DAAA"(zTJJJ MM% *-AVDDDEEEE   3 3 3F!,9IJJJK k 2 2 2C ,,../%''F  M8RU V V V    r0c rtjdtd}t|}t d|dgt t jd g  }ttj |d z||gS)Nr r)rrrrutf_8)encodingr rrrz /text_summaryrr) rrr rrencoder rrr)rr rrrds r/r r s!,N1$=$=$=$O$O$Q$QK k 2 2 2C KKK112%+;+?Q+G+G+G*HIII F }!6VTTTU   r0c *|dkrd}tj||||||f} td|} t jd| } t | } t d| dttj | j d tj | j d  g  } ttj || | gS)Nrrrnum_thresholds pr_curvesrrrIrrr rrbrJrrr)r_stackr rrrrrr<r rrrr)rtpfptnfn precisionrecallrweightsr~pr_curve_plugin_datarrrds r/r"r")s) 8RRY7 8 8D,.",)=K k 2 2 2C ,,r""))++%!$$*Q-888 $$*Q-888       F '-C#fMMMN O O OOr0c ,t|d}t||||}td|}t jd|}t |}t d|d ttj |j d tj |j d  g  } ttj ||| gS)Nr)rrrrrrrrIrrr rrrr)rr$r rrrrrr<r rrrr) rr3 predictionsrrr~rrrrds r/r#r#Gs)--N  NG   D-.",)=K k 2 2 2C ,,r""))++%!$$*Q-888 $$*Q-888       F '-C#fMMMN O O OOr0cd}|d}tjtj||dz z}|tj}d|dz f}tj|||||z\}} tj|||d|z |z\} } tj|dddddd} tj| dddddd} | d| z } | d| z }| tj|| | zz }| tj|| |zz }tj| | | |||fS)NgHz>g?r r)r r9rr) r_int32floorr float64rrmaximumr)r3rrr_MINIMUM_COUNTbucket_indices float_labelshistogram_range tp_buckets_ fp_bucketsrrrrrrs r/r$r$fslNXbh{nq6H'IJJKKN==,,L.1,-OL w& MJL |#w. MJ :ddd# $ $TTrT *B :ddd# $ $TTrT *B AB ABRZR888I "*^R"W55 5F 8RRY7 8 88r0c ddl}ddlm}|j|}||||||j||} t d|dttj |jdtj |jdtj |jd g  }tj | |||| } | S) aCreate a tensor summary with summary metadata. Args: name: Uniquely identifiable name of the summary op. Could be replaced by combination of name and type to make it unique even outside of this summary. display_name: Will be used as the display name in TensorBoard. Defaults to `name`. description: A longform readable description of the summary data. Markdown is supported. tensor: Tensor to display in summary. content_type: Type of content inside the Tensor. components: Bitmask representing present parts (vertices, colors, etc.) that belong to the summary. json_config: A string, JSON-serialized dictionary of ThreeJS classes configuration. Returns: Tensor summary with metadata. rNr) json_configrIrrr rhrrr)rAtensorboard.plugins.meshr as_tensorcreate_summary_metadatarrrr<r rrrget_instance_name) r display_name descriptionrdrt componentsrrArtensor_metadatatensor_summarys r/_get_tensor_summaryrs,.LLL111111 U_V $ $F66  7O..$$++--%!$&,q/::: $&,q/::: $&,q/:::        F ]  & &t\ : : N r0c:d}|tj|d}|S)z5Parse and returns JSON string from python dictionary.z{}NT) sort_keys)jsondumps) config_dictrs r/_get_json_configrs'Kj=== r0c Fddlm}ddlm}t |} g} ||jf||jf||jfg} d| D} |d| D} | D]-\} }| t|||| || | .t| S)a'Output a merged `Summary` protocol buffer with a mesh/point cloud. Args: tag: A name for this summary operation. vertices: Tensor of shape `[dim_1, ..., dim_n, 3]` representing the 3D coordinates of vertices. faces: Tensor of shape `[dim_1, ..., dim_n, 3]` containing indices of vertices within each triangle. colors: Tensor of shape `[dim_1, ..., dim_n, 3]` containing colors for each vertex. display_name: If set, will be used as the display name in TensorBoard. Defaults to `name`. description: A longform readable description of the summary data. Markdown is supported. config_dict: Dictionary with ThreeJS classes names and configuration. Returns: Merged summary for mesh/point cloud representation. rr)MeshPluginDatac"g|] }|d | S)rr5)r7rds r/r9zmesh..s!EEE&vay/Dv/D/D/Dr0cg|]\}}|Sr5r5)r7rdrts r/r9zmesh..s<<<06<<<() #$ %& GFEGEEEG00<rCrEhalffloat16bfloat16r,rdoubleint8rcqint8rwshortrqint32int64 complex32chalf complex64cfloatr complex128cdoublequint8quint4x2rrfrrrr!rrrrrrrrrrrr r"r#r$rrr%r5r0r/rs   '&&&&& <;;;;;FFFFFF888888JJJJJJCCCCCC 22222222   0  8 $ $ &5 &S & & & &&3&5&&&&:5<:DI::::4el4tE{4444 u| S      JJ(;< MIz+>? N]J0CD MJ _=   K*k?;   MK?  L; o> JI7 K*i9 K*i9 K*i9 K*i9 I I7 K*i9 L:y/:  K*k?;!" Onn6LM#$ K..2HI Onn6LM L>>3IJ JJ8 8NO MO^5KL K*lO< L:|_= NZ?5<5#5555 ((((VEEEEP+M+M+M+M\%V%V%VP@@@D@@@@.5555p#@#@#@#@NKO@@@@$"6 @ @ @ @% % % P@@@@D&&&R&IMPPPP<PPPP>"9"9"9"9J<<<~OS6$6$6$6$6$6$r0