§ è‘jTãó˜—ddlmZddlmZddlmZddlmZddlm Z ddl m Z erddl m Z mZddlmZmZmZmZmZGd „d ¦«Zd S) é)Ú annotations)Ú TYPE_CHECKING)Úparse_into_expression)Ú scale_bytes)Ú wrap_expr)Úparse_into_datatype_expr)Ú DataTypeExprÚExpr)Ú EndiannessÚIntoExprÚPolarsDataTypeÚSizeUnitÚTransferEncodingcó’—eZdZdZdZd1d„Zd2d „Zd3d „Zd4d„Zddœd5d„Z d6d„Z d7d8d„Z ddœd9d!„Z d:d;d'„Z dd0„Zd"S)?ÚExprBinaryNameSpacez&Namespace for bin related expressions.ÚbinÚexprr ÚreturnÚNonecó—|j|_dS©N)Ú_pyexpr)Úselfrs úW/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/polars/expr/binary.pyÚ__init__zExprBinaryNameSpace.__init__s€Ø”|ˆŒ ˆ ˆ óÚliteralr cór—t|d¬¦«}t|j |¦«¦«S)u€ Check if binaries in Series contain a binary substring. Parameters ---------- literal The binary substring to look for Returns ------- Expr Expression of data type :class:`Boolean`. See Also -------- starts_with : Check if the binary substring exists at the start ends_with : Check if the binary substring exists at the end Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... "lit": [b"\x00", b"\xff\x00", b"\xff\xff"], ... } ... ) >>> colors.select( ... "name", ... pl.col("code").bin.contains(b"\xff").alias("contains_with_lit"), ... pl.col("code").bin.contains(pl.col("lit")).alias("contains_with_expr"), ... ) shape: (3, 3) ┌────────┬───────────────────┬────────────────────┠│ name ┆ contains_with_lit ┆ contains_with_expr │ │ --- ┆ --- ┆ --- │ │ str ┆ bool ┆ bool │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ false ┆ true │ │ yellow ┆ true ┆ true │ │ blue ┆ true ┆ false │ └────────┴───────────────────┴────────────────────┘ T©Ú str_as_lit)rrrÚ bin_contains)rrÚliteral_pyexprs rÚcontainszExprBinaryNameSpace.containss5€õX/¨wÀ4ÐHÑHÔHˆÝ˜œ×2Ò2°>ÑBÔBÑCÔCÐCrÚsuffixcór—t|d¬¦«}t|j |¦«¦«S)uñ Check if string values end with a binary substring. Parameters ---------- suffix Suffix substring. Returns ------- Expr Expression of data type :class:`Boolean`. See Also -------- starts_with : Check if the binary substring exists at the start contains : Check if the binary substring exists anywhere Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... "suffix": [b"\x00", b"\xff\x00", b"\x00\x00"], ... } ... ) >>> colors.select( ... "name", ... pl.col("code").bin.ends_with(b"\xff").alias("ends_with_lit"), ... pl.col("code").bin.ends_with(pl.col("suffix")).alias("ends_with_expr"), ... ) shape: (3, 3) ┌────────┬───────────────┬────────────────┠│ name ┆ ends_with_lit ┆ ends_with_expr │ │ --- ┆ --- ┆ --- │ │ str ┆ bool ┆ bool │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ false ┆ true │ │ yellow ┆ false ┆ true │ │ blue ┆ true ┆ false │ └────────┴───────────────┴────────────────┘ Tr)rrrÚ bin_ends_with)rr$Ú suffix_pyexprs rÚ ends_withzExprBinaryNameSpace.ends_withLs5€õX.¨fÀÐFÑFÔFˆ ݘœ×3Ò3°MÑBÔBÑCÔCÐCrÚprefixcór—t|d¬¦«}t|j |¦«¦«S)uN Check if values start with a binary substring. Parameters ---------- prefix Prefix substring. Returns ------- Expr Expression of data type :class:`Boolean`. See Also -------- ends_with : Check if the binary substring exists at the end contains : Check if the binary substring exists anywhere Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... "prefix": [b"\x00", b"\xff\x00", b"\x00\x00"], ... } ... ) >>> colors.select( ... "name", ... pl.col("code").bin.starts_with(b"\xff").alias("starts_with_lit"), ... pl.col("code") ... .bin.starts_with(pl.col("prefix")) ... .alias("starts_with_expr"), ... ) shape: (3, 3) ┌────────┬─────────────────┬──────────────────┠│ name ┆ starts_with_lit ┆ starts_with_expr │ │ --- ┆ --- ┆ --- │ │ str ┆ bool ┆ bool │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ false ┆ true │ │ yellow ┆ true ┆ false │ │ blue ┆ false ┆ true │ └────────┴─────────────────┴──────────────────┘ Tr)rrrÚbin_starts_with)rr)Ú prefix_pyexprs rÚ starts_withzExprBinaryNameSpace.starts_with{s5€õ\.¨fÀÐFÑFÔFˆ ݘœ×5Ò5°mÑDÔDÑEÔEÐErT)ÚstrictÚencodingrr.ÚboolcóÞ—|dkr't|j |¦«¦«S|dkr't|j |¦«¦«Sd|›}t |¦«‚)uç Decode values using the provided encoding. Parameters ---------- encoding : {'hex', 'base64'} The encoding to use. strict Raise an error if the underlying value cannot be decoded, otherwise mask out with a null value. Returns ------- Expr Expression of data type :class:`Binary`. Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "encoded": [b"000000", b"ffff00", b"0000ff"], ... } ... ) >>> colors.with_columns( ... pl.col("encoded").bin.decode("hex").alias("code"), ... ) shape: (3, 3) ┌────────┬───────────┬─────────────────┠│ name ┆ encoded ┆ code │ │ --- ┆ --- ┆ --- │ │ str ┆ binary ┆ binary │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ b"000000" ┆ b"\x00\x00\x00" │ │ yellow ┆ b"ffff00" ┆ b"\xff\xff\x00" │ │ blue ┆ b"0000ff" ┆ b"\x00\x00\xff" │ └────────┴───────────┴─────────────────┘ ÚhexÚbase64ú1`encoding` must be one of {'hex', 'base64'}, got )rrÚbin_hex_decodeÚbin_base64_decodeÚ ValueError)rr/r.Úmsgs rÚdecodezExprBinaryNameSpace.decode¬sp€ðN uÒ Ð Ý˜Tœ\×8Ò8¸Ñ@Ô@ÑAÔAÐ AØ ˜Ò !Ð !ݘTœ\×;Ò;¸FÑCÔCÑDÔDÐ DàTÈÐTÐTˆCݘS‘/”/Ð !rcóÚ—|dkr&t|j ¦«¦«S|dkr&t|j ¦«¦«Sd|›}t |¦«‚)uS Encode a value using the provided encoding. Parameters ---------- encoding : {'hex', 'base64'} The encoding to use. Returns ------- Expr Expression of data type :class:`Binary`. Examples -------- >>> colors = pl.DataFrame( ... { ... "color": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... } ... ) >>> colors.with_columns( ... pl.col("code").bin.encode("hex").alias("encoded"), ... ) shape: (3, 3) ┌────────┬─────────────────┬─────────┠│ color ┆ code ┆ encoded │ │ --- ┆ --- ┆ --- │ │ str ┆ binary ┆ str │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•¡ │ black ┆ b"\x00\x00\x00" ┆ 000000 │ │ yellow ┆ b"\xff\xff\x00" ┆ ffff00 │ │ blue ┆ b"\x00\x00\xff" ┆ 0000ff │ └────────┴─────────────────┴─────────┘ r2r3r4)rrÚbin_hex_encodeÚbin_base64_encoder7)rr/r8s rÚencodezExprBinaryNameSpace.encodeÛsl€ðH uÒ Ð Ý˜Tœ\×8Ò8Ñ:Ô:Ñ;Ô;Ð ;Ø ˜Ò !Ð !ݘTœ\×;Ò;Ñ=Ô=Ñ>Ô>Ð >àTÈÐTÐTˆCݘS‘/”/Ð !rÚbÚunitrcór—t|j ¦«¦«}t||¦«}|S)u™ Get the size of binary values in the given unit. Parameters ---------- unit : {'b', 'kb', 'mb', 'gb', 'tb'} Scale the returned size to the given unit. Returns ------- Expr Expression of data type :class:`UInt32` or `Float64`. Examples -------- >>> from os import urandom >>> df = pl.DataFrame({"data": [urandom(n) for n in (512, 256, 1024)]}) >>> df.with_columns( # doctest: +IGNORE_RESULT ... n_bytes=pl.col("data").bin.size(), ... n_kilobytes=pl.col("data").bin.size("kb"), ... ) shape: (4, 3) ┌─────────────────────────────────┬─────────┬─────────────┠│ data ┆ n_bytes ┆ n_kilobytes │ │ --- ┆ --- ┆ --- │ │ binary ┆ u32 ┆ f64 │ â•žâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ b"y?~B\x83\xf4V\x07\xd3\xfb\xb… ┆ 512 ┆ 0.5 │ │ b"\xee$4@f\xc14\x07\x8e\x88\x1… ┆ 256 ┆ 0.25 │ │ b"\x80\xbd\xb9nEq;2\x99$\xf9\x… ┆ 1024 ┆ 1.0 │ └─────────────────────────────────┴─────────┴─────────────┘ )rrÚbin_size_bytesr)rr?Úszs rÚsizezExprBinaryNameSpace.sizes4€õBt”|×2Ò2Ñ4Ô4Ñ 5Ô 5ˆÝ ˜˜TÑ "Ô "ˆØˆ rÚlittle)Ú endiannessÚdtypeúPolarsDataType | DataTypeExprrEr cóz—t|¦«}t|j |j|¦«¦«S)uA Interpret bytes as another type. Supported types are numerical or temporal dtypes, or an ``Array`` of these dtypes. Parameters ---------- dtype : PolarsDataType Which type to interpret binary column into. endianness : {"big", "little"}, optional Which endianness to use when interpreting bytes, by default "little". Returns ------- Expr Expression of data type `dtype`. Note that rows of the binary array where the length does not match the size in bytes of the output array (number of items * byte size of item) will become NULL. Examples -------- >>> df = pl.DataFrame({"data": [b"\x05\x00\x00\x00", b"\x10\x00\x01\x00"]}) >>> df.with_columns( # doctest: +IGNORE_RESULT ... bin2int=pl.col("data").bin.reinterpret( ... dtype=pl.Int32, endianness="little" ... ), ... ) shape: (2, 2) ┌─────────────────────┬─────────┠│ data ┆ bin2int │ │ --- ┆ --- │ │ binary ┆ i32 │ â•žâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•¡ │ b"\x05\x00\x00\x00" ┆ 5 │ │ b"\x10\x00\x01\x00" ┆ 65552 │ └─────────────────────┴─────────┘ )rrrÚbin_reinterpretÚ_pydatatype_expr)rrFrEs rÚ reinterpretzExprBinaryNameSpace.reinterpret,s<€õT)¨Ñ/Ô/ˆåØ ŒL× (Ò (¨Ô)?ÀÑ LÔ Lñ ô ð rNÚoffsetúint | IntoExprÚlengthúint | IntoExpr | NonecóŽ—t|¦«}t|¦«}t|j ||¦«¦«S)u Slice the binary values. Parameters ---------- offset Start index. Negative indexing is supported. length Length of the slice. If set to ``None`` (default), the slice is taken to the end of the value. Returns ------- Expr Expression of data type :class:`Binary`. Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... } ... ) >>> colors.with_columns( ... pl.col("code").bin.slice(1, 2).alias("sliced"), ... ) shape: (3, 3) ┌────────┬─────────────────┬─────────────┠│ name ┆ code ┆ sliced │ │ --- ┆ --- ┆ --- │ │ str ┆ binary ┆ binary │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ b"\x00\x00\x00" ┆ b"\x00\x00" │ │ yellow ┆ b"\xff\xff\x00" ┆ b"\xff\x00" │ │ blue ┆ b"\x00\x00\xff" ┆ b"\x00\xff" │ └────────┴─────────────────┴─────────────┘ )rrrÚ bin_slice)rrLrNÚ offset_pyexprÚ length_pyexprs rÚslicezExprBinaryNameSpace.slice\s?€õR.¨fÑ5Ô5ˆ Ý-¨fÑ5Ô5ˆ ݘœ×/Ò/° ¸}ÑMÔMÑNÔNÐNréÚncór—t|d¬¦«}t|j |¦«¦«S)uÐ Take the first `n` bytes of the binary values. Parameters ---------- n Length of the slice (integer or expression). Negative indexing is supported; see note (2) below. Returns ------- Expr Expression of data type :class:`Binary`. Notes ----- (1) A similar method exists for taking the last `n` bytes: :func:`tail`. (2) If `n` is negative, it is interpreted as "until the nth byte from the end", e.g., ``head(-3)`` returns all but the last three bytes. Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... } ... ) >>> colors.with_columns( ... pl.col("code").bin.head(2).alias("head"), ... ) shape: (3, 3) ┌────────┬─────────────────┬─────────────┠│ name ┆ code ┆ head │ │ --- ┆ --- ┆ --- │ │ str ┆ binary ┆ binary │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ b"\x00\x00\x00" ┆ b"\x00\x00" │ │ yellow ┆ b"\xff\xff\x00" ┆ b"\xff\xff" │ │ blue ┆ b"\x00\x00\xff" ┆ b"\x00\x00" │ └────────┴─────────────────┴─────────────┘ Fr)rrrÚbin_head©rrVÚn_pyexprs rÚheadzExprBinaryNameSpace.head‰ó5€õV)¨°uÐ=Ñ=Ô=ˆÝ˜œ×.Ò.¨xÑ8Ô8Ñ9Ô9Ð9rcór—t|d¬¦«}t|j |¦«¦«S)uÊ Take the last `n` bytes of the binary values. Parameters ---------- n Length of the slice (integer or expression). Negative indexing is supported; see note (2) below. Returns ------- Expr Expression of data type :class:`Binary`. Notes ----- (1) A similar method exists for taking the first `n` bytes: :func:`head`. (2) If `n` is negative, it is interpreted as "starting at the nth byte", e.g., ``tail(-3)`` returns all but the first three bytes. Examples -------- >>> colors = pl.DataFrame( ... { ... "name": ["black", "yellow", "blue"], ... "code": [b"\x00\x00\x00", b"\xff\xff\x00", b"\x00\x00\xff"], ... } ... ) >>> colors.with_columns( ... pl.col("code").bin.tail(2).alias("tail"), ... ) shape: (3, 3) ┌────────┬─────────────────┬─────────────┠│ name ┆ code ┆ tail │ │ --- ┆ --- ┆ --- │ │ str ┆ binary ┆ binary │ â•žâ•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•â•â•â•â•â•â•â•¡ │ black ┆ b"\x00\x00\x00" ┆ b"\x00\x00" │ │ yellow ┆ b"\xff\xff\x00" ┆ b"\xff\x00" │ │ blue ┆ b"\x00\x00\xff" ┆ b"\x00\xff" │ └────────┴─────────────────┴─────────────┘ Fr)rrrÚbin_tailrYs rÚtailzExprBinaryNameSpace.tail·r\rF)Ú null_on_oobÚindexr`cóp—t|¦«}t|j ||¦«¦«S)uô Get the byte value at the given index. For example, index `0` would return the first byte of every binary value and index `-1` would return the last byte of every binary value. The behavior if an index is out of bounds is determined by the argument `null_on_oob`. Parameters ---------- index Index to return per binary value null_on_oob Behavior if an index is out of bounds: * True -> set as null * False -> raise an error Examples -------- >>> df = pl.DataFrame({"a": [b"\x01\x02\x03", b"", b"\x04\x05"]}) >>> df.with_columns(get=pl.col("a").bin.get(0, null_on_oob=True)) shape: (3, 2) ┌─────────────────┬──────┠│ a ┆ get │ │ --- ┆ --- │ │ binary ┆ u8 │ â•žâ•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•â•ªâ•â•â•â•â•â•â•¡ │ b"\x01\x02\x03" ┆ 1 │ │ b"" ┆ null │ │ b"\x04\x05" ┆ 4 │ └─────────────────┴──────┘ )rrrÚbin_get)rrar`Ú index_pyexprs rÚgetzExprBinaryNameSpace.getås2€õD-¨UÑ3Ô3ˆ ݘœ×-Ò-¨l¸KÑHÔHÑIÔIÐIr)rr rr)rr rr )r$r rr )r)r rr )r/rr.r0rr )r/rrr )r>)r?rrr )rFrGrEr rr r)rLrMrNrOrr )rU)rVrMrr )rarMr`r0rr )Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú _accessorrr#r(r-r9r=rCrKrTr[r_re©rrrrs€€€€€€Ø0Ð0à€Ið$ð$ð$ð$ð-Dð-Dð-Dð-Dð^-Dð-Dð-Dð-Dð^/Fð/Fð/Fð/FðbDHð-"ð-"ð-"ð-"ð-"ð-"ð^*"ð*"ð*"ð*"ðX#ð#ð#ð#ð#ðLQYð. ð. ð. ð. ð. ð. ðbGKð+Oð+Oð+Oð+Oð+OðZ,:ð,:ð,:ð,:ð,:ð\,:ð,:ð,:ð,:ð,:ð\AFð#Jð#Jð#Jð#Jð#Jð#Jð#Jð#JrrN)Ú __future__rÚtypingrÚpolars._utils.parserÚpolars._utils.variousrÚpolars._utils.wraprÚpolars.datatypesrÚpolarsr r Úpolars._typingr r r rrrrkrrúrtsðØ"Ð"Ð"Ð"Ð"Ð"à Ð Ð Ð Ð Ð à5Ð5Ð5Ð5Ð5Ð5Ø-Ð-Ð-Ð-Ð-Ð-Ø(Ð(Ð(Ð(Ð(Ð(Ø5Ð5Ð5Ð5Ð5Ð5àðØ)Ð)Ð)Ð)Ð)Ð)Ð)Ð)ðððððððððððððððsJðsJðsJðsJðsJñsJôsJðsJðsJðsJr