j ~ddlmZddlZddlmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZeje5dd lmZdddn #1swxYwYerdd lmZdd lmZdd lmZdd lmZddlmZedddddddddd)d&Zedddddddddd*d(Z dS)+) annotationsN)IO TYPE_CHECKINGLiteral)unstable)wrap_ldf) get_sources)!_init_credential_provider_builder) ScanOptions) PyLazyFrame)Path)StorageOptionsDict) DataFrame)CredentialProviderFunction) LazyFramelineTautonamen_rowsrow_index_namerow_index_offsetglobstorage_optionscredential_providerinclude_file_pathssourcecstr | Path | IO[str] | IO[bytes] | bytes | list[str] | list[Path] | list[IO[str]] | list[IO[bytes]]rstrr int | Noner str | NonerintrboolrStorageOptionsDict | Noner3CredentialProviderFunction | Literal['auto'] | Nonerreturnrc Vt||||||||| S)uh Read lines into a string column from a file. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- source Path(s) to a file or directory When needing to authenticate for scanning cloud locations, see the `storage_options` parameter. name Name to use for the output column. n_rows Stop reading from parquet file after reading `n_rows`. row_index_name If not None, this will insert a row index column with the given name into the DataFrame row_index_offset Offset to start the row index column (only used if the name is set) glob Expand path given via globbing rules. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: \ `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. include_file_paths Include the path of the source file(s) as a column with this name. See Also -------- scan_lines Examples -------- >>> pl.read_lines(b"Hello\nworld") shape: (2, 1) ┌───────┐ │ line │ │ --- │ │ str │ ╞═══════╡ │ Hello │ │ world │ └───────┘ r) scan_linescollect) rrrrrrrrrs T/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/polars/io/lines.py read_linesr+sBr  %) '/-   gii rc t|} t|| |d} ~tj| t |||fnd|d|fnd|||| |} t | S)u Construct a LazyFrame which scans lines into a string column from a file. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- source Path(s) to a file or directory When needing to authenticate for scanning cloud locations, see the `storage_options` parameter. name Name to use for the output column. n_rows Stop reading from parquet file after reading `n_rows`. row_index_name If not None, this will insert a row index column with the given name into the DataFrame row_index_offset Offset to start the row index column (only used if the name is set) glob Expand path given via globbing rules. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: \ `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. include_file_paths Include the path of the source file(s) as a column with this name. See Also -------- read_lines Examples -------- >>> pl.scan_lines(b"Hello\nworld").collect() shape: (2, 1) ┌───────┐ │ line │ │ --- │ │ str │ ╞═══════╡ │ Hello │ │ world │ └───────┘ r(Nr) row_index pre_slicerrrr)sources scan_optionsr)r r r new_from_scan_linesr r) rrrrrrrrrr0credential_provider_builderpylfs r*r(r(sr&!!G"CWo|##   * "- !122%+%7q&kkT1+ ;       D" D>>r,)rrrrrr rr!rr"rr#rr$rr%rr!r&r)rrrrrr rr!rr"rr#rr$rr%rr!r&r)! __future__r contextlibtypingrrrpolars._utils.unstablerpolars._utils.wraprpolars.io._utilsr ,polars.io.cloud.credential_provider._builderr polars.io.scan_options._optionsr suppress ImportError polars._plrr pathlibr polars._typingrpolars.dataframe.framerpolars.io.cloudrpolars.lazyframe.framerr+r(r,r*rFs4""""""----------++++++''''''((((((877777Z%%((''''''(((((((((((((((1111111000000::::::000000 !%15OU%))bbbbb bJ !%15OU%))ppppp pppsAAA