Wj9 >ddlmZddlZddlmZmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZmZmZmZdd lmZmZmZdd lmZerddlm Z m!Z!ede"e#e$edfZ%ede"e#e$edfe&e'eefe(eZ)Gdde*Z+Gddeee%e)fZ,Gdde,e%e)fZ-Gdde,e%e)fZ.Gdde.e%e)fZ/Gdde/e%e)fZ0dS)) annotationsN)ABCabstractmethod) literal_eval)cached_property)sha256)getenv)Path) gettempdir)Lock)AnyGeneric TYPE_CHECKINGTypeVar) assert_neveroverrideSelf)FileLock)FutureThreadPoolExecutorKey.ValueceZdZdZdS) CacheErrorzJ Exception raised for errors encountered during cache operations. N)__name__ __module__ __qualname____doc__Z/home/longshao/multi-rider-rag/.venv/lib/python3.11/site-packages/torch/_inductor/cache.pyrrsr rcBeZdZdZeddZedd Zd S)Cachezi Abstract base class for cache implementations. Provides the interface for cache operations. selfrkeyrreturn Value | NonecdSz Retrieve a value from the cache. Args: key (Key): The key to look up. Returns: Value | None: The cached value if present, else None. Nr)r$r%s r!getz Cache.get*r valuerboolcdS)  Insert a value into the cache. Args: key (Key): The key to insert. value (Value): The value to associate with the key. Returns: bool: True if the value was inserted, False if the key already exists. Nrr$r%r,s r!insertz Cache.insert4r+r Nr$rr%rr&r'r$rr%rr,rr&r-)rrrrrr*r1rr r!r#r#$s^    ^    ^   r r#cZeZdZdZddZdd ZddZeddZeddZ dS) InMemoryCachezL In-memory cache implementation using a dictionary and thread lock. r$rr&Nonec:i|_t|_dS)z6 Initialize an empty in-memory cache. N)_cacher _lockr$s r!__init__zInMemoryCache.__init__Es)+ 66 r r%rr'c|j5|j|x}|cdddS ddddS#1swxYwYdSr))r9r8r*r0s r!r*zInMemoryCache.getLsZ  ---:                          sAAAAr,rr-c|j5||jvr ddddS||j|< ddddS#1swxYwYdS)r/NFT)r9r8r0s r!r1zInMemoryCache.insertYsZ  dk!!         %DK                    s 8 8<<env_varstrc D|}t|x}|S|dD]}|}|s |dd\}}n)#t$r}t d|d|d|d}~wwxYw||}} t |}n0#tt f$r}t d|d |d |d}~wwxYw t |} n0#tt f$r}t d |d |d |d}~wwxYw tj|} n.#tj $r}t d|d |d |d}~wwxYw tj| } n.#tj $r}t d |d |d |d}~wwxYw| | | sE| | | kr,t d | d| | d| d|S)av Create an in-memory cache from an environment variable. Args: env_var (str): Name of the environment variable containing cache data. Returns: InMemoryCache: An instance populated from the environment variable. Raises: CacheError: If the environment variable is malformed or contains invalid data. N;,zMalformed kv_pair z from env_var z!, likely missing comma separator.zMalformed key_bytes_repr z in kv_pair z, encoding is invalid.zMalformed value_bytes_repr z, not un-pickle-able.zMultiple values for key z found, got z and .) r splitstrip ValueErrorrr SyntaxErrorpickleloadsUnpicklingErrorr1r*) clsr>cacheenv_valkv_pairkey_bytes_reprvalue_bytes_reprerr key_bytes value_bytesr%r,s r! from_env_varzInMemoryCache.from_env_varisg &G /L}}S))9 9 GmmooG  3:==a3H3H0 0 0    nnn'nnn $$&& &&((-N  (88  ,    ooogooo  *+;<<  ,    s2BssRYsss   l9--)    nnngnnn   [11)    r2BrrRYrrr LLe,, 599S>>U3J3J cscc%))C..ccY^ccc sxA(( B2B  B:C  C7C22C7;D  D8D33D8<EE< E77E<FG$F;;Gfpathr c||}|s|S t|d5}tj||_dddn #1swxYwYn+#tj$r}t d|d|d}~wwxYwt|jtst d|d|S)a= Create an in-memory cache from a file path. Args: fpath (Path): Path to the file containing pickled cache data. Returns: InMemoryCache: An instance populated from the file. Raises: CacheError: If the file is not a valid pickled dictionary. rbNz&Failed to create cache from file path z#, file contents are un-pickle-able.z-, file contents not pickled dict[Key, Value].) is_fileopenrIloadr8rKr isinstancedict)rLrVrMfprRs r!from_file_pathzInMemoryCache.from_file_paths}} L eT"" /b%{2  / / / / / / / / / / / / / / /%   cccc   %,-- mmmm  s:A$A A$AA$A A$$B 3BB Nr$rr&r6r2r3)r>r?r&r)rVr r&r) rrrrr;r*r1 classmethodrUr_rr r!r5r5@s""""     KKK[KZ[r r5c"eZdZdZdd ZddZdS) AsyncCachezE Asynchronous cache implementation using ThreadPoolExecutor. r$rr%rexecutorrr&Future[Value | None]c8||j|S)a Retrieve a value from the cache asynchronously. Args: key (Key): The key to look up. executor (ThreadPoolExecutor): Executor for async execution. Returns: Future[Value | None]: Future for the cached value or None. )submitr*)r$r%rds r! get_asynczAsyncCache.get_asyncstx---r r,r Future[bool]c:||j||S)aO Insert a value into the cache asynchronously. Args: key (Key): The key to insert. value (Value): The value to associate with the key. executor (ThreadPoolExecutor): Executor for async execution. Returns: Future[bool]: Future for the result of insertion. )rgr1)r$r%r,rds r! insert_asynczAsyncCache.insert_asyncst{C777r N)r$rr%rrdrr&re) r$rr%rr,rrdrr&ri)rrrrrhrkrr r!rcrcsF . . . . 8 8 8 8 8 8r rcceZdZUdZdZded<ddd ZeddZd dZ d!dZ e d"dZ e d#dZe d$dZdS)% OnDiskCachea? On-disk cache implementation using files and file locks. Stores cache data in files on disk, with atomic operations and versioning. Supports custom cache directory names. Attributes: version (int): The version used for cache versioning. name (str): The name of the cache directory. rintversionNr$rname str | Noner&r6c|pd|_dS)z Initialize an on-disk cache instance. Args: name (str | None, optional): The name of the cache directory. If None, defaults to "on_disk_cache". on_disk_cacheN)rp)r$rps r!r;zOnDiskCache.__init__s+O r r cNttdz |jz S)z Get the base directory for the cache. Returns: Path: The base directory path for storing cache files. rM)r r rpr:s r!base_dirzOnDiskCache.base_dirs"JLL!!G+di77r r%rc |jttj|ddz S#t tjf$r}td|d|d}~wwxYw)a Get the file path for a given key. Args: key (Key): The key to convert to a file path. Returns: Path: The file path for the key. Raises: CacheError: If the key is not pickle-able. N zFailed to get fpath for key z, key is not pickle-able.) rurrIdumps hexdigestAttributeError PicklingErrorrr)r$r%rRs r!_fpath_from_keyzOnDiskCache._fpath_from_keys =6&,s*;*;#<#<#F#F#H#H"#MM M 45   OsOOO  sAAA4A//A4rVrcptt|jdz |jddz dzS)z Get a file lock for a given file path. Args: fpath (Path): The file path. Returns: FileLock: The file lock for the path. locksNz.lock)rr?parentrp)r$rVs r!_flock_from_fpathzOnDiskCache._flock_from_fpath*s5EL72UZ^CDDwNOOOr bytesctttjddS)z Get the version prefix for the cache. Returns: bytes: The version prefix as bytes, derived from the cache version string. Nr)rr?rmroencodedigestr:s r!version_prefixzOnDiskCache.version_prefix9s>c+-..557788??AA"1"EEr r'c||}||}|5|s ddddSd}t|j}t |d5}|||jkr|}dddn #1swxYwY|"| ddddS tj |}n+#tj $r}td|d|d}~wwxYw|cdddS#1swxYwYdS)a Retrieve a value from the cache. Args: key (Key): The key to look up. Returns: Value | None: The cached value if present and version matches, else None. Raises: CacheError: If the value is corrupted or cannot be unpickled. Side Effects: Removes stale cache files if the version prefix does not match. NrXzFailed to get key z?, value is potentially corrupted (value is not un-pickle-able).) r|rrYlenrrZreadunlinkrIrJrKr) r$r%rVflockrT prefix_lengthr^r,rRs r!r*zOnDiskCache.getBs$$S))&&u--   ==??         K 344MeT"" ,b77=))T-@@@"$''))K , , , , , , , , , , , , , , ,"         "  [11)    oooo  1                  s_D3&D363B5) D35B9 9D3<B9 =D3%C:9D3:D" DD""D33D7:D7r,rr-c||}||}|jdd |5}t |d5}||jtj||dddn #1swxYwYdddn #1swxYwYn:#tj $r}td|d|d|d}~wt$rYdSwxYwdS) a Insert a value into the cache. Args: key (Key): The key to insert. value (Value): The value to associate with the key. Returns: bool: True if the value was inserted, False if the key already exists. Raises: CacheError: If the value is not pickle-able. Side Effects: Creates the cache directory if it does not exist. T)parentsexist_okxbNzFailed to insert key z with value z, value is not pickle-able.F) r|rrmkdirrZwriterrIdumpr{rFileExistsError)r$r%r,rVr_r^rRs r!r1zOnDiskCache.insertls$$S))&&u-- 4$777  '!T%.. '",--- E2&&& ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' '#   ___5___    55 tsfB: B.0B B.B B.B B." B:.B22B:5B26B::C1 C  C10C1)N)r$rrprqr&r6r$rr&r )r$rr%rr&r )r$rrVr r&r)r$rr&rr2r3)rrrrro__annotations__r;rrur|rpropertyrrr*r1rr r!rmrmsG,,,,,888_8& P P P PFFFXF'''X'RXr rmc<eZdZdZd fd Zed dZxZS) InductorOnDiskCachezt Inductor-specific on-disk cache implementation. Uses a custom base directory for Inductor cache files. r$rr&r6cJtddS)z Initialize an inductor on-disk cache instance. Sets the cache directory name to "inductor_on_disk_cache". inductor_on_disk_cacheN)superr;)r$ __class__s r!r;zInductorOnDiskCache.__init__s$ 122222r r cJddlm}t|d|jS)z Get the base directory for the Inductor cache. Returns: Path: The base directory path for Inductor cache files. r)default_cache_dirrM)%torch._inductor.runtime.runtime_utilsrr rp)r$rs r!ruzInductorOnDiskCache.base_dirs5 LKKKKK%%''$)<<rs"""""" ########%%%%%%777777777777::::::::::******>========geS#uS#X//c5c?E4S>4PS9UU      Ce$   8UUUUUE#u*%UUUp88888sEz"888BQQQQQ*S%Z(QQQh=====+c5j1=====r