OOId'ddlZddlZddlmZddlmZddlmZmZm Z iZ ej dZ dZ dZdd Z dd ZGddeZdZdS)N)AsyncFileSystem)_DEFAULT_CALLBACK) filesystemget_filesystem_classsplit_protocolzfsspec.genericc 0t|fi|t|<dSN)r _generic_fs)protocolstorage_optionss .lib/python3.11/site-packages/fsspec/generic.pyset_generic_fsr s"&xCC?CCKdefaultc^|pt}|pt|d}|pi}|dkrt|S|dkr t|S|dkr#t |}|S|dkr!t|fi||iStd|)zPick instance of backend FSrrgenericcurrentoptionszUnknown FS resolution method: )default_methodrrr rrget ValueError)urlmethodr r clss r _resolve_fsrs  %~F1>#..q1H%+O (### 8$$ "8,,{{}} (HHo&9&9(B&G&GHHH >f>> ? ??rFsize differentc P|p tdi|pi}|||dd|st d|ddfdD} t t| d| D]-} | | d.dDt tdfd D}  D]j\} } | }|vrF|d kr|| <+|d kr3| |||kr|| <O | e|| <krWt\}}t t|d |j||fi||rAt t| d || dSdS)aSync files between two directory trees (experimental) Parameters ---------- source: str Root of the directory tree to take files from. destination: str Root path to copy into. The contents of this location should be identical to the contents of ``source`` when done. delete_missing: bool If there are paths in the destination that don't exist in the source and this is True, delete them. Otherwise, leave them alone. source_field: str If ``update_field`` is "different", this is the key in the info of source files to consider for difference. dest_field: str If ``update_field`` is "different", this is the key in the info of destination files to consider for difference. update_cond: "different"|"always"|"never" If "always", every file is copied, regardless of whether it exists in the destination. If "never", files that exist in the destination are not copied again. If "different" (default), only copy if the info fields given by ``source_field`` and ``dest_field`` (usually "size") are different. Other comparisons may be added in the future. inst_kwargs: dict|None If ``fs`` is None, use this set of keyword arguments to make a GenericFileSystem instance fs: GenericFileSystem|None Instance to use if explicitly given. The instance defines how to to make downstream file system instances from paths. T)withdirsdetailzCan only rsync on a directorycbg|]+\}}|ddk|v)|,S)type directoryreplace).0av destination otherfilessources r zrsync..WsN    Aq V9 # # &+(F(Fj(X(X (X(X(Xrz directories to createexist_okc2i|]\}}|ddk||Sr#file)r'r(r)s r zrsync..`s,IIIAQvY&5H5H15H5H5Hrz files to consider for copycbg|]+\}}|v|ddk)|,Sr1r%)r'or)allfilesr*r,s rr-zrsync..bsN Aq 99[& ) ) 9 9ai6>Q>Q >Q>Q>Qralwaysrz files to copyz files to deleteNr3)GenericFileSystem_strip_protocolfindisdirritemsloggerdebuglenmkdirsr&copypopzipcprm)r,r*delete_missing source_field dest_field update_cond inst_kwargsfskwargsdirsdirn to_deletekr) otherfile source_files target_filesr7r+s`` @@rrsyncrU$sX 7 77K$5277B    ' 'F$$[11KwwvTw::H 88F  :8999tDAAJ      NN$$   D  LLCII555666DD $,,v{33d CCCCII!1!1IIIH LLCMM>>>???$$&&I  %%''$$1IIfk22  " "h&&'  ++\?j&;J&GGG"+HQKKLLOOO$HQKK4%((..*:*:%;" l L))999::: lL33F333 I888999 ircreZdZdZdZdfd ZdZddZd Z dd Z d Z d Z dZ ddZ dZdefdZxZS)r9a^Wrapper over all other FS types This implementation is a single unified interface to be able to run FS operations over generic URLs, and dispatch to the specific implementations using the URL protocol prefix. Note: instances of this FS are always async, even if you never use it with any async backend. rrc V||_tt|jdi|dS)aK Parameters ---------- default_method: str (optional) Defines how to configure backend FS instances. Options are: - "default": instantiate like FSClass(), with no extra arguments; this is the default instance of that FS, and can be configured via the config system - "generic": takes instances from the `_generic_fs` dict in this module, which you must populate before use. Keys are by protocol - "current": takes the most recently instantiated version of each FS Nr3)rsuperr9__init__)selfrrM __class__s rrYzGenericFileSystem.__init__s6% /&&/99&99999rc|t||j}|||Sr )rrunstrip_protocolr:)rZpathrLs rr:z!GenericFileSystem._strip_protocols5 t{ + +""2#5#5d#;#;<<.s+++!AfI+++r)rrrb_lslsr])rZrr!rMrLrer6s rrlzGenericFileSystem._lss dk * * = 4s::4:6::::::::CC"%33D3F33C 7 7A++AfI66AfII  ,J++s+++ +rcKt||j}|jr|j|fi|d{VS|j|fi|Sr )rrrb _cat_filecat_filerZrrMrLs rrozGenericFileSystem._cat_filesi dk * * = .%c44V44444444 42;s--f-- -rcKt||j}|jr|j||fi|d{VS|j||fi|Sr )rrrb _pipe_file pipe_file)rZr^valuerMrLs rrszGenericFileSystem._pipe_filesm t{ + + = 7&tU==f======== =2<e66v66 6rcKt||j}|jr|j|fi|d{VdS|j|fi|dSr )rrrb_rmrFrqs rrwzGenericFileSystem._rmss dk * * = !"&'''' ' ' ' ' ' ' ' ' ' BE#  rcKt||j}|jr|||d{VdS|||dS)Nr.)rrrb _makedirsmakedirs)rZr^r/rLs rryzGenericFileSystem._makedirssk t{ + + = 1,,th,77 7 7 7 7 7 7 7 7 7 KKxK 0 0 0 0 0rc &t||fd|i|dS)z[Sync files between two directory trees See `func:rsync` for more details. rLN)rU)rZr,r*rMs rrUzGenericFileSystem.rsyncs' fk55d5f55555ric(Kt||j}t||j}||ur+|jr|j||fi|d{VS|j||fi|Sddd} t |dr||dd{Vn|j|dfi|} |t| j d{Vt |dr||dd{Vn|j|dfi|} | j | | j krt| |d{V} | j | snst| | d{V|| | j | | j k t| d{Vt| d{VdS#t $rYdSwxYw# t| d{Vt| d{Vw#t $rYwwxYwxYw)Nrnone) blocksize cache_type open_asyncrbwb)rrrb_cp_filecp_filehasattrropenset_size maybe_awaitrtellreadwriteabsolute_updateclose NameError) rZrurl2r~callbackrMrLfs2kwf1f2datas rrzGenericFileSystem._cp_files+dk * *$ ,, 99} 7(R[d==f=========!rz#t66v666F 3 3 2|,,.bmmC.........RWS$--"--    K$8$8888888 9 9 93 --0cnnT4000000000SXdD//B//  '/RWWYY%8%8(););<<<<<<<<7?4?!"((4..111111111((333 '/RWWYY%8%8 !"((**---------!"((**-----------     !"((**---------!"((**----------    sE"E,H0AH H-,H-0J2AJJ J J JJ)r)NFF)T)F)__name__ __module__ __qualname____doc__r rYr:rcrhrlrorsrwryrUrr __classcell__)r[s@rr9r9s  H::::::"=== &,,,,$ . . . 7 7 7!!!1111666" ))))))))rr9cBKtj|r|d{VS|Sr )inspect iscoroutine)cors rrr*s03yyyyyy r)NNN)FrrrNN)rloggingasynr callbacksrcorerrrr getLoggerr>rrrrUr9rr3rrrs!!!!!!((((((BBBBBBBBBB  + , ,DDD@@@@( XXXXvhhhhhhhhVr