8xd dZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z ddl m Z mZd!dZdZdZd Zd Zd Zd"d Zd ZdZdZdZdZdZdZdZdZdZdZ dZ!dZ"dZ#dZ$dZ%dZ&dZ' d#d Z(dS)$z% Tools for converting conda packages N)Path)filter_info_fileswalkFctjd}g}tj|5}|D]}}|drf||}d|d dd}| |~ dddn #1swxYwY|S)aCheck tarfile for compiled C files with '.pyd' or '.so' suffixes. If a file ends in either .pyd or .so, it is a compiled C file. Because compiled C code varies between platforms, it is not possible to convert packages containing C extensions to other platforms. Positional arguments: file_path (str) -- the file path to the source package tar file Keyword arguments: show_imports (bool) -- output the C extensions included in the package zC(Lib\/|lib\/python\d\.\d\/|lib\/)(site-packages\/|lib-dynload)?(.*))z.pydz.soz import {}/.N) recompiletarfileopengetnamesendswithmatchformatgroupreplaceappend) file_path show_importsc_extension_patternimportstarfilenamefilename_match import_names 3lib/python3.11/site-packages/conda_build/convert.pyretrieve_c_extensionsrs*NG i ,C  , ,H  11 ,!4!:!:8!D!D)00"((++33C== {+++  ,,,,,,,,,,,,,,,, NsBC  CCcXtj|5}tj|dd}dddn #1swxYwY|d}|ddkrd}n1|ddkrd }n|d}|d s|d rd ||fS|dd rd ||fStd)zRetrieve the platform and architecture of the source package. Positional arguments: file_path (str) -- the file path to the source package tar file info/index.jsonutf-8Nplatformarchx86_6464x8632linuxosxunixwinz Package platform not recognized.) r r jsonloads extractfilereaddecodeget startswith RuntimeError)rrindexr" architectures rretrieve_package_platformr62st i VC 3??+<==BBDDKKGTTUUVVVVVVVVVVVVVVVZ H yyH$$ 6  e # # yy(( 7##?x':':5'A'A?,// z  % %e , ,?x..=>>>sA A..A25A2c:d|vrBtjd}||}|r|dSdS|dryt j|5}tj| d d}dddn #1swxYwYn[tj |d}t |5}tj|}dddn #1swxYwYtjd|d d }tjd d|d }d ||d|d S)aRetrieve the python version from a path. This function is overloaded to handle three separate cases: when a path is a tar archive member path such as 'lib/python3.6/site-packages', when a path is the file path to the source package tar file, and when a path is the path to the temporary directory that contains the extracted contents of the source package tar file. This allows one function to handle the three most common cases of retrieving the python version from the source package. Positional arguments: file_path (str) -- the file path to a tar archive member, the file path to the source tar file itself, or the file path to the temporary directory containing the extracted source package contents pythonz python\d\.\d+r)z.tar.bz2z.tarr r!Nz(.*)?(py)(\d\d)(.*)?buildrz\A.*py\d\d.*\Zz{}{}.{})r r searchrrr r r,r-r.r/r0ospathjoinloadsubr) rpatternmatchedrr4 path_file index_filebuild_version_number build_versions rretrieve_python_versionrGLs9*-....++  $==## # $ $   2 3 3 .i(( C OO$566;;==DDWMM                 Y0ABBIi .J *-- . . . . . . . . . . . . . . . "y)@%.QQWW   0(E'NKK  /24H4K   s%0A C  C C D%%D),D)ctj}tj|}||||S)zExtract the source tar archive contents to a temporary directory. Positional arguments: file_path (str) -- the file path to the source package tar file )tempfilemkdtempr r extractallclose)rtemporary_directorysources rextract_temporary_directoryrOysJ #*,, \) $ $F )*** LLNNN cd|D}d|D}||}t|dkr4|D]1}|D],}||r||-2|||S)a0Update the source package's existing dependencies. When a user passes additional dependencies from the command line, these dependencies will be added to the source package's existing dependencies. If the dependencies passed from the command line are existing dependencies, these existing dependencies are overwritten. Positional arguments: new_dependencies (List[str]) -- the dependencies passed from the command line existing_dependencies (List[str]) -- the dependencies found in the source package's index.json file cBh|]}|dSrsplit).0 dependencys r z&update_dependencies..s)QQQ* ((**1-QQQrPcBh|]}|dSrSrT)rVr4s rrXz&update_dependencies..s%RRR5ekkmmA.RRRrPr) intersectionlenr2removeextend)new_dependenciesexisting_dependenciesdependency_namesindex_dependency_namesrepeated_packagesindex_dependencyrWs rupdate_dependenciesrdsRQ@PQQQRRr r,r?rUr1printrrddump) temp_dirtarget_platform dependenciesverboserDfiler4r"r5other_platformssource_architectures rupdate_index_filer|sTh(9::J j   T $               -22377HlO/))* 6  h & &""  /66uZ7H(SSTTT -44U8_oVVWWW 1 8 8#\     !E*%E(Ot f   f $f O.|U9=MNNi j#  )$ %a(((())))))))))))))) s#AAA&F  FFc|dkr:t|}tjdd||d}ns|dkrmt|}tjd|dd}tjd ||dd}tj|S) a Update the lib path found in the source package's paths.json file. For conversions from unix to windows, the 'lib/pythonx.y/' paths are renamed to 'Lib/' and vice versa for conversions from windows to unix. Positional arguments: path (str) -- path to rename in the paths.json file target_platform (str) -- the platform to target: 'unix' or 'win' Keyword arguments: temp_dir (str) -- the file path to the temporary directory that contains the source package's extracted contents r+z\AlibLibr*lib\\\z\ALib)rGr r@rr<r=r>normpath)r=rvrupython_versionrenamed_lib_pathlib_python_versions rupdate_lib_pathrs%0666(E488@@QSTT F " "0::W\\%@@HHvVV6 ($,,tV*D*D   7  , - --rPc|dkr_ tj|dD]}d|vrTtj|tjdd}tj||Zt |8t |}tj|||dn#t$rYnwxYw tj tj|ddn#t$rYnwxYwtj tj|dtj|d dS|d krt|}|d z }|dz }||t|d } t |}||z } | d d | D]!}|| |jz  dSdS)aUpdate the source package's 'lib' directory. When converting from unix to windows, the 'lib' directory is renamed to 'Lib' and the contents inside the 'pythonx.y' directory are renamed to exclude the 'pythonx.y' prefix. When converting from windows to unix, the 'Lib' is renamed to 'lib' and the pythonx.y' prefix is added. Positional arguments: lib_directory (str) -- the file path to the 'lib' directory located in the temporary directory that stores the package contents temp_dir (str) -- the file path to the temporary directory that contains the source package's extracted contents target_platform (str) -- the platform to target: 'unix' or win' file_path (str) -- the file path to the source package tar file r+z /python*/**z site-packagesrNrz/python*rr~r**T)parentsexist_ok)globiglobr<r=r>renamesrGrOSErrorshutilrmtree IndexErrormoverrenametuplemkdirname) lib_directoryrurvrlib_filenew_site_packages_pathrsrc_dirdst_dircontents py_folders rupdate_lib_contentsrs= %  J-'D'D'DEE S S"h..-/W\\ "',,uo"F"F..*Jx)?@@@@.x88D)@)J)J 8X-=-=nb-Q-QRRR S    D   M$)}$>$>$>??B C C C C    D   BGLL51127<<%3P3PQQQQQ F " ">>U"U" wc**++1;;n, t444! 7 7H OOI 5 6 6 6 6% # "" 7 7s$B9C CC/D DDc|dkrtj|dst ||rt jdd|}nqtjt jdd|d}|d}n2|dkr,t jdd |}|dd }|S) aUpdate the name of the executable files found in the paths.json file. When converting from unix to windows, executables are renamed with a '-script.py' suffix. When converting from windows to unix, this suffix is removed. The paths in paths.json need to be updated accordingly. Positional arguments: file_path (str) -- the file path to the executable to rename in paths.json target_platform (str) -- the platform to target: 'unix' or 'win' r+r z\AbinScriptsr -script.pyr*z \AScriptsbinr) r<r=basenamer2is_binary_filer r@splitextr)rurrvrenamed_executable_path renamed_paths rupdate_executable_pathr;s% 7  I & & 1 1# 6 6 B. i; ;  B')fXy)&L&L # #7++BF8Y ,R,RSSTUVL)5&A&A&A # # F " "vlE9== "."6"6|R"H"H ""rPcttj||d5}|}t j|cdddS#1swxYwYdS)zUpdate the sha of executable scripts. When moving from windows to linux, a shebang line is removed/added from script files which requires to update the sha. rbN)r r<r=r>r/hashlibsha256 hexdigest)package_directoryexecutable_path script_filescript_file_contentss rupdate_executable_sharVs bgll,o>> E E@*//11~233==??@@@@@@@@@@@@@@@@@@s:A66A:=A:c|tjtj||S)a^Update the size of the converted executable files. Positional arguments: temp_dir (str) -- the file path to the temporary directory containing the source package's extracted contents executable (str) -- the executable whose size to update including its file extension Returns: byte size (int) of the executable file )r<r=getsizer>)ru executables rupdate_executable_sizerbs( 7??27<<*== > >>rPc ttj||d5}|}d|dt j|tjtj||d}dddn #1swxYwY|S)aAdd a new path to the paths.json file. When an executable is renamed during a unix to windows conversion, a an exe is also created. The paths.json file is updated with the exe file's information. Positional arguments: executable_directory (str) -- the file path to temporary directory's 'Scripts' directory executable (str) -- the filename of the script to add to paths.json rzScripts/hardlink)_path path_typer size_in_bytesN) r r<r=r>r/rrrr)executable_directoryrrrnew_paths radd_new_windows_pathrps bgll/<>                    OsA>B99B=B=ctj|d}tj|rt |5}t j|}dddn #1swxYwY|dkrp|dD]}|ddrt|dd|d<ng|ddrLt||dd|d<t||d|d<t||d|d <|d d d  d d |d<tj|d }tj |rUtj|D]@}|dr)|dt#||An|dkr|dD] }|ddrt|dd||d<ng|dd rLt||dd|d<t||d|d<t||d|d <|d d d  d d |d<|ddr|d| t |d5}t j||dddddS#1swxYwYdSdS)aUpdate the paths.json file when converting between platforms. Positional arguments: temp_dir (str) -- the file path to the temporary directory containing the source package's extracted contents target_platform (str) -- the platform to target: 'unix' or 'win' zinfo/paths.jsonNr+pathsrrrrrrrrr.exer*r~).batrrorprq)r<r=r>isfiler r,r?r2rrrrrisdirlistdirrrrr\rt)rurv paths_fileryrr=script_directoryscripts rupdate_paths_filersh(9::J w~~j!!0- *   $IdOOE $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ e # #g V V=++E22 $3DM5$I$IDMM']--e44$: $w-%%DM&;8T']%S%SDN,B $w---D)!%W 5 5dC @ @ H HQT U UW !w||Hi@@ w}}-..  j)9::Fv..g--01A6JJ & &g 0 0=++E22 $3DM68$T$TDMM']--i88$: $w-%%DM&;8T']%S%SDN,B $w---D)!%W 5 5dC @ @ H HQT U UW =))*:;;0'N))$/// *c " " -d IeT! , , , , - - - - - - - - - - - - - - - - - -_0-0-s$A11A58A5MM Mctjtj|dS)a%Retrieve the name of the executable to rename. When converting between unix and windows, we need to be careful that the executables are renamed without their file extensions. Positional arguments: executable (str) -- the executable to rename including its file extension r)r<r=rr)rs rretrieve_executable_namers/ 7  BG,,Z88 9 9! <  F) r<r=r>rr r/ bytearrayunionsetrangebool translate) directoryrr buffered_file file_contentstext_characterss rrrs  Y 33I w~~i  D )T " " 5m)..t44M 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5$ % % % + +CdE0B0B,C,Ctf,L M M  M++D/BBCCC 5sA22A69A6ctj||}|dkrtj|t|d}t |5}|}dddn #1swxYwYt |d5}|ddD]}||dz dddn #1swxYwYtj||dS| dr| dd}t |5}|}dddn #1swxYwYt |d5}|d |D]}||dz dddn #1swxYwYtj||dSdS) a-Rename an executable file when converting between platforms. When converting from unix to windows, each file inside the 'bin' directory is renamed to include '-script.py' as a suffix. When converting from windows to unix, each executable inside the 'Scripts' directory has its '-script.py' suffix removed. Positional arguments: directory (str) -- the file path to the 'bin' or 'Scripts' directory executable (str) -- the name of the executable to rename target_platform (str) -- the platform to target: 'unix' or 'win' r+rNror: z.pyrz.#!/opt/anaconda1anaconda2anaconda3/bin/python ) r<r=r>rr r/ splitlineswriterrr) rrrvold_executable_pathnew_executable_pathscript_file_inlinesscript_file_outlines rrename_executablers',,y*==% gll 2:>>JJJ  % & & 7."''))4466E 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7%s + + 3abb  3 3%%dTk2222 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 &(;<<<<<  ' ' . . A"5"="=lB"O"O )** ;n&++--88:: ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;)3// 7?%%J"77D#))$+66667  7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 J*,? @ @ @ @ @ A AsH&'BB B4&C''C+.C+'E66E:=E:3GGGc|dr6tj||}tj|dSdS)aSRemove an executable from the 'Scripts' directory. When converting from windows to unix, the .exe or .bat files need to be removed as they do not exist in unix packages. Positional arguments: directory (str) -- the file path to the 'Scripts' directory executable (str) -- the filename of the executable to remove )rrN)rr<r=r>r\)rrrs rremove_executablersP+,,i44 &rPcjtjt}|dr!tj|d}n tj|d}tj||d}t j||dS)a@Create an exe file for each executable during a unix to windows conversion. Positional arguments: directory (str) -- the file path to the 'Scripts' directory executable (str) -- the filename of the executable to create an exe file for target_platform -- the platform to target: 'win-64' or 'win-32' r'z cli-32.exez cli-64.exerN)r<r=dirname__file__rr>rcopyfile)rrrv exe_directoryexecutable_filerenamed_executable_files rcreate_exe_filer)sGOOH--M%%D',,}lCC',,}lCC gll96I6I6IJJ OO%<=====rPctj|d}t|d5}|D]}|| ddddS#1swxYwYdS)aUpdate the source package's 'has_prefix' file. Each file in the 'bin' or 'Scripts' folder will be written to the 'has_prefix' file located in the package's 'info' directory. Positional arguments: temp_dir (str) -- the file path to the temporary directory containing the source package's extracted contents prefixes (List[str])-- the prefixes to write to 'has_prefix' zinfo/has_prefixzw+N)r<r=r>r r)ruprefixeshas_prefix_file prefix_fileprefixs rupdate_prefix_filer>sgll8->??O ot $ $&  & &F   f % % % % &&&&&&&&&&&&&&&&&&&sAA!Ac D tj|d}t|d5}g}t |D]\}}}tj|| fd|D}t |dD]S}||dddd|rtd|Tt|D]} | | d z d d d d S#1swxYwYd S) afUpdate the source package's 'files' file. The file path to each file that will be in the target archive is written to the 'files' file. Positional arguments: temp_dir (str) -- the file path to the temporary directory containing the source package's extracted contents verbose (bool) -- show output of items that are updated z info/filesrocPg|]"}tj|#Sr<r=r>rVf relative_dirs r z%update_files_file..a)JJJ1lA66JJJrPrrrrz Updating rN) r<r=r>r rrelpathrrrrssortedr) rurx files_filefiles file_pathsdirpathdirnames filenamesrrrs @rupdate_files_filerPsh 55J j#   *% ,0NN 2 2 (GXy7??7H==LJJJJ JJJI-i<< 2 2!!("2"24"="="E"Efc"R"RSSS20h00111 2  ++ * *I KK D( ) ) ) ) * * * * * * * * * * * * * * * * * * *sCDDDc  tj||}tj|stj|tj|tj|}t j|d5}t|D]n\}}} tj || fd| D} | D]7} | tj|| | 8o ddddS#1swxYwYdS)azCreate the converted package's tar file. Positional arguments: file_path (str) -- the file path to the source package's tar file temp_dir (str) -- the file path to the temporary directory containing the source package's extracted contents platform (str) -- the platform to convert to: 'win-64', 'win-32', 'linux-64', 'linux-32', or 'osx-64' zw:bz2cPg|]"}tj|#Srrrs rrz)create_target_archive..rrP)arcnameN) r<r=r>rmakedirsrr r rradd) rrur" output_diroutput_directory destinationtargetr r r rrs @rcreate_target_archiverksw||J99 7==) * *& $%%%',,/1A1A)1L1LMMK k7 + +Ov,0NN O O (GXy7??7H==LJJJJ JJJI% O O 27<<(;;X NNNN O OOOOOOOOOOOOOOOOOOOs'A?D44D8;D8ct|}t||||t||||tj|dS)aConvert package between unix platforms. Positional arguments: file_path (str) -- the file path to the source package's tar file output_dir (str) -- the file path to where to output the converted tar file platform (str) -- the platform to convert to: 'linux-64', 'linux-32', or 'osx-64' dependencies (List[str]) -- the dependencies passed from the command line verbose (bool) -- show output of items that are updated NrOr|rrrrrr"rwrxrus rconvert_between_unix_platformsrQ+955Hh,@@@)XxDDD M(rPct|}t||||t||||tj|dS)aConvert package between windows architectures. Positional arguments: file_path (str) -- the file path to the source package's tar file output_dir (str) -- the file path to where to output the converted tar file platform (str) -- the platform to convert to: 'win-64' or 'win-32' dependencies (List[str]) -- the dependencies passed from the command line verbose (bool) -- show output of items that are updated Nrrs r&convert_between_windows_architechturesrrrPc t|}t}tj|D]}tj||}tj|r5|tjdkrt||d|tj|r6|tjdkrtj|D]} tj tj|| rt|| sy| dsdt|| dt|t| ||dt| tj|d} tj|| t'||||t)||t+|dt-||t/||||t1j|dS) aConvert a package from a unix platform to windows. Positional arguments: file_path (str) -- the file path to the source package's tar file output_dir (str) -- the file path to where to output the converted tar file platform (str) -- the platform to convert to: 'win-64' or 'win-32' dependencies (List[str]) -- the dependencies passed from the command line verbose (bool) -- show output of items that are updated rr+rr z;/opt/anaconda1anaconda2anaconda3 text Scripts/{}-script.py rrvN)rOrr<rr=r>rstripseprrrr2rrrrrrr|rrrrrr rrr"rwrxrurentryrr new_bin_paths rconvert_from_unix_to_windowsr's*+955HuuHH%%00GLL511 7== # # G BF(;(;u(D(D  8UI F F F 7== # # 0 BF(;(;u(D(D*Y//  GNN27<< 6#B#BCC*9f==#--c22 &i???#!#;F#C#CXLLV]]4V<< 7<<)<rrrr2rrrrrrr|rrrrrrr$s rconvert_from_windows_to_unixr)sI&&&*955HuuHH%%00GLL511 7== # # H(:(:  8VY G G G 7== # # 0 Y(>(>*Y//  %i88ARARSVAWAW%i@@@%i888LLHOO4V<< 7<<%88L Jy, / / /h,@@@x***h7777h((()XxDDD M(rPr c ||rYt|} t| dkrtdn| D]} t| tj|s't|dkrtjdtt|dkrF|sDtjdt j|t|\} } } | d| }d|vrgd}|D]+}||kr$td||-|sAtd t j|||| d r| d krt|||||| d r| d krt|||||| d r| d krt|||||| d r| d krt|||||-d S)a9Convert a conda package between different platforms and architectures. Positional arguments: file_path (str) -- the file path to the source package's tar file output_dir (str) -- the file path to where to output the converted tar file show_imports (bool) -- show all C extensions found in the source package platforms (str) -- the platforms to convert to: 'win-64', 'win-32', 'linux-64', 'linux-32', 'osx-64', or 'all' force (bool) -- force conversion of packages that contain C extensions dependencies (List[str]) -- the new dependencies to add to the source package's existing dependencies verbose (bool) -- show output of items that are updated quiet (bool) -- hide all output except warnings and errors dry_run (bool) -- show which conversions will take place rzNo imports found.z?Error: --platform option required for conda package conversion.z[WARNING: Package {} contains C extensions; skipping conversion. Use -f to force conversion.rfall) zosx-64z osx-arm64zlinux-32zlinux-64rgrhrirjrkrlzwin-32zwin-64z win-arm64zQSource platform '{}' and target platform '{}' are identical. Skipping conversion.zConverting {} from {} to {})r)r(r*r+N)rr[rssysexitrr<r=rr6r2rr'r)r)rrr platformsforcerwrxquietdry_runr c_extensionconversion_platformsource_platformr5source_platform_architecturer"s r conda_convertr6s4' 22 w<<1   % & & & && # # k""""  TC NNa// RSSS  + +,,q000  **0&1A1A)1L1L*M*M   :S::6,'6#F#F #F#F     !! 3 3 3 ''-v.JH'U'U      -44G$$Y//1Mx      / 0 0 5HF5R5R *:xw      ' ' ,?6,I,I (:xw     !1 2 2 7Je7S7S (:xw      ' ' ,?5,H,H 2:xw   ?!!rP)F)N)r FNFNFFF))__doc__rrr,r<r rr,r rIpathlibrconda_build.utilsrrrr6rGrOrdr|rrrrrrrrrrrrrrrrrr'r)r6rrPrr:s[  55555555<???4* * * Z   !!!>:::z....8878787v###6 @ @ @ ? ? ?0:-:-:-z = = =6+A+A+A\   >>>*&&&$***6OOO2,,111h,,,b    ccccccrP