HR-e(dZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z ddl Z ddl mZddlmZddlmZddlmZdd lmZmZmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#dd l$m%Z%m&Z&gZ'd a(dd Z)dZ*d dZ+dZ,dZ-dZ.dZ/d!dZ0ej1e0_dZ2dZ3dZ4dZ5dZ6d"dZ7 d#dddZ8ej9e8_dZ:dS)$zAn extensible ASCII table reader and writer. ui.py: Provides the main user functions for reading and writing tables. :Copyright: Smithsonian Astrophysical Observatory (2010) :Author: Tom Aldcroft (aldcroft@head.cfa.harvard.edu) N)StringIO)Table)get_readable_fileobj)AstropyWarning)NOT_OVERWRITING_MSG)basiccdscorecparserdaophotecsv fastbasic fixedwidthhtmlipaclatexmrtrst sextractor)READ_KWARG_TYPESWRITE_KWARG_TYPEST順c4tts dddd}tD],\}}|t|z }||krd|dzn-tjn#t$rYnwxYwttrd|tj dtj tj zrdStj dddtj r>tj tj rdStj dtj tj zrdSt!fd d DrdSd S) zo Determine if ``table`` probably contains HTML content. See PR #3693 and issue #3691 for context. rNrz+( http[s]? | ftp | file ) :// .+ \.htm[l]?$Tz \.htm[l]?$z\s* ]* >N)research IGNORECASEVERBOSE).0elementtables 3lib/python3.11/site-packages/astropy/io/ascii/ui.py z!_probably_html..bsZ   I11115"-"*:T U U      )r#trtdF) isinstancestr enumeratelenoslinesepjoin Exceptionrmatchrr rpathexists expanduserall)r#maxcharssizeilines` r$_probably_htmlr:5s eS ! !  !HH "1"IID$U++  4D !(??!'AE'NEE#JOOE**EE    D %ixi  8 :  MBJ &    4 9]E"##J > > 27>> G  u % %D D  4 82E2=2:;U V V 4     0      4 5sA/B BBc |adS)z Set the default value of the ``guess`` parameter for read(). Parameters ---------- guess : bool New default ``guess`` value (e.g., True or False) N)_GUESS)guesss r$ set_guessr>ks FFFr&c |4t|}|ddkr tj}n tj}t j|f||d|}|S)a Initialize a table reader allowing for common customizations. Most of the default behavior for various parameters is determined by the Reader class. Parameters ---------- Reader : `~astropy.io.ascii.BaseReader` Reader class (DEPRECATED). Default is :class:`Basic`. Inputter : `~astropy.io.ascii.BaseInputter` Inputter class Outputter : `~astropy.io.ascii.BaseOutputter` Outputter class delimiter : str Column delimiter string comment : str Regular expression defining a comment line in table quotechar : str One-character string to quote fields containing special characters header_start : int Line index for the header line not counting comment or blank lines. A line with only whitespace is considered blank. data_start : int Line index for the start of data not counting comment or blank lines. A line with only whitespace is considered blank. data_end : int Line index for the end of data not counting comment or blank lines. This value can be negative to count from the end. converters : dict Dict of converters. data_Splitter : `~astropy.io.ascii.BaseSplitter` Splitter class to split data columns. header_Splitter : `~astropy.io.ascii.BaseSplitter` Splitter class to split header columns. names : list List of names corresponding to each data column. include_names : list, optional List of names to include in output. exclude_names : list List of names to exclude from output (applied after ``include_names``). fill_values : tuple, list of tuple Specification of fill values for bad or missing table values. fill_include_names : list List of names to include in fill_values. fill_exclude_names : list List of names to exclude from fill_values (applied after ``fill_include_names``). Returns ------- reader : `~astropy.io.ascii.BaseReader` subclass ASCII format reader instance Nenableforce)Inputter Outputter)_get_fast_reader_dictr FastBasicr Basicr _get_reader)ReaderrBrCkwargs fast_readerreaders r$ get_readerrLys]l~+F33 x G + +(FF[F  f Wx9 W WPV W WF Mr&c||td|d|[|tjvrtj|}n:td|t tj|S)NzCannot supply both format and z keywordsz(ASCII format {!r} not in allowed list {}) ValueErrorr FORMAT_CLASSESformatsorted)rP ReaderWriterlabels r$_get_format_classrTs l6J%JJJKKK  T( ( (.v6LL:AAF4#677  r&ctj|dd}t|tr|ddnd|i}|S)zpConvert 'fast_reader' key in kwargs into a dict if not already and make sure 'enable' key is available. rJTr@rA)copydeepcopygetr)dict setdefault)rIrJs r$rDrDs\- =$ ? ?@@K+t$$.x1111- r&c Fd|dkrtnt}|D]r\}||vs ||}|d|d|dtd}t |t s|f}t fd|Dst|sdS) z:Validate types of keyword arg inputs to read() or write().c|dkr6t|t ot|tjj}n.is_ducktypes +  S)))Wjko>V.W.WBBC%%B !c#hhG"c>>>>>BB!BBB sA'' A65A6readNz () argument 'z ' must be a z object, got z insteadc30K|]}|VdSN)r!rardr`s r$r%z._validate_read_write_kwargs..s/::S;;sC((::::::r&)rritemstyper)tupleany TypeError) read_writerI kwarg_typesargtypeserr_msgrdr`s @@r$_validate_read_write_kwargsrss .'1F&:&:""@QKLLNN%%S k ! !S[ C  7 7 7 7 7 7#'99 7 7 7  %'' HE:::::E::::: %G$$ $ %%%%r&ct|tttjfr_t|tod|vpd|v}|s@tj|}tj|r|}|S)N  )r)r*bytesr-PathLiker2r4r3)argument is_str_dataex_users r$_expand_user_if_pathr| s(S%566 # !3// H  0 0  #g((22Gw~~g&& #" Or&c d}tdd=tj|}tdi|t |}||d<|dr"|dr t |fi|Sd|vrdg|d<d|vrd|d<|d }tj|}tj||d<t||d d }| ||d <|j}d |vr|d =|t}|rt||d <d |vr|d } t|}t||5} | }dddn #1swxYwYtjd|s|t jz}|d st||d <n#t$$rt&$rYnwxYwt)||||}|d}|s|t+di|} | j}t|}|drFd|t,jvr4tj|} t,jd|| d <t+di| } | |}ttj| | jddn#t,jt6jt:f$r} |ddkrt-jd| jd| t+di|} | |}ttj|| jddYd} ~ n^d} ~ wwxYwt+di|} | |}ttj|| jdd|t?d|S)NrerJr@ chunk_size fill_values)0rCFrPrH guess_htmlreadmeencodingrz[\r\n]fast_z&Success with fast reader (no guessing)rIrHstatusrAz fast reader z exception: z>Success with slow reader after failing with fast (no guessing)z1Success with specified Reader class (no guessing)zPread() function failed due to code logic error, please report this bug on github)rerh) _read_tracerVrWrsrDrX_read_in_chunksrT _format_namer<r:r|rrerrr-r.rNr0_guessrLr FAST_CLASSESappend __class__ParameterErrorr CParserErrorUnicodeEncodeErrorInconsistentTableError RuntimeError)r#r=rIdatrJrP new_kwargsrHrfileobjrK fast_kwargsfast_reader_rdrerrs r$reres C AAA]6 " "F11&111(//K'F=80!>!>0u/////F""!* } v % H ZZ ! !Fv&&J M+66F=vvzz(';';X F FF % 8$: x  } - $2%#8#8 <  : % %zz*--H E,U33)%(CCC+w#LLNNE+++++++++++++++yE22/!BJ.E ",/E/=e/D/DJ|,#       *UJ << ;E 7 >--*--F(F$U++ x - %5V%5%59J%J%J- 33K$($56Ff6F6F$GK !(77;77O %**511"""&- "<"<"1";"J#$"    x(G335S'@SScSS$11j11kk%(("""&- ";";"("27          0 --*--F++e$$C   "mJ77$.Q    { /   JsP. F9E/# F9/E33F96E37F99GG$A J00!MBMMc n g}t|}|drF|Dd|tjvr3tj|}tjd||d<|g|z}nd}g}|d}|D]R}|ddurg|dtjvrAttj||dj ddd d d t|dd krg|dtjvrAttj||dj d dd d d d} | D]7\} } | |vrtj| || <!| || kr ||krd} n8| s9||vr||Tt|dkrdStj ttttjtjt$jf} |D]*}t)j} d|vrd|d<t+d!i|}d|_||}ttj||j dt)j| z dzd d d |cS#| $r}ttj||j jdt3|t)j| z dzd d d||Yd}~$d}~wwxYw t+d!i|}||}ttj||j dd|S#| $r}ttj||j jdt3|d||dg}|D]֊t5dt5D}t7dt8j}dt=jd| dzg}fd|D}|!d|D|d"|gd}|!|tj d "|dd}~wwxYw)"a1 Try to read the table using various sets of keyword args. Start with the standard guess list and filter to make it unique and consistent with user-supplied read keyword args. Finally, if none of those work then try the original user-supplied keyword args. Parameters ---------- table : str, file-like, list Input table as a file name, file-like object, list of strings, or single newline-separated string. read_kwargs : dict Keyword arguments from user to be supplied to reader format : str Table format fast_reader : dict Options for the C engine fast reader. See read() function for details. Returns ------- dat : `~astropy.table.Table` or None Output table or None if only one guess format was available r@NrrHrJFz/Disabled: reader only available in fast versiongz.3fz ms)rIrHrdtrAz-Disabled: no fast version of reader availableTr strict_nameszSuccess (guessing)i: )rIrrz.us6%%:Q1Q1QA1Q1Q1Q1Q%%r&zReader:z \.(\w+)'>c3,K|]}||fVdSrgrh)r!keyrIs r$r%z_guess..zs, K K#vc{!3 K K K K K Kr&c"g|] \}}|d| S)rrh)r!rr`s r$ z_guess..{s*!R!R!RSS"3"3C"3"3!R!R!Rr& ) rH************************************************************************zH** ERROR: Unable to guess table format with the guesses listed above. **zH** **zH** To figure out why the table did not read, use guess=False and **zH** fast_reader=False, along with any appropriate arguments to read(). **zH** In particular specify the format and any known attributes like the **zH** delimiter. **rrurh)#_get_guess_kwargs_listr rrVrWrXvaluesrrrrir,rrNrmAttributeErrorOptionalTableImportErrorrr rtimerLguessingre__name__r*rQreprr rFrrgroupextendr/)r# read_kwargsrPrJ failed_kwargsfull_list_guessrfiltered_guess_kwargs guess_kwargsguess_kwargs_okrr`guess_exception_classest0rKrrlines sorted_keys reader_repr keys_vals kwargs_sortedmsgrIs @r$rrs2M-[99O H    F   1 1 1mK00 $ 12B&2B2B C H&-/9 //-00K'1717   !U * *X&$*;*B*B*D*DDD   "mL99*84>O ////       !W , ,X&d.?.F.F.H.HHH   "mL99*84>M ////     #))++  HC,&&$(M#$6$6 S!! S)))lk.I.I"'   4 4 4 ! ( ( 6 6 6  !!Q&&t # % .OJOJ Y[[ /{**/3 ^,//,//F"FO++e$$C   "mL99$.2"ikkB.$6????    JJJ& / / /   "mL99!$!7EE3s88EE"ikkB.$6????      . . . . . . . . // J..+..F++e$$C   "mK88$.V    J&! J! J! J   "mK88!$!7EE3s88EE      - - -VE( 2 2$%%%f~~%%% #6::h #D#DEE &<)M)M)S)STU)V)VVW K K K K{ K K K   !R!RM!R!R!RSSS SXXi001111   C LL   -dii.>.>??T IC! Js4>BKM Az#_read_in_chunks..s&EEEc#(--//EEEr&)SU)dtypec g|] }| Srhrh)r!rout_colss r$rz#_read_in_chunks..s9994999r&)namesmetarV)r_read_in_chunks_generatornextmaskeditercolscolumnsrirrkindnparraytolistma concatenatecolnamesrr)r#rIrJr~r tbl_chunkstbl0r str_kindstblrrcol1col2routrs @r$rrs 'K..J!oo&7??O#K *5*GGGGJ   D [FFET]]__EEEHI77#***,, 7 7ID#"$$Dz)++ y0P0Px TZ_EEEI--$*/2R2Rx TZ_EEE06I"%++2>K([$66HTNN# 7(:9994=999H ..TYU. S SC Jr&c+.Ktjdd}t|trd|vsd|vrt |}|}n*t |drt |dr|}nt }d|dd <d }d }d}|||d  5} ||} t| |k} | rtj d | sntt| dz ddD]} | s | | dkrntd||z| d| dzz} | | dzd}t| fddi|} |r| jd}d}| V| rnddddS#1swxYwYdS)zk For fast_reader read the ``table`` in chunks and return a generator of tables for each chunk. Nc3K|VdS)zyStub for get_readable_fileobj, which does not seem to work in Py3 for input file-like object, see #6460. Nrh)rrs r$passthrough_fileobjz6_read_in_chunks_generator..passthrough_fileobjs  r&rurvreseekTrJreturn_header_charsrrrz\Srz1no newline found in chunk (chunk_size too small?)r=F"__ascii_fast_reader_header_chars__rg) contextlibcontextmanagerr)r*rhasattrrrXrer,rrrangerNrr)r#r~rIrfileobj_contextheaderprev_chunk_chars first_chunkfhchunk final_chunkidxcomplete_chunkrs r$rrs` %/45==DEMM-   /GE6$:$:/-/48F=/0 FK J)?)? @ @ @#B" GGJ''Ee**z1K 29UE#:#: SZZ!^R44 V V%*"4"4E#5!!TUUU%'77537;KKN$S1WYY/ ~==U=f==C  $&JKK# III E" ##################s#CF  FF)rcommentrformatsr include_names exclude_namesstrip_whitespacec | tj}d|vrd|d<tj||fi|}t |tjt jfr8t |ddtstd|S)aE Initialize a table writer allowing for common customizations. Most of the default behavior for various parameters is determined by the Writer class. Parameters ---------- Writer : ``Writer`` Writer class (DEPRECATED). Defaults to :class:`Basic`. delimiter : str Column delimiter string comment : str String defining a comment line in table quotechar : str One-character string to quote fields containing special characters formats : dict Dictionary of format specifiers or formatting functions strip_whitespace : bool Strip surrounding whitespace from column values. names : list List of names corresponding to each data column include_names : list List of names to include in output. exclude_names : list List of names to exclude from output (applied after ``include_names``) fast_writer : bool Whether to use the fast Cython writer. Returns ------- writer : `~astropy.io.ascii.BaseReader` subclass ASCII format writer instance NrTrrzfor the commented_header writer you must supply a string value for the `comment` keyword. In order to disable writing table comments use `del t.meta['comments']` prior to writing.) r rFr _get_writerr)rrrrXr*rN)Writer fast_writerrIwriters r$ get_writerrasB~''%)!"  fk < ##F++ >RW__V44 >-4V<<== = ~ JJw  E%6U??e5u555 2A2Y^^  F% 7 ?## ?##  !Ir!:!:;;c&/>R>RR   V233      vvx 8 8F  Iv; I I& I IF d/// UF### LL  EZ__U # #F 67 # # ! fc2... V RZ     V RZ     r&c4tjtS)a Return a traceback of the attempted read formats for the last call to `~astropy.io.ascii.read` where guessing was enabled. This is primarily for debugging. The return value is a list of dicts, where each dict includes the keyword args ``kwargs`` used in the read call and the returned ``status``. Returns ------- trace : list of dict Ordered list of format guesses and status )rVrWrrhr&r$get_read_tracer1s = % %%r&)r)NNNrg)NT)NNNT);__doc__r]rrVr-rr#rr'iornumpyr astropy.tablerastropy.utils.datarastropy.utils.exceptionsrastropy.utils.miscrrr r r r r rrrrrrrrrdocsrrrr<r:r>rLrTrDrsr|reREAD_DOCSTRINGrrrrextra_writer_parsrrWRITE_DOCSTRINGr1rhr&r$r=s 333333333333222222 65555555  3333l   ????D      /%/%/%d"aaaaH" IJIJIJXMMM`...bDDDN 6666v    J!J!J!J!J!J!Z$ &&&&&r&