dJ dZddlZddlZddlZddlmZddlmZdZ dZ Gdd ej e Z d Ze d Ze d Ze dZe dZe dZe dZe dZe dZe dZe dZe dZe dZe dZe dZeedre dZe dZ e dZ!eedre dZ"eed re d!Z#e d"Z$e d#Z%e d$Z&e d%Z'eed&re d'Z(eed(re d)Z)e d*Z*e d+Z+e d,Z,Gd-d.Z-Gd/d0e Z.Gd1d2e. Z/dQd3Z0dRd4Z1e2d5kr Gd6d7e/Z3Gd8d9e/Z4e4Z5e-e5j6Z7e8d:e7e8d;e9e7e8de7j3e8d?e7j3j<e8d@e7j=e8dAe7j>e8dBe7j?e8dCe7j@e8dDe7jAj@e8dEe7jBjCe7DD]ZZEeFeEe-r5e8dFdGHe8dIeEjGe8dJeEjBjCCe8dKeEjGeEjH[GdLdMe/ZIGdNdOeIZJdPeJj6vsJdSdS)Sz5Classes for describing columns for ``Table`` objects.N)atom)check_name_validityreStructuredTextcBfd}j|_j|_|S)z.newmethodsS  LLL   55 {el*Eyyu/E/EEs  )__name____doc__)r rs` r same_positionrs?FFFFF #+I!)I ceZdZdZiZ edZed dZeddZeddZ eddZ edd Z ed Z fd Z d ZxZS)ColaDefines a non-nested column. Col instances are used as a means to declare the different properties of a non-nested column in a table or nested column. Col classes are descendants of their equivalent Atom classes (see :ref:`AtomClassDescr`), but their instances have an additional _v_pos attribute that is used to decide the position of the column inside its parent table or nested column (see the IsDescription class in :ref:`IsDescriptionClassDescr` for more information on column positions). In the same fashion as Atom, you should use a particular Col descendant class whenever you know the exact type you will need when writing your code. Otherwise, you may use one of the Col.from_*() factory methods. Each factory method inherited from the Atom class is available with the same signature, plus an additional pos parameter (placed in last position) which defaults to None and that may take an integer value. This parameter might be used to specify the position of the column in the table. Besides, there are the next additional factory methods, available only for Col objects. The following parameters are available for most Col-derived constructors. Parameters ---------- itemsize : int For types with a non-fixed size, this sets the size in bytes of individual items in the column. shape : tuple Sets the shape of the column. An integer shape of N is equivalent to the tuple (N,). dflt Sets the default value for the column. pos : int Sets the position of column in table. If unspecified, the position will be randomly selected. cJ|j}|d|dS)zReturn the column class prefix.Nr)rrfind)clscnames rprefixz Col.prefixIs( (ekk%((())rNcn|j}|j}|j|}|d||d|S)z{Create a Col definition from a PyTables atom. An optional position may be specified as the pos argument. pos_offset)r_get_init_args_class_from_prefix)rrrrrkwargscolclasss r from_atomz Col.from_atomPsK$$&&)&1x;C;;F;;;rrcrtj|||}|||S)a Create a `Col` definition from a NumPy scalar type `sctype`. Optional shape, default value and position may be specified as the `shape`, `dflt` and `pos` arguments, respectively. Information in the `sctype` not represented in a `Col` is ignored. r)rAtom from_sctyper$)rsctypeshapedfltrnewatoms rr(zCol.from_sctype]s3)''t<<}}W#}...rcrtj||}||||S)ajCreate a `Col` definition from a NumPy `dtype`. Optional default value and position may be specified as the `dflt` and `pos` arguments, respectively. The `dtype` must have a byte order which is irrelevant or compatible with that of the system. Information in the `dtype` not represented in a `Col` is ignored. r)rr' from_dtyper$)rdtyper+rrr,s rr.zCol.from_dtypeks3)&&ud33}}W#w}???rcrtj|||}|||S)zCreate a `Col` definition from a PyTables `type`. Optional shape, default value and position may be specified as the `shape`, `dflt` and `pos` arguments, respectively. r&)rr' from_typer$)rtyper*r+rr,s rr1z Col.from_typezs3)%%dE488}}W#}...rcttj||||}|||S)a)Create a `Col` definition from a PyTables `kind`. Optional item size, shape, default value and position may be specified as the `itemsize`, `shape`, `dflt` and `pos` arguments, respectively. Bear in mind that not all columns support a default item size. r&)rr' from_kindr$)rkinditemsizer*r+rr,s rr4z Col.from_kinds5)%%dHeTBB}}W#}...rcdz}|j}||vr||SttdzGfdd||_|<S)z-Get a column subclass for the given `prefix`.z%sColz%sAtomceZdZdZfdZejZejZdkrejZdSdS))Col._subclass_from_prefix..NewCola&Defines a non-nested column of a particular type. The constructor accepts the same arguments as the equivalent `Atom` class, plus an additional ``pos`` argument for position information, which is assigned to the `_v_pos` attribute. c|dd}|dd}|j}j|g|Ri||jur!||}||_||_||_dS)Nrr)popr!__init__ __class__rr _v_offset) r argsr"roffsetclass_from_prefixr#NewColatombases rr<z2Col._subclass_from_prefix..NewCol.__init__sjj--It44$($;!!!$8888888>//0?H%-DN! !'rEnumN) r __module__ __qualname__rr<r__eq___is_equal_to_atom_is_equal_to_enumatom)rBrCrsrrBr9s   ( ( ( ( ( (#]8?33F - h.H I I (5 2)4)4%%% rrB)r!getattrrr)rrrrArBrCs ` @@r_subclass_from_prefixzCol._subclass_from_prefixs& 2 % % %$U+ +4F!233" 4" 4" 4" 4" 4" 4" 4" 4" 4S(" 4" 4" 4H $*&! rct}|d}|d}||dz|}|jj}|d|d|jdS)N()rz, pos=)super__repr__indexrindexr=rr )r atomreprlparrparatomargs classnamer=s rrPz Col.__repr__sw77##%%~~c""s##D1HTM*N+ <z&Col._get_init_args..s%GGGc#wtS))GGGr)r*r+r NrrZ)r r"s` rr zCol._get_init_argss:HGGG5FGGGh55u  rNN)rNN)NNN)NrNN)rrErFrr! classmethodrr$r(r.r1r4rKrPr __classcell__)r=s@rrrs6&&P1**[*  < < <[ < / / /[ / @ @ @[ @ / / /[ / / / /[ /00[0d=====rr) metaclassc#fKgd}tjD]}\}}t|dr*|}||?|D])}||*~|gdttdr|dttdr|d|D] }t |}|V!dS) zGenerate all column classes.)IntUIntFloatTimer5) Complex32 Complex64 Complex128Complex192Atom Complex192Complex256Atom Complex256N) ratom_mapitemshasattrappendrvaluesextendrrK) cprefixesr5kdata atomclasscprefixnewclasss r_generate_col_classesrysO100I,,..55 u 5& ! ! 5I   Y--// 0 0 0 0"\\^^ 5 5   !1!1!3!34444 5 ===>>>t%&&'&&&t%&&'&&&,,W55rStringBoolrDrcInt8Int16Int32Int64rdUInt8UInt16UInt32UInt64re Float16AtomFloat16Float32Float64 Float96AtomFloat96 Float128AtomFloat128ComplexrgrhrirjrkrlrmrfTime32Time64c:eZdZdZd dZdZdZd d Zd Zd Z dS) DescriptionaThis class represents descriptions of the structure of tables. An instance of this class is automatically bound to Table (see :ref:`TableClassDescr`) objects when they are created. It provides a browseable representation of the structure of the table, made of non-nested (Col - see :ref:`ColClassDescr`) and nested (Description) columns. Column definitions under a description can be accessed as attributes of it (*natural naming*). For instance, if table.description is a Description instance with a column named col1 under it, the later can be accessed as table.description.col1. If col1 is nested and contains a col2 column, this can be accessed as table.description.col1.col2. Because of natural naming, the names of members start with special prefixes, like in the Group class (see :ref:`GroupClassDescr`). .. rubric:: Description attributes .. attribute:: _v_colobjects A dictionary mapping the names of the columns hanging directly from the associated table or nested column to their respective descriptions (Col - see :ref:`ColClassDescr` or Description - see :ref:`DescriptionClassDescr` instances). .. versionchanged:: 3.0 The *_v_colObjects* attribute has been renamed into *_v_colobjects*. .. attribute:: _v_dflts A dictionary mapping the names of non-nested columns hanging directly from the associated table or nested column to their respective default values. .. attribute:: _v_dtype The NumPy type which reflects the structure of this table or nested column. You can use this as the dtype argument of NumPy array factories. .. attribute:: _v_dtypes A dictionary mapping the names of non-nested columns hanging directly from the associated table or nested column to their respective NumPy types. .. attribute:: _v_is_nested Whether the associated table or nested column contains further nested columns or not. .. attribute:: _v_itemsize The size in bytes of an item in this table or nested column. .. attribute:: _v_name The name of this description group. The name of the root group is '/'. .. attribute:: _v_names A list of the names of the columns hanging directly from the associated table or nested column. The order of the names matches the order of their respective columns in the containing table. .. attribute:: _v_nested_descr A nested list of pairs of (name, format) tuples for all the columns under this table or nested column. You can use this as the dtype and descr arguments of NumPy array factories. .. versionchanged:: 3.0 The *_v_nestedDescr* attribute has been renamed into *_v_nested_descr*. .. attribute:: _v_nested_formats A nested list of the NumPy string formats (and shapes) of all the columns under this table or nested column. You can use this as the formats argument of NumPy array factories. .. versionchanged:: 3.0 The *_v_nestedFormats* attribute has been renamed into *_v_nested_formats*. .. attribute:: _v_nestedlvl The level of the associated table or nested column in the nested datatype. .. attribute:: _v_nested_names A nested list of the names of all the columns under this table or nested column. You can use this as the names argument of NumPy array factories. .. versionchanged:: 3.0 The *_v_nestedNames* attribute has been renamed into *_v_nested_names*. .. attribute:: _v_pathname Pathname of the table or nested column. .. attribute:: _v_pathnames A list of the pathnames of all the columns under this table or nested column (in preorder). If it does not contain nested columns, this is exactly the same as the :attr:`Description._v_names` attribute. .. attribute:: _v_types A dictionary mapping the names of non-nested columns hanging directly from the associated table or nested column to their respective PyTables types. .. attribute:: _v_offsets A list of offsets for all the columns. If the list is empty, means that there are no padding in the data structure. However, the support for offsets is currently limited to flat tables; for nested tables, the potential padding is always removed (exactly the same as in pre-3.5 versions), and this variable is set to empty. .. versionadded:: 3.5 Previous to this version all the compound types were converted internally to 'packed' types, i.e. with no padding between the component types. Starting with 3.5, the holes in native HDF5 types (non-nested) are honored and replicated during dataset and attribute copies. TNcZ |std|j}d|d<g|d<i|d<i|d<i|d<i|d<d |d <g}g}t|d s|d z|d <g}g} g} d } |D]\} } | d r%| |vrt jd| d|n| || <@d}t| ttkr%t| tr| j }nxt| j ttkr"t| j tr| j }n,t| tr| }ntj| } |)ttj||j|} | || <t#| dd}|| | n||| ft#| dd}|| ||| d|D| z}d}d }|D]}|rt)|||}|||<t|t*tfst-d|z||_||_|d z }||d|<|d|||jd<t|t2s|}n|}t|t*r|j|d|<|j|d|<|j|d|<||jjjd d}|||jfR||j |||j!fd}|dup|d}|rltE| d krYtE|tE|kr9tE|tE| kr|s| d} ng|d<||d<|jdkrG|#|$t|drtd| r>|d|| d}|%dd}|||d<tMj|ntMj||d<j'|d<fd j(D|d<dS)!Nz cannot create an empty data type/_v_name_v_names _v_dtypes_v_types_v_dflts _v_colobjectsF _v_is_nested _v_nestedlvlr_v_zCan't set attr z in description class ptparamsr r>cg|]\}}|Srr)r[rnames r z(Description.__init__..s666#t666rrzPassing an incorrect value to a table column. Expected a Col (or subclass) instance and got: "%s". Please make use of the Col(), or descendant, constructor to properly initialize columns.T ALLOW_PADDING _v_offsets_v_nested_formats _v_byteorderzpUsing a ``_v_byteorder`` in the description is obsolete. Use the byteorder parameter in the constructor instead.)namesformatsoffsets _v_itemsizer6_v_dtypec6g|]}j|dSr)fields)r[rr/s rrz(Description.__init__..]s% O O O4d!3A!6 O O Or)) ValueError__dict__rpro startswithwarningswarnr2 IsDescription issubclasscolumnsr= isinstancedictcopyrrrJrqsortrr TypeErrorr _v_parentstrdecoder/r+ recarrtypebaser*rrlen_g_set_nested_names_descr_g_set_path_namesgetnpr6r)r classdict nestedlvlvalidaternewdict nestedFormats nestedDType cols_with_pos cols_no_pos cols_offsets valid_offsetsrdescrrrr@keysnestedkobjectkkbaserecarrtype allow_padding dtype_fieldsr6r/s @rr<zDescription.__init__s A?@@ @-    !     #% "'  w// 4&/!mGN #    '__..* ,* ,MT5u%% 7??MM%)TT44#12222%*GDMGU tM2222um443 %''/u''4 +>+>>>U_m<<? -E4(( ) %(("#DIg$6$68I-5777#IdO%400C{""4(((($$c4[111UK66F!##F+++ 66 666D& & A '#A&&&q\FGAJfsK&899 @!69? !?@@@  FM#F  1HC*0GO $Q ' J  & &q ) ) ))*FOI &a%% XXZZ&#&&  */ $Q')/ #A&)/ #A&$$V%6777!&!3""B #DEEEE$$V%=>>>""B#8999"!D(EH_,E  'L!!A%%D S////D S..../       MM$&GL !(5#$   ! !  * * , , ,  " " $ $ $t^,, O NOOO  *!,'))L{{=$77H#+3 Z(H\**EEH[))E# !&  O O O O5; O O O rcl|j}|j}|dd|_tt |||_t |D]d\}}|j|}t|tr=| ||jf|j|<||jf|j|<d|_ edS)z@Computes the nested names and descriptions for nested datatypes.NT) rr_v_nested_nameslistzip_v_nested_descr enumeraterrrrr)r rfmtsir new_objects rrz%Description._g_set_nested_names_descr_s %$QQQx#Ct$4$455 '' ) )GAt+D1J*k22 )44666+/1K*L$Q'+/1K*L$Q'$(! ) )rcj d}d g}d|_||||f|r~|\}}|d}t|tr[ |j|j|_|||ddf||||fnt|t rU |j|j|_||j|||ddfnt|tsJ||_t|dkrO|j fd|D}| d|dd}| |||dSdS) zCompute the pathnames for arbitrary nested descriptions. This method sets the ``_v_pathname`` and ``_v_pathnames`` attributes of all the elements (both descriptions and columns) in this nested description. c*fdjDS)Nc*g|]}j|Sr)r)r[colname descriptions rrzLDescription._g_set_path_names..get_cols_in_order..zs1999 -g6999r)r)rs`rget_cols_in_orderz8Description._g_set_path_names..get_cols_in_orderys19999#.#7999 9rc|s|S|d|S)Nrr)path1path2s r join_pathsz1Description._g_set_path_names..join_paths}s#  %%e%% %rrrNc(g|]}|Srr)r[pathdescNamers rrz1Description._g_set_path_names..s%LLLt 8T : :LLLrr) _v_pathnamerqr;rrrrr _v_pathnamesrinsertrs) r rstackdesccolsheadcolPaths parentColsrrs @@rrzDescription._g_set_path_namesps 9 9 9 & & && d--d334555" 0JD$7D$ ,, 0$.:d.> #M#M  dDH-... d$5$5d$;$;<====D#&& 0$.:d.> #M#M  DL))) dDH-.... "$,,,,,$(!u::>> $|HLLLLLtLLLHOOAx000!&r1J%%h///E" 0" 0" 0" 0" 0rAllc#K|dvrtd|g}|rk|d}|dvr|V|jD]B}|j|}t |t r||:|dvr|VC|idSdS)a,Iterate over nested columns. If type is 'All' (the default), all column description objects (Col and Description instances) are yielded in top-to-bottom order (preorder). If type is 'Col' or 'Description', only column descriptions of that type are yielded. )rrrz@type can only take the parameters 'All', 'Col' or 'Description'.r)rr)rrN)rr;rrrrrq)r r2rrrrs r_f_walkzDescription._f_walks 4 4 4DEE E )YYq\\F---  ) )#1$7 j+66)LL,,,,~--(((( ) ) ) ) )rcZfdjD}dd|zS)z3Gives a detailed Description column representation.cJg|]}djzd|dj| S)z "z": )rr)r[rr s rrz(Description.__repr__..sP'''t((((!!!T-?-B-BD'''rz{ %s}z, )rjoin)r reps` rrPzDescription.__repr__sF'''' '''W\\#..//rcd|jdS)z)Gives a brief Description representation.z Description(rN)r)r s r__str__zDescription.__str__s6d25555r)rTN)r) rrErFrr<rrrrPrrrrrrsEENvPvPvPvPp)))"I0I0I0X))))800066666rrceZdZdZdZdS)MetaIsDescriptionz?Helper metaclass to return the class variables as a dictionary.c dii}d|vr |d|d<|D]1}d|jvr&|d|jd2|D](}|ds|||d|<)t||||S)z5Return a new class with a "columns" attribute filled.rr__)rupdaterr2__new__)mcsrWbasesrrbrs rrzMetaIsDescription.__new__sb#  ! !!*9!5GI  A AAAJ&& "))!*Y*?@@@ 5 5ALL&& 5(1!  "1%||CE7;;;rN)rrErFrrrrrrrs)II<<<<<=zDstructured arrays with mixed byteorders are not supported yet, sorrybiufSUcrV)rrrz/nested descriptions will be converted to scalarrzXstructured arrays with columns with type description ``%s`` are not supported yet, sorry)rrrr5 byteorderNotImplementedErrorrr.r*rrdescr_from_dtyper r>r) dtype_rr fbyteorderrr/r@r5rcol_s rrr)sPFJ  d+BQB/ vzJ(   #y!111)3444#J 9  ..FF.CCCC S[[U[J66{b   EGGG%ej8DDDFCCJ"CMM%/16788 8t v 1 1 1: ==rct|trt||}nt|ttkr4t |trt|j|}nSt|trt|j|}n't|tstd|z|j}|r|dkr| |}|S)zGet a (nested) NumPy dtype from a description instance and byteorder. The descr parameter can be a Description or IsDescription instance, sub-class of IsDescription or a dictionary. rzinvalid description: %rr ) rrrr2rrrrr newbyteorder)rrrrs rdtype_from_descrrLs%<EH555 u++m,, , , .. -EEGGOh??? E= ) )<EMH=== { + +<2U:;;; ^F0Y#%%$$Y// Mr__main__c:eZdZdZeZeZdS)InforN)rrErFr UInt32ColName Float64ColValuerrrrris)y{{ rrceZdZdZeddddZeddd Ze d Z e dd Z e Z Gd d eZdS)Testz'A description that has several columns.int32rrr&floatrrr+r*r+ ceZdZdZeZedZe ddddZ e dZ Gdd e Zd S) Test.inforrr&r%r&)r+r*rr)ceZdZedddZedZeZ e Z Gdde Z dS) Test.info.info2r%rr&r(r)c~eZdZeZeZedddZ e dZ dS)Test.info.info2.info3r%rr&r(r)N) rrErFrrr valuerr4y4UInt8Colz4rrrinfo3r0sM$9;;D&JLLEwQfEEB!q)))BBBrr5N)rrErFrr4y3r3z3rrr r1rr5rrrinfo2r.s}]]7&]AAX1%%% y{{" *****M*****rr8N)rrErFr rrr r1rr4y2r3z2rr8rrrinfor,xsF9;;DJ1%%%EwQf!DDBq!!!B * * * * * * * * * *rr;N)rrErFrrr1xr4yr3z StringColcolorrrr;rrrr#r#ns55 MM'1aQM / / MM'M 8 8 H!    !#&&&tvv * * * * *= * * * * *rr#z&Description representation (short) ==>z%Description representation (long) ==>zColumn names ==>z Column x ==>zColumn Info ==>zColumn Info.value ==>zNested column names ==>z Defaults ==>zNested Formats ==>zNested Descriptions ==>zNested Descriptions (info) ==>zTotal size ==>z******begin object*************r*)endzname -->z totalsize-->zleaf -->c"eZdZeZdS)testDescParentN)rrErFInt32ColcrrrrCrCs HJJrrCceZdZdS)testDescN)rrErFrrrrGrGs rrGrE)Nr^)Krrrnumpyrrrrr __docformat__rr'r2rryrKr?BoolColEnumColIntColInt8ColInt16ColrDInt64ColUIntColr3 UInt16Colr UInt64ColFloatColrp Float16Col Float32Colr  Float96Col Float128Col ComplexCol Complex32Col Complex64Col Complex128Col Complex192Col Complex256ColTimeCol Time32Col Time64Colrrrrrrrr#klassrrprintreprrr<r!rrrrr;rr6rrrrr/rCrGrrrrds{;; %%%%%%# 9   xxxxx$)txxxxv>  % %h / / # #F + + # #F + + " "5 ) ) # #F + +  $ $W - -  $ $W - -  $ $W - - # #F + +  $ $W - -  % %h / /  % %h / /  % %h / /  $ $W - - 746**955J  & &y 1 1  & &y 1 1  746**955J 74  8++J77K  & &y 1 1 ((55 ((55 )),77  74!""<--l;;M 74!""<--l;;M # #F + +  % %h / /  % %h / / D6D6D6D6D6D6D6D6N<<<<<<<<,*****/****Z > > > >F4 z} *****}***v DFFE ;u} % %D E 2D999 E 144::>>> E dm,,, E.$&!!! E TY''' E !49?333 E $d&:;;; E.$-((( E  6777 E #T%9::: E *DI,EFFF E DM2333,,.. < < :fk * * < E3 = = = = E*fn - - - E.&/": ; ; ; ; E*fnfl ; ; ; ;     >    (" " " " "ML # "r