+d%fddlZddlZddlmZddlmZGddeZGddeZdS)N)islice) DataSourcecleZdZdZdZdZdZ dded ed ed ed ed e de ffd Z dZ dZ dZ xZS)JSONFileSourcez Read JSON files as a single dictionary or list The files can be local or remote. Extra parameters for encoding, etc., go into ``storage_options``. json0.0.1pythonTutf8Nurlpath text_mode text_encoding compressionreadmetadatastorage_optionscbddlm}t|dgz} ||_|pi|_d|_d|_||_||| vrtd|d| |rdnd|_ ||_ ||_ tt|| dS) aD Parameters ---------- urlpath : str Target file. Can include protocol specified (e.g., "s3://"). text_mode : bool Whether to open the file in text mode, recoding binary characters on the fly text_encoding : str If text_mode is True, apply this encoding. UTF* is by far the most common compression : str or None If given, decompress the file with the given codec on load. Can be something like "zip", "gzip", "bz2", or to try to guess from the filename, 'infer' storage_options: dict Options to pass to the file reader backend, including text-specific encoding arguments, and parameters specific to the remote file-system driver, if using. r compressionsinferNCompression value  must be one of rtrbr) fsspec.utilsrlistvalues_urlpath_storage_options _dataframe_filer ValueErrormodeencoding_readsuperr__init__ selfr r r rrrrrVALID_COMPRESSIONS __class__s 7lib/python3.11/site-packages/intake/source/jsonfiles.pyr'zJSONFileSource.__init__s< .-----!,"5"5"7"788G9D / 52 &  i"44 i !gk!g!gSe!g!ghhh%/DD4 %   nd##,,h,?????cddl}||jd}|j|f|j|j|jd|j5}tj |cdddS#1swxYwYdS)Nrr#r$r) fsspec _get_cacheropenr#r$rrrloadr)r0r fs r,rzJSONFileSource.readDs //$-003 V[  ](   #    9Q<<                  s A,,A03A0cdSNr)s r,_load_metadatazJSONFileSource._load_metadataQ r-cdSr7r8r9s r, _get_schemazJSONFileSource._get_schemaTr;r-Tr NTNN)__name__ __module__ __qualname____doc__nameversion containerstrbooldictr'rr:r= __classcell__r+s@r,rrs DGI # $.@.@.@.@ .@  .@  .@.@.@.@.@.@.@.@`              r-rceZdZdZdZdZdZ dded ed ed ed ed e de ffd Z e j dZ dZddefdZdZdZxZS)JSONLinesFileSourcez Read a JSONL (https://jsonlines.org/) file and return a list of objects, each being valid json object (e.g. a dictionary or list) jsonlrr Tr Nr r r rrrrcTddlm}t|dgz} ||_|pi|_d|_d|_||_||| vrtd|d| |rdnd|_ ||_ ||_ t| dS) aE Parameters ---------- urlpath : str Target file. Can include protocol specified (e.g., "s3://"). text_mode : bool Whether to open the file in text mode, recoding binary characters on the fly text_encoding : str If text_mode is True, apply this encoding. UTF* is by far the most common compression : str or None If given, decompress the file with the given codec on load. Can be something like "zip", "gzip", "bz2", or to try to guess from the filename, 'infer'. storage_options: dict Options to pass to the file reader backend, including text-specific encoding arguments, and parameters specific to the remote file-system driver, if using. rrrNrrrrr)rrrrrrr r!rr"r#r$r%r&r'r(s r,r'zJSONLinesFileSource.__init__bs< .-----!,"5"5"7"788G9D / 52 &  i"44 i !gk!g!gSe!g!ghhh%/DD4 %   (+++++r-c#Kddl}||jd}|j|f|j|j|jd|j5}|VddddS#1swxYwYdS)z2 Yields an fsspec.OpenFile object rNr/)r0r1rr2r#r$rrr4s r,_openzJSONLinesFileSource._opens  //$-003 V[  ](   #     GGG                  s AA#&A#c|5}tttj|cdddS#1swxYwYdSr7)rPrmaprloads)r)r5s r,rzJSONLinesFileSource.reads ZZ\\ ,QDJ**++ , , , , , , , , , , , , , , , , , ,s'A  A A dnrowsc |5}tttjt ||cdddS#1swxYwYdS)z> return the first `nrows` lines from the file N)rPrrRrrSr)r)rUr5s r,headzJSONLinesFileSource.headsZZ\\ ;QDJq%(8(899:: ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;s5AAAcdSr7r8r9s r,r:z"JSONLinesFileSource._load_metadatar;r-cdSr7r8r9s r,r=zJSONLinesFileSource._get_schemar;r-r>)rT)r?r@rArBrCrDrErFrGrHr' contextlibcontextmanagerrPrintrWr:r=rIrJs@r,rLrLXs" DGI # $-,-,-,-, -,  -,  -,-,-,-,-,-,-,-,^ ,,,;;#;;;;          r-rL)rZr itertoolsrintake.source.baserrrLr8r-r,r_s ))))))M M M M M ZM M M `Y Y Y Y Y *Y Y Y Y Y r-