d dZddlmZddlmZmZddlZddlmZddl Z ddl Z ddl Z ddl m Z mZmZmZmZmZddlZddlZddlmZddlZddlZddlmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%dd l&m'Z'm(Z)m*Z*m+Z+m,Z,ddl-Z-ddl.Z.dd l/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7dd l8m9Z9dd l:m;Z;dd lddl?m@Z@ddlAmBZBddlCmDZDmEZEmFZFmGZGddlHmIZIddlJmKZKeLe,e*ze+zZMeMNdejOdZPe#de0ZQe jRGddZSe jRGddeeZTdzdZUe%d{d"ZVe%d|d#ZVd}d%ZVd~d(ZWe%ddd,ZXe% ddd-ZX ddd0ZXd1ZYdd3ZZe@eKd4eKd5d z6 ddd>Z[dd@Z\dAdAdAdAdBdCdDdEdFdG Z]eLe]^Z_ddIZ`e@eKd5d zJddLZaddNZbe%d)d)d)d)d)dOddVZce%d)d)d)d)d)d)dWddZZce%d)d)d)d)d)d)dWdd\Zce@eKd5dPzJddd.d]dddWdd^ZcGd_d`eeZdGdadbedZeGdcddedZfGdedfZgGdgdhZhddlZiddmZjddnZke jlddpZm ddduZnddyZodS)zCommon IO api utilities) annotations)ABCabstractmethodN) defaultdict)BufferedIOBaseBytesIO RawIOBaseStringIO TextIOBase TextIOWrapper)Path) IOAnyAnyStr DefaultDictGenericHashableLiteralMappingSequenceTypeVarcastoverload)urljoinurlparse uses_netloc uses_params uses_relative) BaseBufferCompressionDictCompressionOptionsFilePath ReadBuffer ReadCsvBufferStorageOptions WriteBuffer) get_lzma_file)import_optional_dependency)BZ2File)doc)find_stack_level)is_bool is_file_like is_integer is_list_like) MultiIndex) _shared_docsz^[A-Za-z][A-Za-z0-9+\-+.]*:// BaseBufferT)boundcJeZdZUdZded<ded<ded<ded<d Zd ed <d S) IOArgsz? Return value of io/common.py:_get_filepath_or_buffer. str | BaseBufferfilepath_or_bufferstrencodingmoder compressionFbool should_closeN)__name__ __module__ __qualname____doc____annotations__r>L/var/www/html/t/fyr/venv311/lib/python3.11/site-packages/pandas/io/common.pyr6r6SsY)(((MMM III    LrEr6czeZdZUdZded<ded<ejeZded<d Z d ed <ddZ ddZ ddZ dS) IOHandlesau Return value of io/common.py:get_handle Can be used as a context manager. This is used to easily close created buffers and to handle corner cases when TextIOWrapper is inserted. handle: The file handle to be used. created_handles: All file handles that are created by get_handle is_wrapped: Whether a TextIOWrapper needs to be detached. z IO[AnyStr]handler r<)default_factoryzlist[IO[bytes] | IO[str]]created_handlesFr= is_wrappedreturnNonecF|jrmt|jtsJ|j|j|j|j|jD]}|g|_d|_dS)z Close all created buffers. Note: If a TextIOWrapper was inserted, it is flushed and detached to avoid closing the potentially user-created buffer. FN) rL isinstancerIr flushdetachrKremoveclose)selfrIs rFrTzIOHandles.closeus ? 5dk=99 9 9 9 K      K    ' ' 4 4 4*  F LLNNNN!rEIOHandles[AnyStr]c|SNrDrUs rF __enter__zIOHandles.__enter__s rEargsrc.|dSrX)rT)rUr[s rF__exit__zIOHandles.__exit__s rENrMrN)rMrV)r[rrMrN) r?r@rArBrC dataclassesfieldlistrKrLrTrZr]rDrErFrHrH`s      1B1BSW1X1X1XOXXXXJ    "rErHurlobjectrMr=cft|tsdSt|jtvS)z Check to see if a URL has a valid protocol. Parameters ---------- url : str or unicode Returns ------- isurl : bool If `url` has a valid protocol return True otherwise False. F)rPr9 parse_urlscheme _VALID_URLSrbs rFis_urlris/ c3  u S>> K //rEr8r9cdSrXrDr8s rF _expand_userrlCrEcdSrXrDrks rFrlrlrmrEstr | BaseBufferTcnt|trtj|S|S)a] Return the argument with an initial component of ~ or ~user replaced by that user's home directory. Parameters ---------- filepath_or_buffer : object to be converted if possible Returns ------- expanded_filepath_or_buffer : an expanded filepath or the input if not expandable )rPr9ospath expanduserrks rFrlrls4$c**6w!!"4555 rEheaderrNc|dSt|r,tt|}|dkrtddSt |drptt |}t tt|stdtd|DrtddSt|rtdtd) NrzUPassing negative integer to header is invalid. For no header, use header=None insteadF) allow_setsz*header must be integer or list of integersc3"K|] }|dkV dS)rNrD).0is rF z&validate_header_arg..s&%%q1u%%%%%%rEz8cannot specify multi-index header with negative integerszPassing a bool to header is invalid. Use header=None for no header or header=int or list-like of ints to specify the row(s) making up the column names) r.rint ValueErrorr/rallmapanyr, TypeError)rts rFvalidate_header_argrs  ~&c6"" A::9  Fu---h''3z6**++ KIJJ J %%f%%% % % YWXX Xv  4   A B BBrE.r"convert_file_likecdSrXrDr8rs rFstringify_pathrrmrEcdSrXrDrs rFrrs CrEFFilePath | BaseBufferTc|s$t|rtt|St|tjr|}t|S)a Attempt to convert a path-like object to a string. Parameters ---------- filepath_or_buffer : object to be converted Returns ------- str_filepath_or_buffer : maybe a string version of the object Notes ----- Objects supporting the fspath protocol (python 3.6+) are coerced according to its __fspath__ method. Any other object is passed through unchanged, which includes bytes, strings, buffers, or anything else that's not even path-like. )r-rr3rPrqPathLike __fspath__rlrs rFrrse. 5.@!A!A5K!3444$bk22=/::<< * + ++rEc.ddl}|jj|i|S)z` Lazy-import wrapper for stdlib urlopen, as that imports a big chunk of the stdlib. rN)urllib.requestrequesturlopen)r[kwargsurllibs rFrrs*  !6> !4 26 2 22rEFilePath | BaseBufferct|tot|dr.d|vr*t jdt td}t||}d|vr5|dvr1|d vr-t j|d |tt|}d |vr d|vr|dz }t|trt|r|pi}d dl }|j|| }t!|5} | jdd} | dkrddi}t'| } dddn #1swxYwYt+| ||d|St-|rBt|tsJ|dr|dd}|dr|dd}t3d} g} t3dd dlm}m}||t:g} n#t<$rYnwxYw | j|fd|i|pi}nW#tA| $rB|ddi}nt|}d|d<| j|fd|i|pi}YnwxYwt+|||d|S|rtCdt|ttDtFj#fr!t+tI|||d|St|ds1t|ds!dtK|}tC|t+|||d|S)a% If the filepath_or_buffer is a url, translate and return the buffer. Otherwise passthrough. Parameters ---------- filepath_or_buffer : a url, filepath (str, py.path.local or pathlib.Path), or buffer {compression_options} .. versionchanged:: 1.4.0 Zstandard support. encoding : the encoding to use to decode bytes, default is 'utf-8' mode : str, optional {storage_options} .. versionadded:: 1.2.0 ..versionchange:: 1.2.0 Returns the dataclass IOArgs. writebzDcompression has no effect when passing a non-binary object as input.) stacklevelN)methodw)bz2xz)zutf-16zutf-32z( will not write the byte order mark for tr)headerszContent-EncodinggziprT)r8r:r<r>r;zs3a://zs3://zs3n://fsspecbotocore) ClientErrorNoCredentialsErrorr;anonz?storage_options passed with file object or non-fsspec file pathFreadz)Invalid file path or buffer object type: )&rget_compression_methodinfer_compressionhasattrwarningswarnRuntimeWarningr+dictUnicodeWarningrPr9rirrRequestrrgetrrr6rrreplacer(botocore.exceptionsrrPermissionError ImportErroropentupler|bytesmmaprltype)r8r:r<r;rcompression_method fsspec_moderreq_inforeqcontent_encodingreaderrerr_types_to_retry_with_anonrrfile_objmsgs rF_get_filepath_or_bufferrs6D((:;;'=[&I&I# *+=?QRR"g&8'BB"sRV R '))    "{+=>>>K t - / / , , ,  N NH N N '))    K +#["8"8s $c** v6H/I/I */R >))*> +,>??#      "F++/67I7/S/SU$?Q:R:RTToo -     s8"AE55E9<E9#!I II$I;;AKKrrc@ddlm}td||S)z converts an absolute native path to a FILE URL. Parameters ---------- path : a path in native format Returns ------- a valid FILE URL r) pathname2urlzfile:)rrr)rrrs rFfile_path_to_urlrs0,+++++ 7LL.. / //rEtarrrziprzstd) .tar.tar.gz.tar.bz2.tar.xz.gz.bz2.zip.xzz.zst"tuple[str | None, CompressionDict]ct|trHt|} |d}n&#t$r}t d|d}~wwxYwi}|}||fS)a Simplifies a compression argument to a compression method string and a mapping containing additional arguments. Parameters ---------- compression : str or mapping If string, specifies the compression method. If mapping, value at key 'method' specifies compression method. Returns ------- tuple of ({compression method}, Optional[str] {compression arguments}, Dict[str, Any]) Raises ------ ValueError on mapping missing 'method' key rz.If mapping, compression must have key 'method'N)rPrrpopKeyErrorr|)r<compression_argsrerrs rFrrs.+w'') ,, X!1!5!5h!?!?   X X XMNNTW W X( / //s< AAA)r str | Nonect|dS|dkrtt|d}t|tsdStD]0\}}||r|cS1dS|tvr|Sddgttz}d|d|}t|)a/ Get the compression method for filepath_or_buffer. If compression='infer', the inferred compression method is returned. Otherwise, the input compression method is returned unchanged, unless it's invalid, in which case an error is raised. Parameters ---------- filepath_or_buffer : str or file handle File path or object. {compression_options} .. versionchanged:: 1.4.0 Zstandard support. Returns ------- string or None Raises ------ ValueError on invalid compression specified. NinferT)rUnrecognized compression type: z Valid compression types are ) rrPr9extension_to_compressionitemslowerendswith_supported_compressionssortedr|)r8r< extensionvalidrs rFrrs4tg+,>RVWWW,c22 4'?&D&D&F&F # # "I{!''))229== #"""" #t--- dOf%<== =E /+ / /', / / S//rE Path | strc|t|j}|std|ddS)z Check if parent directory of a file exists, raise OSError if it does not Parameters ---------- path: Path or str Path to check parent directory of z1Cannot save file into a non-existent directory: ''N)r parentis_dirOSError)rrrs rFcheck_parent_directoryrMsI$ZZ F ==??VT6TTTUUUVVrE)r:r< memory_maperrorsr path_or_bufris_textLiteral[False]rIOHandles[bytes]cdSrXrDrr;r:r<rrrrs rF get_handler[ CrE)r:r<rrrr Literal[True]IOHandles[str]cdSrXrDrs rFrrjrrE!IOHandles[str] | IOHandles[bytes]cdSrXrDrs rFrryrrETc: |pd}|pd}t||r d|vr|dz }tj|t|trtj|t |||||}|j} t| |\} }} t| t} t|j } | d}d|vr| rtt | |r3|dkr!|j dd |_ n|dkrd|j vr|xj dz c_ |d krKt| trtjd*| |j d | } ntjd*| |j d | } no|d krt#| fd|j i| } nS|dkrt%| |j fi| } | jj dkr| | | j} t-| dkr.| j| } n| st1d|t1d| n|dkr| d|j t| trt5d*d| i| } nt5d*d| i| } t| t4sJd| jj vr| | | j}t-|dkr'| j|d}|J|} n|st1d|t1d|n|dkrt;| |j } ng|dkrMt=d}d|j vrd|jd*i| i}nd|j d*i| i}|j| fd|j i|} nd|}t1|t| trJ| | nnt| trY|j!r(d|j vrt/| |j |j!|d } nt/| |j } | | d }|s7|j d!kr,t| tDrtG| |j!"} n|r|s|st| |j rtI| d#r tI| d$rtI| d%stK| } tM| |j!|d } | | t|jtp|j' }d|j vr5tI| d&s%tQd'tS|jd(| *|j'r6t|jtrJ| |jtW| | ||j )S)+a Get file handle for given path/buffer and mode. Parameters ---------- path_or_buf : str or file handle File path or object. mode : str Mode to open path_or_buf with. encoding : str or None Encoding to use. {compression_options} .. versionchanged:: 1.0.0 May now be a dict with key 'method' as compression mode and other keys as compression options if compression mode is 'zip'. .. versionchanged:: 1.1.0 Passing compression options as keys in dict is now supported for compression modes 'gzip', 'bz2', 'zstd' and 'zip'. .. versionchanged:: 1.4.0 Zstandard support. memory_map : bool, default False See parsers._parser_params for more information. Only used by read_csv. is_text : bool, default True Whether the type of the content passed to the file/buffer is string or bytes. This is not the same as `"b" not in mode`. If a string content is passed to a binary file/buffer, a wrapper is inserted. errors : str, default 'strict' Specifies how encoding and decoding errors are to be handled. See the errors argument for :func:`open` for a full list of options. storage_options: StorageOptions = None Passed to _get_filepath_or_buffer .. versionchanged:: 1.2.0 Returns the dataclass IOHandles rstrictr)r:r<r;rrrrrr2r)filenamer;)fileobjr;rr;rzZero files found in ZIP file z9Multiple files found in ZIP file. Only one file per ZIP: rnamerrNz Zero files found in TAR archive zDMultiple files found in TAR archive. Only one file per TAR archive: r zstandarddctxcctxr)r:rnewlineFrb)r:readablewritableseekablerz1Expected file path name or file-like object, got z type)rIrKrLr<rD),_is_binary_modecodecslookuprPr9 lookup_errorrr8_maybe_memory_maprr<rrr;rrGzipFile_BZ2File _BytesZipFilebufferappendnamelistlenrr| setdefault _BytesTarFilegetnames extractfiler'r(ZstdDecompressorZstdCompressorr:r _BytesIOWrapperr _IOWrapperr r>rrreverserH)rr;r:r<rrrrioargsrIhandlesis_pathr zip_namesfilesfiler open_argsrrLs rFrrsl"7H  xF{D))coo   M(&#$F###% ' F &F #4FJ"G"GFJ%%GF.//"&&x00K $7s6{{+++B &  +--c266FKK F " "s&+'='= KK3 KK & &#&& #' #  ' E ! ![#FFE ! !# '7F}!S((v&&&"M2244 y>>Q&&#]// @@FF"$%R[%R%RSSS$>2;>>)E ! !  ' ' < < <&#&& &GGFG6FGG '"&6fm44 4 4 4fm(((v&&& ..00u::??!=44U1X>>D+++!FF$%U %U%UVVV$B:?BB) D %]__VV[99FFF " "-k::Dfk!!#%:T%:%N%N=M%N%NO #%8T%8%L%L;K%L%LM TY[FFBKAACS// !fc*****v FC  ? /s&+55  FF&&+..FvJ  v{d**z&*/M/M* _      ! %4VV[%I%I  ++ (6:.. (6:.. (  ''F _     v v0# 6 6 M&:M  fk'&&"9"9 :122 : : :    OO 2f7=====v0111  &    rEc<eZdZdZeddZdfd ZxZS)_BufferedWriterz Some objects do not support multiple .write() calls (TarFile and ZipFile). This wrapper writes to the underlying buffer on close. rMrNcdSrXrDrYs rFwrite_to_bufferz_BufferedWriter.write_to_buffers rEcF|jrdS|rI|d|j5|dddn #1swxYwYn|jt dS)Nr)closedgetvalueseekrr,rTsuper)rU __class__s rFrTz_BufferedWriter.closes ;  F ==?? IIaLLL ' '$$&&& ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' K       sAA #A r^)r?r@rArBrr,rT __classcell__r2s@rFr*r*sg    ^           rEr*cBeZdZ ddfd ZddZddZddZxZS)rNrrrr;Literal['r', 'a', 'w', 'x']r-ReadBuffer[bytes] | WriteBuffer[bytes] | None archive_namerMrNc t||_||_t jjd||||d||_dS)N)rr;rrD) r1__init__r8rtarfileTarFiler extend_moder)rUrr;rr8rr2s rFr:z_BytesTarFile.__init__sq ( o* !!$''      rEr9c|dd}|dkr|S|j,t|jj}|dvr|d|dd}|S)Nrr2r)rrr:r)rrr suffix)rUr;r@s rFr=z_BytesTarFile.extend_modesg||C$$ 3;;K 9 $)__+F///---- rEc|jdSt|j}|jdkr|djS|jdvr-|ddjS|jS)z If an explicit archive_name is not given, we still want the file inside the zip file not to be named something.tar, because that causes confusion (GH39465). Nrr2)rrr)rr r@ with_suffixrUrs rFinfer_filenamez_BytesTarFile.infer_filenames} 9 4 ?? ?f $ $''++0 0 _ B B B''++77;;@ @}rEc|jp|pd}tj|}t ||_|j||dS)Nr)r) r8rDr;TarInforr/sizeraddfile)rUr8tarinfos rFr,z_BytesTarFile.write_to_buffersg(JD,?,?,A,AJU /|4444==??++  GT*****rE)NrNN) rrr;r6rr7r8rrMrN)r;r9rMr9rMrr^)r?r@rAr:r=rDr,r3r4s@rFrrs ,/AE#'        *    ++++++++rErc4eZdZ d dfd Zdd Zdd ZxZS)rNr'1FilePath | ReadBuffer[bytes] | WriteBuffer[bytes]r;r9r8rrMrNc t|dd}||_|dt jt j||fi||_dS)Nrr2r<) r1r:rr8rzipfile ZIP_DEFLATEDZipFiler)rUr'r;r8rr2s rFr:z_BytesZipFile.__init__sp ||C$$(-)=>>>odD;;F;; rEct|jjtjt frEt |jj}|jdkr|dj S|j SdS)z If an explicit archive_name is not given, we still want the file inside the zip file not to be named something.zip, because that causes confusion (GH39465). rr2N) rPrrrqrr9r r@rBrrCs rFrDz_BytesZipFile.infer_filenamese dk*R[#,> ? ? !DK011H&((++B//44= trEc|jp|pd}|j||dS)Nr)r8rDrwritestrr/)rUr8s rFr,z_BytesZipFile.write_to_buffersF(JD,?,?,A,AJU  \4==??;;;;;rErX)r'rLr;r9r8rrMrNrJr^)r?r@rAr:rDr,r3r4s@rFrrso $( <<<<<<<"    <<<<<<<rZrEn int | Nonerc |jJ|j||j}|j|z}||dks|t |kr d|_|S|d|}||d|_|S)NrrE)rrencoder:rbr)rUrf bytestringcombined_bytestring to_returns rFrz_BytesIOWrapper.readAs{&&&[%%a((// >> "mj8 9Ac*=&>&>!>!>DM& &+BQB/I/3DM rEN)r)rr`r:r9rMrN)rcr9)re)rfrgrMr)r?r@rAr:rYrrDrErFrr2sZ****       rErrIr7/tuple[str | BaseBuffer, bool, list[BaseBuffer]]c4g}|t|dpt|tz}|s|||fStt|}t|tr%t |d}|| ttj| dtj }t|D]}| n+#t|D]}| wxYw|||gfS)zTry to memory map file/buffer.filenor r)access) rrPr9rr$rrr rro ACCESS_READreversedrT)rIrr#wrappeds rFrrOs/!#G'&(++Fz&#/F/FFJ +z7**- ( (F&#fd##v  I 4+;      w''  F LLNNNN hw''  F LLNNNN  J ))s AC))(Dcd}t|}t|ts|S tj|}n#t tf$rYnwxYw|S)zTest whether file exists.F)rrPr9rqrrexistsrr|)r8rus rF file_existsrvqss F'(:;; (# . .   233 z "     MsA AAcd|vsd|vrd|vStjtjtjf}t t ||rdSt |tpdt|d|vS)z+Whether the handle is opened in binary moderrFr;) r StreamWriter StreamReaderStreamReaderWriter issubclassrrP_get_binary_io_classesrX)rIr; text_classess rFr r s d{{cTkkd{ ! L $v,, --u f466 7 7 3'CC<rEtuple[type, ...]cttf}tdd}|R|d5}|t |fz }dddn #1swxYwY|S)z!IO classes that that expect bytesrignore)rNrE)rr r(r stream_readerr)binary_classesrrs rFr|r|s)7 'BN &k( C C CD   " " $ $ 2 23 7 7 .6 tF||o -N . . . . . . . . . . . . . . . s A))A-0A-columnsSequence[Hashable] | MultiIndex index_colbool | Sequence[int] | Nonecttrgtt|o0t|t ot fd|DS)a Check whether or not the `columns` parameter could be converted into a MultiIndex. Parameters ---------- columns : array-like Object which may or may not be convertible into a MultiIndex index_col : None, bool or list, optional Column or columns to use as the (possibly hierarchical) index Returns ------- bool : Whether or not columns could become a MultiIndex Nc3dK|]*}|tvt|tV+dSrX)rarPr)rxcrs rFrzz+is_potential_multi_index..s=RR$y//9Q9Q 1e$$9Q9Q9Q9QRRrE)rPr=rr0r})rrs `rFis_potential_multi_indexrsv&Jy$77  G  S7J// / S RRRRgRRR R R  rEnamesSequence[Hashable]is_potential_multiindexcLt|}tt}t|D]p\}}||}|dkrP|dz||<|r1t |t sJ|dd|dd|fz}n|d|}||}|dkP|||<|dz||<q|S)a: Rename column names if duplicates exist. Currently the renaming is done by appending a period and an autonumeric, but a custom pattern may be supported in the future. Examples -------- >>> dedup_names(["x", "y", "x", "x"], is_potential_multiindex=False) ['x', 'y', 'x.1', 'x.2'] rrNre.)rarr{ enumeraterPr)rrcountsrycol cur_counts rF dedup_namesrs KKE)4S)9)9FE""$$33K !mm#a-F3K& +!#u-----#2#hSW":":y":":!<<**y**s I!mma!ms LrE)rbrcrMr=)r8r9rMr9)r8r3rMr3)r8rorMro)rtrcrMrN).)r8r"rr=rMr9)r8r3rr=rMr3)F)r8rrr=rMro)rbrrMr=)rNrN) r8rr:r9r<r!r;r9rr%rMr6)rrr9rMr9)r<r!rMr)r8rr<rrMr)rrrrMrN)rrr;r9r:rr<r!rr=rrrrrr%rMr)rrr;r9r:rr<r!rr=rrrrrr%rMr)rrr;r9r:rr<r!rr=rr=rrrr%rMr)rIr7rr=rMrm)r8rrMr=)rIrr;r9rMr=)rMr~rX)rrrrrMr=)rrrr=rMr)prB __future__rabcrrr collectionsrr_ functoolsriorrr r r r rrqpathlibr rer;typingrrrrrrrrrrrr urllib.parserrrerrrrrNpandas._typingrr r!r"r#r$r%r& pandas.compatr'pandas.compat._optionalr(pandas.compat.compressorsr)rpandas.util._decoratorsr*pandas.util._exceptionsr+pandas.core.dtypes.commonr,r-r.r/pandas.core.indexes.apir0pandas.core.shared_docsr1setrgdiscardcompilerr3 dataclassr6rHrirlrrrrrrrvaluesrrrrrr*rrr rrrvr  lru_cacher|rrrDrErFrs"""""" ######                                                   ('''''>>>>>>999999''''''444444/.....000000c-+- ;<< BBJ?@@gm:666           ))))))))X0000$    &CCCC:   ?B $,,,,,D333     !23$%:;>RR &*&* oooo od0000&        #6==??@@ 0 0 0 0F&;