:vj}T2dZddlmZddlZddlZddlZddlZddlmZm Z ddl m Z ddl m Z ddlZddlmZddlmZdd lmZmZdd lmZdd lmZdd lmZmZmZd ZdZddZ ddZ!dZ"dZ#e ddZ$e ddZ%GddeeZ&Gdde&Z'y)z9 Utilities for file-based Contents/Checkpoints managers. ) annotationsN) decodebytes encodebytes)contextmanager)partial)run_sync) HTTPError)BoolEnum) Configurable)LoggingConfigurable)ApiPath to_api_path to_os_pathc0tj||y)zreplace dst with srcN)osreplacesrcdsts x/workspace/moltex-experiments/.pixi/envs/default/lib/python3.12/site-packages/jupyter_server/services/contents/fileio.py replace_filersJJsCcVKttj||d{y7w)z#replace dst with src asynchronouslyN)rrrrs rasync_replace_filer s 2::sC (((s )')cxtj|tj}|sstj|tj} tj |tj |tj|tj}|s1|r|jd|ttjd|tj|| tj||y#tj |wxYw#t$r|r|jd|dYyYywxYw)zZcopy src to dst like shutil.copy2, but log errors in copystat instead of raising Source file, %s, is not writableFile is not writable: copystat on %s failedTexc_infoN)raccessW_OKopenO_RDONLYfsyncclosedebugPermissionErrorerrnoEACCESshutilcopyfilecopystatOSError)rrlog is_writablefds r copy2_safer3%s ))C)K WWS"++ &  HHRL HHRLiiRWW-    II8# >ell.DSE,JKK OOCCS! HHRL C  II-sTI B Cs C;$D;DD98D9cKtj|tjs1|r|jd|t t j d|ttj||d{ ttj||d{y7)7#t$r|r|jd|dYyYywxYww)zicopy src to dst asynchronously like shutil.copy2, but log errors in copystat instead of raising rrNrTr ) rr"r#r(r)r*r+rr,r-r.r/)rrr0s rasync_copy2_safer5Fs 99S"'' "  II8# >ell.DSE,JKK 6??C ---CvS111.1 C  II-sTI B CsHA4C 6B 7C <B$B"B$C "B$$CC CC ctjj|\}}tjj|d|zS)ztName of the intermediate file used in atomic writes. The .~ prefix will make Dropbox ignore the temporary file.z.~rpathsplitjoinr8dirnamebasenames rpath_to_intermediater>Xs4 d+GX 77<< 11rctjj|\}}tjj||dzS)zEName of invalid file after a failed atomic write and subsequent read.z.invalidr7r;s rpath_to_invalidr@`s3 d+GX 77<<J!6 77rc+Ktjj|rPtjjtjj |tj |}tjj |xstj }tjj|rtj|tjs_tj|tjr;|rdnd}|rt||fd|i|}n t||fi|} ||jyt|}tjj|rt||||r"|jddt|dfd|i|}n t|dfi|} ||j#tj$|j'|jtjj|rtj(|yy#|jwxYw#t$r|jt!||wxYww)aContext manager to write to a file only if the entire write is successful. This works by copying the previous file contents to a temporary file in the same directory, and renaming that file back to the target if the context exits with an error. If the context is successful, the new data is synced to disk and the temporary file is removed. Parameters ---------- path : str The target file to write to. text : bool, optional Whether to open the file in text mode (i.e. to write unicode). Default is True. encoding : str, optional The encoding to use for files opened in text mode. Default is UTF-8. **kwargs Passed to :func:`io.open`. wwbencodingNr0newline )rr8islinkr:r<readlinkgetcwdisfiler"r#r$r'r>r3 setdefault BaseExceptionrflushr&filenoremove) r8textrDr0kwargsdirpathmodefileobjtmp_paths ratomic_writingrWfs0 ww~~dww||BGGOOD12;;t3DEggood#2ryy{G ww~~dBIIgrww$?BIIdTVT[T[D\s 4CCFCG400G M MMO#D)H ww~~d4s+ )T*tS>8>v>tT,V,  MMOHHW^^  MMO ww~~h ( ; MMO"  Xt$ s8D1I/4H08A:I/3I7A9I/0II/'I,,I/c+Ktjj|rPtjjtjj |tj |}|r"|j ddt|dfd|i|}n t|dfi|} ||jy#t$r|jwxYww)aContext manager to write file without doing atomic writing (for weird filesystem eg: nfs). Parameters ---------- path : str The target file to write to. text : bool, optional Whether to open the file in text mode (i.e. to write unicode). Default is True. encoding : str, optional The encoding to use for files opened in text mode. Default is UTF-8. **kwargs Passed to :func:`io.open`. rFrGrBrDrCN) rr8rHr:r<rIrLr$rMr')r8rQrDr0rRrUs r_simple_writingrYs( ww~~dww||BGGOOD12;;t3DE )T*tS>8>v>tT,V,  MMO   sB!C$B9(C9CCceZdZdZedddZeejdddZ e dZ e d Z e dd Z d Zd Z d ddZddZddZ d ddZdZy )FileManagerMixina Mixin for ContentsAPI classes that interact with the filesystem. Provides facilities for reading, writing, and copying files. Shared by FileContentsManager and FileCheckpoints. Note ---- Classes using this mixin must provide the following attributes: root_dir : unicode A directory against against which API-style paths are to be resolved. log : logging.Logger TaBy default notebooks are saved on disk on a temporary file and then if successfully written, it replaces the old ones. This procedure, namely 'atomic_writing', causes some bugs on file system without operation order enforcement (like some networked fs). If set to False, the new notebook is written directly on the old one which could fail (eg: full filesystem or quota ))confighelpsha256z:Hash algorithm to use for file content, support by hashlib) default_valuer\r]c/K|j|5t|g|i|5}|ddddddy#1swYxYw#1swYyxYww)z=%W>t>v>!G? ' &>=?> ' &sKB+B A2B A>!B ) B2A; 7B >B B  BBc#K dy#t$rk}|jtjtjhvr9|s|jxsd}t ||j }tdd|z|d}~wwxYww)z7context manager for turning permission errors into 403.Nz unknown file)rootizPermission denied: %s)r/r*EPERMr+filenamerroot_dirr )rcrder8s rrazFileManagerMixin.perm_to_403 sq   ww5;; 55jj:NG"7?%?T I Js1D E(ENc|j|d|} tj|d||}|r||dfS|S#t$r }|}Yd}~nd}~wwxYwt |} |j rt jj| stdd|d |t|} t|| t| ||j|||| S) Read a notebook from an os path.rQ)rawr as_versioncapture_validation_errorNUnreadable Notebook:  rr~) _read_filenbformatreads Exceptionr>rhrr8existsr r@r_read_notebook rcrdrrr~answernbrne_origrV invalid_files rrzFileManagerMixin._read_notebookKs&c: q %)AB '*Bq ? 1r 1 F  (0&&bggnnX.F'y&<  'w/ Wl+Xw'"" Z:RX[#  s#<< AA  Ac|j|d5}tj||tj|dddy#1swYyxYwzSave a notebook to an os_path.utf-8)rD)versionrN)rWrwrite NO_CONVERTrcrdrrrfs r_save_notebookzFileManagerMixin._save_notebookosA  7 ;q NN ++)A  < ; ;s (AAc|j}tj|}|j||j |dS)a^Compute the hash hexdigest for the provided bytes. The hash algorithm is provided by the `hash_algorithm` attribute. Parameters ---------- byte_content : bytes The bytes to hash Returns ------- A dictionary to be appended to a model {"hash": str, "hash_algorithm": str}. )hashhash_algorithm)rhashlibnewupdate hexdigest)rc byte_content algorithmhs r _get_hashzFileManagerMixin._get_hashys:'' KK "  CCrctjj|stdd|z|j |d5}|j }ddd|dk(r |rd|fSdfS||dk(r* |rj dd|fSj ddfS|rtj d d |fStj d d fS#1swYxYw#t$r!}|dk(rtdd|zd |Yd}~ld}~wwxYw aRead a non-notebook file. Parameters ---------- os_path: str The path to be read. format: str If 'text', the contents will be decoded as UTF-8. If 'base64', the raw bytes contents will be encoded as base64. If 'byte', the raw bytes contents will be returned. If not specified, try to decode as UTF-8, and fall back to base64 raw: bool [Optional] If True, will return as third argument the raw bytes content Returns ------- (content, format, byte_content) It returns the content in the given format as well as the raw byte content. rzCannot read non-file %srbNbyterQutf8z%s is not UTF-8 encodedz bad format)reasonasciibase64) rr8rKr r$readdecode UnicodeErrorrrcrdformatr~rfbcontentrns rrzFileManagerMixin._read_filesD,ww~~g&C!:W!DE E YYw %vvxH& V 36Hfh/ NXvVv- __V,fh?!/" " ) )' 2Hh G H%,,W5 5& %&  V##1G;+ $ s*C2C"C"C" D +DD cF|dvr tdd |dk(r|jd}n|jd}t|}|j |d 5}|j |d d d y #t$r}tdd|d||d }~wwxYw#1swYy xYw zSave content of a generic file.>rQrrz:Must specify format of file contents as 'text' or 'base64'rQrrzEncoding error saving z: NF)rQ)r encoderrrWrrcrdcontentrr b64_bytesrnrfs r _save_filezFileManagerMixin._save_files + +L  Q">>&1#NN73 &y1 u 5 GGH 6 5 QC#9'"QC!HIq P Q6 5s#3A3B3 B<BBB )NFr~boolN)rbytesreturnzdict[str, str]Frdstrrz str | Noner~rrz8tuple[str | bytes, str] | tuple[str | bytes, str, bytes])__name__ __module__ __qualname____doc__r rhr ralgorithms_availablerrr$rWrarsr{rrrrrrrr[r[s" $$ I N    ,'TQV" IM" HD(=B: : $.: 59: A: xrr[cLeZdZdZdZ d d dZd dZ d d dZdZy) AsyncFileManagerMixinzY Mixin for ContentsAPI classes that interact with the filesystem asynchronously. cPKt|||jd{y7wrp)r5r0rqs rrszAsyncFileManagerMixin._copys sDdhh777s &$&Nc,K|j|d|d{} tttj|||dd{}|r||dfS|S7A7#t $r }|}Yd}~nd}~wwxYwt |} |jrtjj| stdd|d|t|} t|| d{7t| |d{7|j|||| d{7}|Sw) r}rQNrrrrrrr)rrrrrrr>rhrr8rr r@rrrs rrz$AsyncFileManagerMixin._read_notebooks)w<< NN)-E q B'*Bq ? 1r 1= F  (0&&bggnnX.F'y&<  'w/  ,777 7333** Z:RX[+    s{DAD,A A ADADA A4(A/*D/A44A%DCD.C1/D D DcK|j|d5}tttjtj |||d{dddy7 #1swYyxYwwr)rWrrrrrrs rrz$AsyncFileManagerMixin._save_notebooksf  7 ;qNN$//-E   < ; < ;s.A+9AAA A+AA($A+cDKtjj|stdd|z|j |d5}t |j d{}ddd|dk(r |rd|fSdfS||dk(r* |rjdd|fSjddfS|rtjd d |fStjd d fS7#1swYxYw#t$r!}|dk(rtdd|zd |Yd}~nd}~wwxYwwr) rr8rKr r$rrrrrrs rrz AsyncFileManagerMixin._read_filesP,ww~~g&C!:W!DE E YYw %%aff--H& V 36Hfh/ NXvVv- __V,fh?!/" " ) )' 2Hh G h'..w7B 3.& %&  V##1G;+ $ sfAD C'C%C'!D C3D C3)>&1#NN73 &y1 u 5177H- - -6 5 QC#9'"QC!HIq P Q .6 5sRB43BB4B(4B&5B(9 B4 B# BB##B4&B((B1-B4rrrrr) rrrrrsrrrrrrrrrsW8QV&IM&P =B7 7 $.7 597 A7 r.rrr)TrN)(r __future__rr*rrr,rrr contextlibr functoolsrranyio.to_threadr tornado.webr traitletsr r traitlets.configr traitlets.config.configurabler jupyter_server.utilsrrrrrr3r5r>r@rWrYr[rrrrrs #  +%$! )=AA ) CBC$28 DDN##LD*LDNK.,K.r