+gd d Z ddlZddlZddlmZmZmZmZmZmZm Z m
Z
ddl m Z ddl
mZ ej ej ej
ej ej dZej
Zd Zdefd Zdej fd
Zd d Zd d Zd!d
e e dej fdZdefdZdeddfdZ d Z d Z d Z d Z d dZ!d dZ" e G d d Z#da$ G d d Z% e% Z
de&fd Z'd Z(d Z)dS )"z Logging utilities. N)CRITICALDEBUGERRORFATALINFONOTSETWARNWARNING)Optional)auto)debuginfowarningerrorcriticalc t j dd } | rl| t v r
t | S t j d| dd t t S )z
If DATASETS_VERBOSITY env var is set to one of the valid choices return that as the new default level.
If it is not - fall back to ``_default_log_level``
DATASETS_VERBOSITYNz"Unknown option DATASETS_VERBOSITY=z, has to be one of: z, ) osgetenv
log_levelslogging getLoggerr joinkeys_default_log_level)
env_level_strs 6lib/python3.11/site-packages/datasets/utils/logging.py_get_default_logging_levelr , s
I 2D99M J & & m, , ' 'F] F F&*ii
0A0A&B&BF F
returnc B t d d S )N.r )__name__split r r _get_library_namer& = s >># q !!r c B t j t S N)r r r& r% r r _get_library_root_loggerr) A s . 0 0 1 11r c d t } | t d S r( )r) setLevelr library_root_loggers r _configure_library_root_loggerr. E s/ 244 !;!=!=>>>>>r c ` t } | t j d S r( )r) r+ r r r, s r _reset_library_root_loggerr0 K s* 244 00000r namec J | t } t j | S )z_Return a logger with the specified name.
This function can be used in dataset scripts.
)r& r r )r1 s r
get_loggerr3 P s% | "" T " ""r c B t S )a Return the current level for the HuggingFace datasets library's root logger.
Returns:
Logging level, e.g., `datasets.logging.DEBUG` and `datasets.logging.INFO`.
HuggingFace datasets library has following logging levels:
- `datasets.logging.CRITICAL`, `datasets.logging.FATAL`
- `datasets.logging.ERROR`
- `datasets.logging.WARNING`, `datasets.logging.WARN`
- `datasets.logging.INFO`
- `datasets.logging.DEBUG`
)r) getEffectiveLevelr% r r
get_verbosityr6 Y s $ % % 7 7 9 99r verbosityc H t | dS )zSet the level for the Hugging Face Datasets library's root logger.
Args:
verbosity:
Logging level, e.g., `datasets.logging.DEBUG` and `datasets.logging.INFO`.
N)r) r+ )r7 s r
set_verbosityr9 l s$ '' 22222r c * t t S )zSet the level for the Hugging Face datasets library's root logger to `INFO`.
This will display most of the logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.INFO)`.
)r9 r r% r r set_verbosity_infor; u s r c * t t S )zSet the level for the Hugging Face datasets library's root logger to `WARNING`.
This will display only the warning and errors logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.WARNING)`.
)r9 r
r% r r set_verbosity_warningr= s ! !!r c * t t S )zSet the level for the Hugging Face datasets library's root logger to `DEBUG`.
This will display all the logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.DEBUG)`.
)r9 r r% r r set_verbosity_debugr? r c * t t S )zSet the level for the Hugging Face datasets library's root logger to `ERROR`.
This will display only the errors logging information and tqdm bars.
Shortcut to `datasets.logging.set_verbosity(datasets.logging.ERROR)`.
)r9 r r% r r set_verbosity_errorrB r@ r c , dt _ dS )zjDisable propagation of the library log outputs.
Note that log propagation is disabled by default.
FNr) propagater% r r disable_propagationrF s ,1 (((r c , dt _ dS )zEnable propagation of the library log outputs.
Please disable the Hugging Face datasets library's default handler to prevent double logging if the root logger has
been configured.
TNrD r% r r enable_propagationrH s
,0 (((r c 0 e Zd ZdZd Zd Zd Zd Zd ZdS ) EmptyTqdmz%Dummy tqdm which doesn't do anything.c ( |r|d nd | _ d S )Nr ) _iteratorselfargskwargss r __init__zEmptyTqdm.__init__ s $(2adr c * t | j S r( )iterrL rN s r __iter__zEmptyTqdm.__iter__ s DN###r c d }|S )zReturn empty function.c d S r( r% )rO rP s r empty_fnz'EmptyTqdm.__getattr__..empty_fn s Fr r% )rN _rX s r __getattr__zEmptyTqdm.__getattr__ s r c | S r( r% rT s r __enter__zEmptyTqdm.__enter__ s r c d S r( r% )rN type_value tracebacks r __exit__zEmptyTqdm.__exit__ s r N) r#
__module__ __qualname____doc__rQ rU rZ r\ ra r% r r rJ rJ se //3 3 3$ $ $ r rJ Tc e Zd Zd Zd Zd ZdS ) _tqdm_clsc J t rt j |i |S t |i |S r( ) _tqdm_activetqdm_libtqdmrJ rM s r __call__z_tqdm_cls.__call__ s2 .=$1&11 1 d-f-- -r c N d | _ t rt j j |i |S d S r( )_lockrh ri rj set_lockrM s r rn z_tqdm_cls.set_lock s3
;=)4:6:: : ; ;r c P t r t j S d S r( )rh ri rj get_lockrT s r rp z_tqdm_cls.get_lock s( ,=))++ + , ,r N)r# rb rc rk rn rp r% r r rf rf sA . . . ; ; ;
, , , , ,r rf c * t t S )zCReturn a boolean indicating whether tqdm progress bars are enabled.)boolrh r% r r is_progress_bar_enabledrs s r c
da dS )zEnable tqdm progress bar.TNrh r% r r enable_progress_barrv s
LLLr c
da dS )zDisable tqdm progress bar.FNru r% r r disable_progress_barrx s
LLLr )r Nr( )*rd r r r r r r r r r r
typingr rj r ri r r r strr& Loggerr) r. r0 r3 intr6 r9 r; r= r? rB rF rH rJ rh rf rr rs rv rx r% r r r} s ! ! ! ! ! ! ] L
]
_ ""3 " " " "2'. 2 2 2 2? ? ? ? 1 1 1 1
# #Xc] #gn # # # #:s : : : :&3S 3T 3 3 3 3 " " " 1 1 1 10 0 0 0 0 , , , , , , , ," y{{ r