Qd9dZddlmZdZdZdZdZdZdZd Z Gd d Z d Z e d kr e dSdS)aCounts Paice's performance statistics for evaluating stemming algorithms. What is required: - A dictionary of words grouped by their real lemmas - A dictionary of words grouped by stems from a stemming algorithm When these are given, Understemming Index (UI), Overstemming Index (OI), Stemming Weight (SW) and Error-rate relative to truncation (ERRT) are counted. References: Chris D. Paice (1994). An evaluation method for stemming algorithms. In Proceedings of SIGIR, 42--50. )sqrtc|t}|D]*}|t||+|S)a5 Get original set of words used for analysis. :param lemmas: A dictionary where keys are lemmas and values are sets or lists of words corresponding to that lemma. :type lemmas: dict(str): list(str) :return: Set of words that exist as values in the dictionary :rtype: set(str) )setupdate)lemmaswordslemmas 2lib/python3.11/site-packages/nltk/metrics/paice.pyget_words_from_dictionaryr sB EEE)) S''(((( Lci}|D]?}|d|} |||g*#t$r |h||<Yz_calculate..s/ 1 1$Ct   1 1 1 1 1 1r )rrrrr)sumr/r6) rrngdmtgdntgumtgwmtr lemmacountr1r2s ` r _calculaterEs 1 1 1 1& 1 1 111A1D$d''  j1n-- a*n--"&-77S     1HdQhq$( 33r c ||z }n#t$rd}YnwxYw ||z }n#t$rd}YnwxYw ||z }n5#t$r(|dkrtd}ntd}YnwxYw|||fS)aCount Understemming Index (UI), Overstemming Index (OI) and Stemming Weight (SW). :param gumt, gdmt, gwmt, gdnt: Global unachieved merge total (gumt), global desired merge total (gdmt), global wrongly merged total (gwmt) and global desired non-merge total (gdnt). :type gumt, gdmt, gwmt, gdnt: float :return: Understemming Index (UI), Overstemming Index (OI) and Stemming Weight (SW). :rtype: tuple(float, float, float) rnanr'r()rBr@rCrAuioisws r _indexesrKs D[   D[   "W  99uBBuB  B<s' ! 00:/A,+A,c8eZdZdZdZdZdZd dZdZdZ d S) Paicez7Class for storing lemmas, stems and evaluation metrics.c||_||_g|_d\|_|_|_|_d\|_|_|_ d|_ | dS)al :param lemmas: A dictionary where keys are lemmas and values are sets or lists of words corresponding to that lemma. :param stems: A dictionary where keys are stems and values are sets or lists of words corresponding to that stem. :type lemmas: dict(str): list(str) :type stems: dict(str): set(str) )NNNN)NNNN) rrcoordsrBr@rCrArHrIrJerrtr)selfrrs r __init__zPaice.__init__sY   5M2 49di$6!$'  r cPd|jzg}|d|jz|d|jz|d|jz|d|jz|d|jz|d|jz|d|jzd d |j D}|d |zd |S) Nz)Global Unachieved Merge Total (GUMT): %s z&Global Desired Merge Total (GDMT): %s z'Global Wrongly-Merged Total (GWMT): %s z*Global Desired Non-merge Total (GDNT): %s z&Understemming Index (GUMT / GDMT): %s z%Overstemming Index (GWMT / GDNT): %s zStemming Weight (OI / UI): %s z.Error-Rate Relative to Truncation (ERRT): %s  cg|]}d|zS)z(%s, %s)r)r;items r z!Paice.__str__..sJJJd T 1JJJr zTruncation line: %s) rBappendr@rCrArHrIrJrPjoinrO)rQtextr+s r __str__z Paice.__str__sJKKK ADIMNNN =GHHH .s(44dD 444444r r.r=rrr)r rmaxr_rYr/r,rJ)rQrr maxlengthrOpair derivative1 derivative2s r _get_truncation_coordinatesz!Paice._get_truncation_coordinates s*$+6644e44444 9$$//yAAD6!! d###z!! 6{{aDGcMM-fRj99 -fRj99 $'8888[88888!M NI)9$$* r c||_d|jvr0|j|jfdkrt dSt dS|j|jfdkrdSt d|j|jff|jdd}t |jdz|jdzz}t |d dz|d dzz}||z S) aCount Error-Rate Relative to Truncation (ERRT). :return: ERRT, length of the line from origo to (UI, OI) divided by the length of the line from origo to the point defined by the same line when extended until the truncation line. :rtype: float r.r'rGr)rrrbNr=rr)rirOrHrIr*r%r)rQ intersectionopots r _errtz Paice._errt0s6688  $ $!Z//U||#U||# GTW  + +3+ dgtw' ($+bcc*:  $'1*twz) * * ,q/Q&aA)== > >Bwr ct|j|j\|_|_|_|_t|j|j|j|j\|_|_ |_ | |_ dS)z7Update statistics after lemmas and stems have been set.N) rErrrBr@rCrArKrHrIrJrnrP)rQs r rz Paice.updatePsa5? TZ5X5X2 49di$,TY 49di$X$X!$'JJLL r N)r) __name__ __module__ __qualname____doc__rRr\r_rirnrrr r rMrMs{AA"    %%%%N@!!!!!r rMc ddgddggdd}dgdggddgd gd }td t|D]>}td |d ||?ttdt|D]>}td |d ||?tt ||}t|tdgdgdgddgdgd gd}tdt|D]>}td |d ||?t||_|t|dS)zDemonstration of the module.kneelkneltrangeranged)ringrangrung)rurwry)rzrwrxryr{)rurvrzryr{zWords grouped by their lemmas:z{} => {}rTz+Same words grouped by a stemming algorithm:rz)rurvrzrwryr{z/Counting stats after changing stemming results:N)printsortedformatrZrMrr)rrr rps r demorWs7#8$(((F+++   E *+++AA jsxxu '>'>??@@@@ GGG 7888u >> jchhuT{&;&;<<==== GGG feA !HHH GGG8$   E ;<<<u >> jchhuT{&;&;<<==== GGGAGHHJJJ !HHHHHr __main__N) rsmathrr rr%r,r6rErKrMrrprr r rs      ,   F   2&4&4&4R"""J|!|!|!|!|!|!|!|!~* * * Z zDFFFFFr