U ^'^ =@sddlZddlZddlZddlZddlZddlZddlmZmZm Z ddl Z ddl m Z ddlmZddlZdZdZddZd d Zd d Zd dZddZddZddZedkreejdddS)N)Image ImageChops ImageStat)partial)get_terminal_sizez.pngz.jpgcCstj|dddd}tj|dddd}d|jdd}|jdd|jddf}||tj||tjt||}tt |j |kS) Nrr)modeRGBgQ?) ropenconvertsize thumbnailBILINEARr differencesumrZStatZsum2)pathsnewImgZoldImgZtresholdrZdiffrFD:\Dropbox\games\factorio\mods-live\L0laapk3_FactorioMaps_3.5.5\ref.pytests rc Csd}zjz>ttjj||f|ddtjj|f|ttf}Wn&tdt tdYnXW5|ddX||ddfS)NFTr   ) putrospathjoinreplaceextoutextprint traceback print_exc)rbasePathnew progressQueue testResultrrrcompares> r)cCsptj|||dt}d}z(t|tj||d|dtf}WntdYnX|||d|dfS)NrFr rr )rrrr rr!r")Z renderboxr%r&ZnewPathr(rrrcompare_renderbox(s(r*cCsv|dd\}}}t|dttj|dd}}|||t|dt|dtf|kr|||||d|dfdd@pp|||t|dt|dtf|kr|||||d|dfdd@pp|||t|dt|dtf|kr|||||d|dfdd@pp|||t|dt|dtf|krd|||||d|dfdd@pp|||t|dt|tf|kr|||||d|fdd@pp|||t|dt|tf|kr|||||d|fdd@pp|||t|t|dtf|kr0||||||dfdd @pp|||t|t|dtf|kop||||||dfdd @|fS) z8 x+ = UP, y+ = RIGHT corners: 2 1 X 4 3 Nrr r r )intrrsplitextstrr get)coordkeepListcropList surfaceNamedaytimezxyrrr neighbourScan3s$&JFHH@@@@r<cCs`|dkr|dkst|dkr dS|dkr,dS|dkr@t|dS|d krTt|d St|d S) Nr@?/>+3r,GA)AssertionErrorchr)irrr base64CharLs  rIcCsHt||rdnd}t|dtt|ddtt|ddS)Niir=)r0rI)numberZisNightrrr getBase64WsrKc? sFtttjdkrtjndtjt |dkr>|dnd|d}tj|d}t ||drhdnd}t j |d }t |d d d }t|}W5QRXtj|dd drt |dd dd d d }t|}W5QRXni}t |dkr2t|dD]&\} } | d|dkr| } qBqnt |dd} d} d|krXi|d<t| |dkr~dii|dt| <|d| } i}i}dD ]rg}g}g}g}id}t |dksЈ|dkr:| dD]Z\}t |dks|dkr܈|krt|rt |dks6|dkrd}|ddg}|fg}t| D]&}|d|dkrd||qdfdd}|D].}|tj|d|d|dddq|tj|d| dddi}|D]}|d|dkr|kr|ddkr|krBi|<tj|d|d|dt}t|D]B}ttj||D]&}|d|d|||ttf<qqrqdkr`tjtj|d| dddstd nf|d!rtd"t tj|d| dddd .}|D]"}|t|d#d$dq*W5QRX||<tj|d| dt}t|D]}ttj||D]}|tj|df|ks||ttf|kr|t||fn@||ttf|kr||||ttft||fqqq|sDq|d!r^td%t |t |dkr|d!rtd&t |t }| } |!t"t#tj|dt| d| d'|d(}!d}"td)$dd$t%dd*d+d,tt |D]r} | &d|"d7}"t'|"t |}#t%dd*}$td-$t(|#d.dd/t |#|$d$|$t |#|$d+d,q|!)|!&}%d0d1d2d1|%DD}&|d3d1d4d1|%DD7}|d!rtd5t |&t |f||&7}td6$d.d/t%dd*|d!rtd7t ||*t"t+|d8|d9}%d:d1d;d1|%DD}'dt |'|d!rtd?t |(t |t |'t |t |'t |(f|d!rtd@|(D]&}t,tjj|d| df|q|d!rtdA|D]\|ddt tj|d| dddBv}||'fD]f})|)D]Z}*|*dkrJ|*dkrJ|*dtkrJ|-dC|*dtj|*ddfqJqBW5QRXq|d!rtdD||'fD]})|)D]}*t |*d}t tj|*dd}|*d|k ri||*d<|*d||*dk rFi||*d|*d<|||*d|*dk r||g||*d|*d|<n<|||*d|*d|kr||*d|*d||qڐq|d! rtdEdF|dt| krd} d|dt| dF<i}d}+| dD]8\}i},t|dGD]\}-}.|dt| dk rndGgi|dt| d<|dt| ddGd| didD]|.dHdIk r|.dJ sˆdk rtj|.dK|.dJ r܈nddLt|dd|.dM}||,k r|-fg|,|<n|,||-f|+d7}+ q q.t| ddNdND]}|d|dk rDt|d|ddGD]\}-}.dD]|.dHdIk r|.dJ sdk rtj|.dK|.dJ rȈnddLt|dd|.dM}||,k r||k rd|.k r |.dn"|dt|ddG|-d}/||/|,|f||< q q| qD q|.}|*t"t/tj|dt| ddO|dP}%d}0|%D]\\}1}}/}2|1 st,||2D].\}-d|/i|dt| ddG|-< qn|0d7}0 q|d!rtdQ|0t ||+fq|D]\}3g}4dR|3k rd|d| d rdt|d| ddR rddRnd|3k rv q|3}5|5D]\}}6t0|d}7d}8d}9tt1|6t2|6dD]j}||6k}:dRk ot|t|f|k};|8|:k s|: r|9|;k r|7t0||:r|;n|97}7|:}8|;}9 q|4|7 q|dt| dkrbi|dt| d<d/|4|dt| ddS<t |4dk rd} q| rB|d!rtdTt |dd ddUd d }t3||W5QRX|d!rtdVtj4|f|ddD]2\}<}=}>t |=dkrt |>dkrt5|<qdS)WNntr.r,z ../../script-output/FactorioMapsrz mapInfo.json refthreads maxthreads) processesrzutf-8)encodingz .out.jsonr mapsrFsurfaces)daynightr+r Tzoommaxc s&t|d}|ddkr$dnd}|D]}|dkr|ddd}tt|dttj|ddf}|d }nj|ddd}|dd d}|dtkrq,tt|dttj|ddf}|d}|rt|d  |dBnt|d |<q,W5QRXdS) Nrrv2r r  r/rr,r?) r readlinerstripsplitr2r0rrr1r3) rZcombinePreviousfversionliner]keyvalueZ pathSplitr6r8r7r9rr readCropLists. .zref..readCropListImageszcrop.txtrTzref.txtzuWARNING: cannot find day surface to copy non-day surface from. running ref.py on night surfaces is not very accurate.verbosez7found day surface, reuse results from ref.py from thererrYzfound %s new imageszcomparing %s existing images)r%r&r'zref {:5.1f}% [{}])endz ref {:5.1f}% [{}{}]d=cSsg|] }|dqSr r.0r:rrr szref..cSsg|]}|dr|qSrrrnrrrrpscSsg|] }|dqSrmrrnrrrrpscSsg|]}|ds|qSrqrrnrrrrpszfound %s changed in %s imagesz ref {:5.1f}% [{}]z)scanning %s chunks for neighbour cropping)r5r6r=cSsg|] }|dqSrmrrnrrrrpscSsg|]}|dr|qSrqrrnrrrrpscSsg|] }|dqSrmrrnrrrrpscSsg|]}|ds|qSrqrrnrrrrpszkeeping %s neighbouring imagesz-deleting %s, keeping %s of %s existing imageszremoving identical imageszcreating render indexwz%s %s zcreating client indexzcomparing renderboxesZrenderboxesComparedlinkstypeZlink_renderbox_areaZdaynightZ toSurfaceZ renderboxesfilename)r%r&rZz3removed %s of %s compared renderboxes, found %s newrUchunkszwriting mapInfo.out.jsonzw+zdeleting empty folders)6psutilProcessrgetpidnicenameBELOW_NORMAL_PRIORITY_CLASSrrlenr0mpPoolr jsonloadisfile enumerater2itemsappendrangelistdirrr r!r"tupler\r]r1ManagerQueue map_asyncrr)formattsizer3floatroundwaitmapr<removewritevaluesr*rKminrWdumpwalkrmdir)?argskwargstoppathdatapathrNpoolr^dataZoutdatarHZmapObjr&changedZnewMapZ allImageIndexZ allDayImagesZnewComparedSurfacesZ compareListr5ZfirstRemoveListZ didAnythingsurfaceZ dayImagesZ oldMapsListoldrdZ oldImagesrr:r;r`mr'workersdoneSizeprogresstsizZ resultListZnewListZ neighbourListZ removeListZaListr4Z totalCountZ linksByPath linkIndexlinkZoldPathcountZ isDifferentrsZdaytimeImageIndexZ indexListZsurfaceImageIndexZxListstringZisLastChangedImageZisLastNightImageZisChangedImageZ isNightImagecurdirZsubdirsfilesrrcrrefcs$&     P  , 2 &, $  "*06  ," @    6 $   " .<    & *"6 $"66"*  *   F  ""  "r__main__r )rsysmathtimerrxPILrrrmultiprocessingr functoolsrshutilrrr#r r!rr)r*r<rIrKr__name__argvrrrrs$0       B