USh& BSSKrSSKJr "SS\R5rg)N)nncJ^\rSrSrS U4SjjrSrSrSrSrSr Sr U=r $) LitEmac>[TU]5 US:dUS:a [S5e0UlUR S[ R "U[ RS95 UR SU(a#[ R "S[ RS9O"[ R "S[ RS95 UR5H}upEUR(dMURS S 5nURRXF05 UR XeR5R5R5 M /Ulg) Ng?zDecay must be between 0 and 1decaydtype num_updatesr.)super__init__ ValueError m_name2s_nameregister_buffertorchtensorfloat32intnamed_parameters requires_gradreplaceupdateclonedetachdatacollected_params)selfmodelr use_num_upatesnameps_name __class__s ?/home/gothic/public_html/Fooocus/ldm_patched/ldm/modules/ema.pyrLitEma.__init__s  3;%#+<= = Well5 &NO ]P^ELL%)),L \\"EII . 0--/GDc2.""))4.9$$VWWY-=-=-?-D-DE 0!#cnU?URS[R"S[RS95 g)Nr rr )r rrrr)r!s r(reset_num_updatesLitEma.reset_num_updatess'   ]ELL%)),LMr*c|URnURS:aHU=RS- sl[URSUR-SUR-- 5nSU- n[R"5 [ UR 55n[ UR55nUHlnXFR(aEURUnXWRXF5XW'XWRX5UXF- -5 M[X`R;aMle SSS5 g!,(df  g=f)Nr r) r r minrno_graddictr named_buffersrrtype_assub_)r!r"r one_minus_decaym_param shadow_paramskeysnames r(forwardLitEma.forwards    q    !  Q)9)9%9b4CSCS>S$TUE+ ]]_51134G !3!3!56M<-- ..s3E+8+?+G+G +UM(!(--ouAUX_XdAd.ef"&8&8888  __s?BD- D-- D;c2[UR55n[UR55nUH_nX$R(a8X$RR X0R UR5 MNX@R ;aM_e g)N)r3rr4rrcopy_r)r!r"r8r9r:s r(copy_toLitEma.copy_to2syu--/0T//12 C|)) !!'' 6H6H6M(N(S(ST"4"4444 r*cXUVs/sHo"R5PM snUlgs snf)z Save the current parameters for restoring later. Args: parameters: Iterable of `torch.nn.Parameter`; the parameters to be temporarily stored. N)rr )r! parametersparams r(store LitEma.store;s#=G GJ5J G Gs'c[URU5H*up#URRUR5 M, g)a Restore the parameters stored with the `store` method. Useful to validate the model with EMA parameters without affecting the original optimization process. Store the parameters before the `copy_to` method. After validation (or model saving), use this to restore the former parameters. Args: parameters: Iterable of `torch.nn.Parameter`; the parameters to be updated with the stored parameters. N)zipr rr?)r!rCc_paramrDs r(restoreLitEma.restoreDs4"$"7"7DNG JJ  W\\ *Er*)r r)gH.?T) __name__ __module__ __qualname____firstlineno__rr,r<r@rErJ__static_attributes__ __classcell__)r's@r(rrs(#&N9*5H + +r*r)rrModulerr*r(rTs K+RYYK+r*