#j"dZddlmZddlZddlZddlZddlZddlmZmZddl m Z gdZ gdZ gdZ d Zd Zd Zd Zd ZddZddZddZedkreedS)a+Calibrate market regimes from roughly 10 years of historical prices. Outputs: - historical_regime_config.json: regime return parameters and transition matrix - historical_regime_stats.csv: human-readable regime statistics - historical_regime_calibration_report.md: summary for the dashboard/manual ) annotationsN)datetimetimezone)Path)SPYQQQIWMSMHSOXXSOXLSOXSNVDAAVGOAMDMUTSMASML^VIX)basketqualityleadersoxlsoxs)risk_on selectivechopselloffreboundcrashc*|SN) pct_change)seriess 'outputs/historical_regime_calibrator.pyr"r")s     c|d}|d}|d}|d}t|}|d}|d}|d}|d} |d} |d} |d} |d} |d}|d }|d}|d }||z d z }i}|jD]X}t d |j||j||j|| j|| j||j||j||j||j|f Dr|j|d ks3| j|dks"|j|dkr|j|dkrd}n|j||j|krB|j||j|kr&|j|dks| j|dkrd}n$|j|dkr%|j|dkr| j|dkrd}n|j||j|kr]|j||j|krA|j||j|kr%|j|dkr| j|dkrd}nu|j||j|ks|j||j|kr;|j|| j|ks| j||j|krd}nd}|||<Z|S)Nrr rr2<g?c3>K|]}tj|VdSr!)mathisnan).0xs r$ z#classify_regimes..Ds:   tz!}}       r%g333333gzGế#gQ롿rgQ?rgg?gQ?rrrrr)r"rollingmeanmaxindexanyloc)closeqqqsmhspyvix qqq_ret_1 qqq_ret_3 qqq_ret_5 qqq_ret_20 smh_ret_3 smh_ret_5 smh_ret_20 spy_ret_20 vix_change_5qqq_ma50 qqq_ma200smh_ma50 qqq_high_60qqq_drawdown_60regimesidxregimes r$classify_regimesrP-s_ ,C ,C ,C -C3Iq!!Iq!!I##Jq!!Iq!!I##J##J>>!$$L{{2##%%H C  %%''I{{2##%%H++b//%%''KK'#-OG{    M#  M#  N3  N3   S ! L  M#  L    $ '      M# & ( (IM#,>&,H,HSWUX\]_M_M_dmdqrudvyddFFgclX\#...373<(,sBS3S3SYbYfgjYkntYtYtyEyIJMyNQUyUyUFF   % - -)-2Du2L2LQZQ^_bQcfkQkQkFF WS\HL- - -#'#,sAS2S2SX[X_`cXdgogstwgxXxXx~H~LMP~QTU~U~UZdZhilZmpqZqZqFFgclX\#...#'#,cAR2R2RYcYghkYloyo}BpCZCZCGQGUVYGZ]g]klo]pGpGp FFF Nr%c>|i}gdd|d<ddgd|d<fdd D}|d|d <d |d <d |d<|S)N)rrr r )axisrrrrc&g|] }|jv |Scolumns)r0tickerreturnss r$ z'build_asset_returns..gs(rrrfX^bibqXqXq6XqXqXqr%)rrrrrrrr rr r)r"r5)r:out leader_colsrYs @r$build_asset_returnsr]bs  G C8889>>A>FFCMeU^,11q199C Nrrrr(TrrrKK(--1-55CM&/CK&/CK Jr%c"d|D}|sdSt|t|z tfd|Dtt|dz dz }ttj|dfS)Nc8g|]}||kt|SrU)float)r0vs r$rZzmean_std..os# 0 0 0!aU1XXr%)gg{Gz?c3(K|] }|z dzV dS)NrU)r0r1r5s r$r2zmean_std..ss+22qAH?222222r%rRg-C6?)sumlenr6r.sqrt)valuescleanvariancer5s @r$mean_stdrjns 0 0v 0 0 0E y u::E "D2222E22222SUa5K5KKH TYx((&11 11r%cdtD}dt|dD}t||ddD]\}}|||xxdz cc<i}|D]=\}t fdtD||<>|S)Nc2i|]}|dtDS)ci|]}|dS)rRrU)r0dsts r$ z7smooth_transition_counts...xs333sC333r%) REGIME_ORDER)r0srcs r$roz,smooth_transition_counts..xs) L L Lc33l333 L L Lr%cg|]\}}|SrUrU)r0_rOs r$rZz,smooth_transition_counts..ys___)!Vv___r%c|dS)NrrU)items r$z*smooth_transition_counts..ys VZ[\V]r%)keyrRc*g|]}||z fSrUrU)r0rn dst_countstotals r$rZz,smooth_transition_counts..s'SSSsS*S/E"9:SSSr%)rpsorteditemsziprdrg) regime_seriescountsorderedrqrn transitionsryrzs @@r$smooth_transition_countsrws L L| L L LF__vm.A.A.C.CI]I]'^'^'^___G--Ss CAK!<<>>TTZJ%%''((SSSSSlSSS C r%periodstrc ddl}|t|ddd}|jrt dd|vr|ddn|dfd tD}|rt d |gd  t ti}g}tD]fd  D}i|<tD]r fd|D}t|\}} || g| <|  t||| |dz| tjdzdst!} fdtD} t#jt&j|dt| || gdd} | |fS)NrTF)r auto_adjustprogressthreadsz No data downloaded from yfinanceCloseall)howc&g|] }|jv |SrUrV)r0rXr:s r$rZzcalibrate..s%KKK&vU]/J/Jv/J/J/Jr%z$Missing tickers in downloaded data: )rrr r r r r)subsetc&g|] \}}|k |SrUrU)r0datelabelrOs r$rZzcalibrate..s"TTT+$EVOOOOOr%cTg|]$}|jvj|%SrU)r7r9)r0rasset asset_returnss r$rZzcalibrate..s:mmm$R_`eRfRlJlJlmE*.t4JlJlJlr%)rOrdaysmean_daily_returnstdev_daily_returnannualized_mean_simpleannualized_vol_simpleczi|]7}|t|8SrU)listrgcount)r0rOregimes_by_dates r$rozcalibrate..s= ^ ^ ^vfd?113344::6BB ^ ^ ^r%zyfinance adjusted close)z3Historical calibration is a guide, not a guarantee.zbSOXL/SOXS are daily leveraged products; long-horizon simulation still requires daily revalidation.z>Classification uses QQQ/SMH/SOXX/VIX trend and drawdown rules.) as_of_utcrsourcetickers regime_countsrMrnotes)yfinancedownloadTICKERSempty RuntimeErrordropnarPr]rpr|ASSETSrjappendrer.rfrrnowrutc isoformat)ryfdatamissing regime_config stats_rowsdatesrgr5stdevrrpayloadrrr:rOrs @@@@@r$ calibratersZ ;;wv4%Y^; _ _D z?=>>>$W $$$//  &&KKKKGKKKGMK'KKLLL LL U U UL V VE&u--O'..MMJTTTT)>)>)@)@TTT " f  EmmmmmmmmF"6**KD%,0%=M& !% (    F %)&+*.*).3)?     +?;;K ^ ^ ^ ^Q] ^ ^ ^F\(,//99;;+ "     G J r%out_dirrc\|dz }|dz }|dz }|tj|dd|dd 5}t j|t |d  }|| |dddn #1swxYwY|d }t| } d dd|dd|dd|dddddddg } tD]3} || } | r| | z nd } | d| d| d| dd4| dddddddd dd!|d"d#|d"g |d$| d$zdS)%Nzhistorical_regime_config.jsonzhistorical_regime_stats.csvz'historical_regime_calibration_report.mdFrc ensure_asciiindentw)newliner) fieldnamesrz&# Historical Regime Calibration Reportz - As of UTC: rz - Period: rz - Source: rzZ- Purpose: calibrate 1-year strategy simulations from the last 10 years of market regimes.z ## Regime Mixz| Regime | Days | Share |z| --- | ---: | ---: |z| z | z.2%z |z## Required Usez<- Strategy simulations should run at least 252 trading days.z- Chart and trend analysis should reference this 10-year regime calibration before selecting ATTACK/GUARDED ATTACK/DEFENSE/REST.zP- If live data download fails, use the last saved calibration and mark it stale.z## Filesz - Config: ``z - Stats: ` ) write_textjsondumpsopencsv DictWriterrkeys writeheader writerowsrdrgrprextendjoin)rrr config_path stats_path report_pathhandlewriterrrzlinesrOrshares r$ write_outputsrsT;;K88JEEK4:gE!LLLMMM b ) )%V4 1 8J8J8L8L3M3MNNN$$$%%%%%%%%%%%%%%% _ %F   E0 . ,..(WX&(((WX&((d  # E==f~ %,u 1 ;&;;T;;e;;;;<<<< LL  F KZ  $k$$$"Z"""    499U++d233333sA%CC Creturnintctj}|dd|}t t j}t|j \}}t|||ttj |d|d|dddd d S) Nz--period10y)defaultrrr)rrrFrcrr)argparseArgumentParser add_argument parse_argsr__file__resolveparentrrrprintrr)parserargsrrrs r$mainrs  $ & &F  E222     D8nn$$&&-G#DK00GZ':w/// $*(#[) 1!  % % %&&& 1r%__main__)rr)rr)rr)__doc__ __future__rrrrr.rrpathlibrrrrpr"rPr]rjrrrr__name__ SystemExitrUr%r$rsO#""""" ''''''''   " 9 8 8NNN 222j   222   7777t-4-4-4-4`      z *TTVV  r%