i 8dZddlZddlZddlmZddlmZmZmZ ddl m Z ddl m Z ddl mZej ej"d ej$d ej&ej(g ej*eZd ed eefdZde de d eefdZdZedk(reyy#e$rddl m Z ddl m Z ddl mZYwxYw)z Script to verify all Bitbucket repositories are present and up-to-date. Compares Bitbucket repos with local repos and updates/clones as needed. N)Path)DictListSet) ConfigManager)BitbucketClient) GitManagerz4%(asctime)s - %(name)s - %(levelname)s - %(message)szrepo_verification.log)levelformathandlers repos_dirreturnc^t}|jstjd||S|j D]e}|j s|dz jr|j |jCtjd|jdg|S)z Get list of all local repository directories. Args: repos_dir: Path to repositories directory Returns: Set of repository names/slugs z'Repositories directory does not exist: .gitz Directory z# exists but is not a git repository) setexistsloggerwarningiterdiris_diraddnamedebug)r local_repositems src/verify_repos.pyget_local_reposr!s%K    @ LM!!#Z ;;=v %%' * z$))4WXY Z  bitbucketconfigc |jxsg}|jdg}|r+tjdt |d|D]}t |t rH|jdrf|jddjdd}|jd}t |dk(sh|\}}|j||d |id d |d gid |jdrk|jddjdd}|jd}t |dk(s|\} }|j||d | id d |d d|d gid d|vs|jd}t |dk(s/|\}}d|d|d} |j||d |id d | d gid ]t |tso|jdxs|jd }|jd}|jdxs|jd} |s| st |t rd |i}|j|||xsid d | d gid |S)z Get all repositories from Bitbucket (including additional repos). Args: bitbucket: Bitbucket client instance config: Configuration manager Returns: List of repository info dictionaries z scanning.additional_repositoriesFound z" additional repositories in configzgit@bitbucket.org:r/slugclonessh)rhref)rr' workspacelinkszhttps://github.com/httpsrr+ssh_url clone_url) get_all_repositoriesgetrinfolen isinstancestr startswithreplacesplitappenddict) r r!reposadditional_repos_config repo_configpathpartsr+ repo_nameorgr.s rget_bitbucket_reposrB=s  * * , 2E%jj)KRP fS!89::\]^2B K+s+))*>?&../CRHPPQWY[\D JJsOE5zQ/4, 9 $-$-*0))< '-2K$H*"& & !++,AB&../DbIQQRXZ\]D JJsOE5zQ).Y $-$-*0# '-2K$H-4k$J*"& & K''--c2E5zQ/4, 9$6yk9+T"R $-$-*0))< '-2G$D*"& & K.'OOF3N{v7N 'OOK8 %//)4T  8T!)S1%+Y$7 LL ) )%._"#). @&" " sB H LrcLtjdtjdtjd t}|jds*tj dt j dt|jd}t|jd}|jds*tj d t j d|s,|s*tj d t j dt|jd|jd|s|jdnd |jd }t|jd }t|jd }tjdt||}|stjdy tjdt|dtjdt|}tjdt|di}|D]} | jdxs| jd} | s*| jds| jdr[| j!dj#d} t| dk\r| d} | r| jdr| jdxs| } | || <t%|j'} | |z } | |z}|| z }tjdtjdtjdt| tjdt|tjd t| tjd!t||r!tjd"t|tjd| r=tjd#t)| D]}tjd$||r=tjd%t)|D]}tjd$|d&}d&}| rtjd'dtjd(t| d)tjdt)| D]} || } tjd*|  |j+| d+,}|stjd-| d.|dz }U|j-| |/}|r3t/|t0r#|d&r|dz }tjd0| n|dz }tj d1| d&}d&}|rtjd'dtjd6t|d7tjdt)|D]} || } tjd8|  |j+| d+,}|stjd-| d.|dz }U|j-| |/}|r3t/|t0r#|d&r|dz }tjd9| n|dz }tj d:| tjd<tjd=tjdt| tjd>|tjd?|tjd@|tjdA|tjd||zt| k(rtjdBy tjdCy #t2$r-}|dz }tj d2| d3|d45Yd }~d }~wwxYw#t2$r-}|dz }tj d;| d3|d45Yd }~#d }~wwxYw#t4$r-tjdDt j dYy t2$r9}tj dE|d45t j dYd }~y d }~wwxYw)Fz4Main function to verify and update all repositories.z<============================================================z+Starting Repository Verification and Updatezbitbucket.workspacez"Bitbucket workspace not configuredr zbitbucket.api_tokenzbitbucket.app_passwordzbitbucket.usernamez'Bitbucket username/email not configuredz'Bitbucket authentication not configuredN)r+username app_password api_tokenzscanning.repos_dir)rz'Fetching repositories from Bitbucket...z"No repositories found in Bitbucketr#z repositories in BitbucketzScanning local repositories...z local repositoriesrr'zhttp://zhttps://r%r&httpzRepository Status Summary:z Total Bitbucket repos: z Total local repos: z Missing repos (need clone): z Existing repos (need update): z( Extra local repos (not in Bitbucket): z' Missing Repositories (will be cloned):z - z- Extra Local Repositories (not in Bitbucket):r zCloning z missing repositories...z Cloning: r))protocolzNo SSH clone URL found for z , skipping) repo_slugr/z[OK] Successfully cloned z[FAIL] Failed to clone u✗ Error cloning z: T)exc_infoz Updating z existing repositories...z Updating: z[OK] Successfully updated z[FAIL] Failed to update u✗ Error updating z= ============================================================zVerification Summary:z Cloned: z Updated: z Failed to clone: z Failed to update: z6[SUCCESS] All repositories are present and up-to-date!zP[WARNING] Some repositories could not be cloned/updated. Check logs for details.z! Verification interrupted by userz Fatal error: )rr2rr1errorsysexitboolrr rrBrr3rr6rstripr8rkeyssorted get_clone_urlclone_or_updater4tuple ExceptionKeyboardInterrupt)r! has_api_tokenhas_app_passwordr git_managerrbitbucket_reposrbitbucket_repo_map repo_inforKr?bitbucket_repo_names missing_reposexisting_reposextra_local_reposr@ cloned_countfailed_clone_countr/ clone_resulte updated_countfailed_update_counts rverify_and_update_reposris KK KK=> KKxzz/0 LL= > HHQKVZZ(=>?  +C DEzz./ LLB C HHQK%5 LLB C HHQK$jj!67ZZ 45ER$<=X\jj!67  !jj!56 $89:   =>-i@ NN? @  fS122LMN  45%i0  fS-..ABC ( :I! f-Fv1FI'' 2i6J6J:6V%,,S177>  H 01 /4H0I/JKL +C ,<+=>? 4S5G4HIJ 6s>7J6KLM  KKB3GXCYBZ[ \ H  KKB C#M2 0  d9+./ 0  KKH I#$56 0  d9+./ 0   KK"VH & KK(3}#5"66NO P KK6( $#M2 W .y9  k)56W ) 7 7 E 7 RI$)DYKz'Z[*a/* #.#>#>"+"+$?$L $L%)H\Z[_$)  &? {$KL*a/* '>yk%JK+ W6   KK"VH & KK)C$7#88QR S KK6( $#N3 X .y9  l9+67X ) 7 7 E 7 RI$)DYKz'Z[+q0+ #.#>#>"+"+$?$L $L%)H\Z[_%*  &@ $LM+q0+ '? {%KL+ X6  O$ +, /4H0I/JKL j/0 k-12 )*<)=>? *+>*?@A H - '3/C+D D KKP Q NNm ni!W&!+&LL#5i[1#!FQULVVWF!X'1,'LL#6ykA3!GRVLWWX&  89   }QC(4 8  sF`- B`-2J`-3^;8`-9A%^;B`-#3_4`-A%_4rzs ""(,0& ,, A34cjj)   8 $tC8V?VMVdSWjVr~B zQ (-1'(sB44C C