_i@pdZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z m Z ddlmZejeZde efdZded e edefd ZGd d Zy) z@ SonarQube scanner integration for running code analysis scans. N)Path)DictListOptional)datetimereturnc2 g t dtddf fd }tjj ddj }|rt |j}|jr@tj|tjr|t|jn!|jr|t|tjdk(r St j}|dz d z d z }|jrY|j!d j }|r7|d k7r2|dz dz dz |z dz }|jr|t||dz dz dz }|jrIt#|j%ddD])}|dz } | js|t| +t d|dz dz fD]$} | js|t| & S)z Directories to prepend to PATH so SonarJS can run `node` (cron/minimal env often omits nvm). Override with NODE_BIN_PATH=/path/to/dir/containing/node or explicit path to node binary. prNc|rB|vr=t|jr#j|j|yyyyN)ris_diraddappend)r dirsseens 9/home/batmin/projects/sonar_scan/src/sonarqube_scanner.pyrz+_node_bin_directories_for_path..adds8 $47>>#3 HHQK KKN$41 NODE_BIN_PATHWindowsz.nvmaliasdefaultutf-8encodingsystemversionsnodebinc|jSr )name)xs rz0_node_bin_directories_for_path..5s affrT)keyreversez/usr/local/binz.local)setstrosenvirongetstripr expanduseris_fileaccessX_OKparentr platformrhome read_textsortediterdir) roverrideopr2 default_aliasverbindirnvm_nodechildbextrarrs @@r_node_bin_directories_for_pathr?s D 5Dst zz~~or288:H (^ & & ( ::FF}}CK f}z)F2HH,,.4DdS E AxxzCF   '($/E*AB <<> E O Kr existing_path node_binsc||s|Stjj|}|r|tjz|zS|Sr )r(pathsepjoin)r@rAprefixs r_path_with_node_binsrFAs9  ZZ__Y 'F "]22 Mrc 0eZdZdZddededefdZdeedefdZd d ed ed e d e de f d Z d ed edede fdZ de fdZdeddfdZdedeefdZdedeefdZdedee fdZdedeefdZdede fdZ d!dedededede f dZd edededefdZy)"SonarQubeScannerz&Manages SonarQube scanning operations. sonar_url sonar_token scanner_pathc|jd|_||_|r|jsd}n|j}t j dk7r0d|vs|j dsd|vrtjdd}t j dk7rtj|vxs$tjxrtj|v}tjj|s|stj|}|r|}tjd|nt!t"j%j&j&}|dz d z dz t!d t!d g}|D]5}|j)st+|}tjd |nt j dk(r|j d stj|s|dz} tj| r| }tjd|nt!t"j&j&j-} t+| dz d z dz ddtjj/dg} | D]=} tjj1| s#| }tjd|n||_t j dk(|_y)ak Initialize SonarQube scanner. Args: sonar_url: SonarQube server URL sonar_token: SonarQube authentication token scanner_path: Invoke this command to run the scanner (e.g. "sonar-scanner" when in PATH). Set via SONAR_SCANNER_PATH or config scanning.sonar_scanner_path. / sonar-scannerr\.bat.cmdzC:z#9#9#;#B#B#I#IL$6>PCDMN"J !+"<<>+.t9L"KK(DlS! " ??  )(()AB||L1+f4H||H-'/  &@$OP&*(^%:%:%A%A%J%J%L  _ is for SonarQube *project analysis* tokens (sqp_...). Server REST calls use self.sonar_token (user/global SONARQUBE_TOKEN) — project tokens cannot manage projects or read all metrics APIs. -_SONARQUBE_TOKEN_r)rJreplaceupperr(r)r*r+)rbrlsuffixr6s r_token_for_slugz SonarQubeScanner._token_for_slugsf ## #""3,224::>>$4VH"=rBHHJ#x9)9)99r repo_pathsonar_properties_path max_retries retry_delayc tjd|jd}t|dzD]}|dkDr?|d|dz zz}tjd|d|d|d t j ||j |||j}|jd r|cS|jd d }d |vsd|vr%||kr tjd|d|zzd |cS|r|SdddS)a Run SonarQube scan on a repository with retry logic for concurrent scan errors. Args: repo_path: Path to repository directory sonar_properties_path: Path to sonar-project.properties file max_retries: Maximum number of retries for concurrent scan errors (default: 3) retry_delay: Initial delay in seconds between retries (default: 60, doubles each retry) Returns: Dictionary with scan results including: - success: bool - task_id: str (if available) - analysis_id: str (if available) - error: str (if failed) zStarting SonarQube scan for NrzRetry attempt rMz after waiting z seconds...successerrorr1Another SonarQube analysis is already in progressalready in progressz/Another analysis is in progress. Will retry in FzScan failed after all retriesr|r}) rUrVr!rangetimesleep _execute_scanr*warning) rbrurvrwrxresultattempt wait_time error_msgs rrun_scanzSonarQubeScanner.run_scans"  29>>2BCD[1_- G{'11+=>  nWIQ{m?S\R]]hij 9%'' 3H)..YFzz)$  7B/ICyP%2+8M!PQ\`ael`lQmPnnyz{M) . vaA`%aarc |dz }|jdd|dz }|jddtjd||j|tj j }|j||d<t}|r8t|jdd||d<tjd |d d ttjjd z }|jddt|j|d <tjd|t j } t j"| |j$rA|j&j)dr&t+j,|j&dd|dd} n%t+j,|j&gdd|d} | j.dk(r~tj1d|j2|j5| j6} |j9| j6} d| | | j6dt j"| S| j:xs | j6} tj=d|j2d| d| vsd| vr/tj?dtj1d| dz } d| vsd| vsd| vr_tj?d|dz }|jdd|dz }|jddtj1d | d!z } d"| vsd#| vrtj?d$|jA}|rtj1d%| d&z } nOtj?d'tj?d(tjBjEd)| d*z } d+| | j6d,t j"| S#t j"| wxYw#t*jF$r*tj=d-|j2d+d.d/cYStH$r}d0|j&} tj=| tj=d1tj=d2tj=d3tj=d4d+| d/cYd }~Sd }~wtJ$r}t|} tj=d5|d"| vsd#| vrtj?d$|jA}|rtj1d%| d&z } nOtj?d'tj?d(tjBjEd)| d*z } d+| d/cYd }~Sd }~wwxYw)6aa Execute a single SonarQube scan attempt. Args: repo_path: Path to repository directory sonar_properties_path: Path to sonar-project.properties file repo_slug: Directory name / repo slug (for per-repo SONARQUBE_TOKEN_) Returns: Dictionary with scan results z .scannerworkT)parentsexist_okz .sonartmpz(Ensured scanner work directories exist: SONAR_TOKENPATHrz/Prepended Node bin dirs to PATH for SonarJS: %sNz .sonar_cacheSONAR_USER_HOMEz!Using SonarQube cache directory: rPi)capture_outputtextenvtimeoutshell)rrrrrz*SonarQube scan completed successfully for )r|task_id analysis_idoutputzSonarQube scan failed for : r~rzBAnother SonarQube analysis is already in progress for this projectzKThis usually means a previous scan is still running on the SonarQube serverz< Another analysis is in progress. Will retry automatically.zFailed to create temp fileNoSuchFileExceptionzHDetected temp file creation error, ensuring scanner directories exist...z8Scanner work directories created. Please retry the scan.z5 Scanner directories created. Please retry the scan.AccessDeniedExceptionzFailed to extract archivezGDetected cache/permission error, attempting to clear SonarQube cache...z2Cache cleared successfully. Please retry the scan.z' Cache cleared. Please retry the scan.z;Could not clear cache automatically. Please manually clear:z ~/.sonar/cachez7 Please clear the SonarQube cache directory and retry.F)r|r}rzSonarQube scan timed out for zScan timed out after 30 minutesrzSonarQube scanner not found: z4Please ensure sonar-scanner is installed and either:z" 1. Added to your system PATH, orzH 2. Set the 'scanning.sonar_scanner_path' config value to the full pathz< Example: C:\Program Files\SonarQube\bin\sonar-scanner.batz(Unexpected error during SonarQube scan: )&mkdirrUdebug_update_sonar_propertiesr(r)copyrtr?rFr*rr]r0r'r_getcwdchdirrarKrT subprocessrun returncoderVr!_extract_task_idstdout_extract_analysis_idstderrr}r_clear_sonar_cacherYr,TimeoutExpiredFileNotFoundError Exception)rbrurvrlscannerwork_dir sonartmp_dirrrAproject_cache_dir original_cwdrrrr cache_clearedes rrzSonarQubeScanner._execute_scansBQ '.8O  ! !$ ! >+[8L   td  ; LLCOCTU V  ) )*? @**//#C!%!5!5i!@C 68I2377623F RF  NPYZ\[\P]^!%X 5 5 < <~ M   # #D4 # @%():)C)C)E%FC! " LL<=NILL#=inn=MRPY{![\KiW[pt}[}'kl $qr!%ee 4y@DY]fDfjuzCkC'qr*3n*D'--dT-J'6'D $**4$*G $^_!%^^ /);?Z^g?g'pq(,(?(?(A ("KK(\]%)TTI"NN+hi"NNR0B0BCS0T/U+VW%)ddI$)!*"(-- &&((  LL88HI J : ! 78I8I7JKI LL # LLO P LL= > LLc d LL[ ] "  AI LLCA3G H')37RV_7_hi $ 7 7 9  KK TU!LLINN#`aNNR(:(:;K(L'M#NO!\\I!" ! s^E%P (C)PP 'F P0P PP :V=V=$AbAA os+ !q  ! !; # #: ! ! N NNHL M M NsL DC8B>DD/D8D=DD  D D D;D66D;rcddl}|jd||j}|r|jdS|jd|}|r|jdSy)z Extract task ID from scanner output. Args: output: Scanner output text Returns: Task ID string or None rNz#EXECUTION SUCCESS.*?taskId=([^\s]+)rzztaskId[=:]\s*([^\s\n]+))rsearchDOTALLgrouprbrrmatchs rrz!SonarQubeScanner._extract_task_idsV  @&"))T ;;q> ! 4f= ;;q> !rcVddl}|jd|}|r|jdSy)z Extract analysis ID from scanner output. Args: output: Scanner output text Returns: Analysis ID string or None rNzanalysisId[=:]\s*([^\s\n]+)rz)rrrrs rrz%SonarQubeScanner._extract_analysis_ids,  8&A ;;q> !r project_keyc dd|ji}|jd}d|i}tj|||d}|j |j }|jd}|dd }tj|||d} | j d k(r| j ni} |jd ijd d | jdijdgtjjdS#t$r"} tjd| Yd} ~ yd} ~ wwxYw)a Get scan results from SonarQube API (uses global SONARQUBE_TOKEN, not project analysis tokens). Args: project_key: SonarQube project key Returns: Dictionary with scan metrics and quality gate status AuthorizationBearer z /api/qualitygates/project_status projectKeyparamsheadersrz/api/measures/componentzHcoverage,bugs,vulnerabilities,code_smells,duplicated_lines_density,ncloc) component metricKeys projectStatusstatusUNKNOWNrmeasures) quality_gatemetrics timestampz/Failed to get scan results from SonarQube API: N) rJrIrequestsr*raise_for_statusjson status_codernow isoformatrrUr}) rbrr status_urlrresponse status_data metrics_urlmetrics_paramsmetrics_response metrics_datars rget_scan_resultsz!SonarQubeScanner.get_scan_resultssH &'$2B2B1C(DEG NN++KLJ"K0F||JvwXZ[H  % % '"--/K"^^,,CDK(hN (||%    7G6R6RVY6Y+002_aL!, D H HS\ ]'++K<@@RP%\\^557    LLJ1#N O sDD D>D99D>cN t|d5}|D]O}|jjds#|jdddjccdddS dddy#1swYyxYw#t$r"}t j d|Yd}~yd}~wwxYw)z Extract project key from sonar-project.properties. Args: properties_path: Path to sonar-project.properties file Returns: Project key string or None rzsonar.projectKey=rzNzFailed to read project key: )rr+rsplitrrUr)rbrrrrs rget_project_keyz SonarQubeScanner.get_project_keys ?os+ =q=Dzz|../AB#zz#q1!4::<< = == =   =  ? NN9!= > > ?sE A9%A-$A- A9"A-$A9-A62A96A99 B$BB$c |jd}d|i}dd|ji}tj|||d}|j |j }|jdg}|D]1}|jd|k(st jd |d y t jd |d y #tj$r@} | jjdk(rYd} ~ y t jd| Yd} ~ y d} ~ wt$r"} t jd| Yd} ~ y d} ~ wwxYw)z Check if a SonarQube project exists (uses global SONARQUBE_TOKEN). Args: project_key: SonarQube project key Returns: True if project exists, False otherwise z/api/projects/searchprojectsrrrr componentsr$ Project 'z' exists in SonarQubeTz' not found in SonarQubeFiNz"Error checking project existence: z#Failed to check if project exists: ) rIrJrr*rrrUr HTTPErrorrrrr) rbrurlrrrdatarrrs rcheck_project_existsz%SonarQubeScanner.check_project_existss/ ^^$$89C +.F&'$2B2B1C(DEG||CQSTH  % % '==?D,3J( ==';6LL9[M9N!OP LL9[M1IJ K!! zz%%, NN?sC D  NN@D E s6BC C&CD=D2D D=D88D= project_name description visibilityc" |jd}dd|ji}|||d}|r||d<tj|||d}|jdk(rt j d |d |d y |jd k(rT|j} d| jvrt j d|dy t jd|d| y|jy#tj$rg} t jd|d| t| jdr,t jd| jjYd} ~ yd} ~ wt $r%} t jd|d| Yd} ~ yd} ~ wwxYw)a Create a new project in SonarQube (uses global SONARQUBE_TOKEN). Args: project_key: SonarQube project key (must be unique) project_name: Display name for the project description: Project description (optional) visibility: Project visibility - "private" or "public" (default: private) Returns: True if project was created successfully, False otherwise z/api/projects/createrr)projectr!rrr)rrrrz(Successfully created SonarQube project: z ()Tizalready existsrz' already exists in SonarQubezFailed to create project 'z': Fz'HTTP error creating SonarQube project 'rz Response: Nz$Failed to create SonarQube project ')rIrJrpostrrUrVrlowerrrrr}hasattrrrr) rbrrrrrrrr error_textrs rcreate_projectzSonarQubeScanner.create_project@s&$ ^^$$89C&'$2B2B1C(DEG'$(D &1]#}}StWbQH##s* F{mSUVbUccdef%%,%]] #z'7'7'99KK)K=8U VW!;K=J<XY))+!!  LLB;-sSTRUV Wqzz6* z!**//):;<  LL? }CPQsS T s8A1C(4AC(;C(C((F;AE F)F  FcD|dz } d|d|d|jd}t|dd5}|j|d d d tj d |j d ||S#1swY0xYw#t $r}tjd |d }~wwxYw) aN Generate sonar-project.properties file with default values. Args: repo_path: Path to repository directory project_key: SonarQube project key project_name: Project display name Returns: Path to created sonar-project.properties file zsonar-project.propertiesz{# SonarQube Project Properties # Auto-generated by SonarQube Scanner Automation # Project identification sonar.projectKey=z sonar.projectName=zL # Source code location sonar.sources=. # SonarQube server sonar.host.url=z( # Encoding sonar.sourceEncoding=UTF-8 rrrNz'Generated sonar-project.properties for rz-Failed to generate sonar-project.properties: )rIrrrUrVr!rr})rbrurrrproperties_contentrrs rgenerate_sonar_propertiesz*SonarQubeScanner.generate_sonar_propertiesys$&@@ &.!  " $osW= ,*+ , KKA)..AQQSTcSde f" "  , ,   LLHL M  s-$A8A,.A8,A51A88 BBB)rN)r<)rprivate)__name__ __module__ __qualname____doc__r'rkrrtrintrrrboolrrrrrrrr r rrrHrHJs0J9#J9CJ9sJ9X :# :3 :+b$+bt+bRU+bhk+buy+bZ]t]D]UX]]a]~D2*N*N*NXsx},38C= )C)HTN)Vt &$$$T# 777 7  7  7r)4)c)Y\)ae)rrH)rr(rloggingrrr[r1pathlibrtypingrrrr getLoggerrrUr'r?rFrHrrrrsz   ''   8 $,S ,^S cX X r