.cj UdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlZddlmZddlmZmZmZmZddlmZddlmZddlmZdd l m!Z"m#Z#m$Z$m%Z&dd l'm(Z(m)Z)ej*e+Z,d Z-d e-Z.d e-dZ/dZ0dZ1ee2e2e2fZ3iZ4de5d<dZ6dZ7dZ8dZ9dpdZ:e#e6e:Z;de5d<dqdrd"Zd%d&dtd)Z?dud*Z@dud+ZAd%d,dvd.ZBdwd2ZCdxd5ZDdyd7ZEdzd;ZFd{d>ZGd|d@ZHd}dCZId~dEZJddHZKddIddLZLddIddPZMddQdRdSdd%ddTdd]ZNdd^ZO ddd`ZPdadSd%dQdRdSdd%ddb ddhZQGdidje)ZRddmZSdqddnZTdqddoZUdS)uBBitwarden Secrets Manager (`bws` CLI) integration. Hermes pulls API keys from Bitwarden Secrets Manager at process startup so they don't have to live in plaintext in ``~/.hermes/.env``. Design summary -------------- * The ``bws`` binary is auto-installed into ``/bin/bws`` on first use. Hermes pins one version (``_BWS_VERSION``) and downloads the matching asset from the official GitHub Releases page, verifying the SHA-256 against the release's published checksum file. * The access token is stored in ``~/.hermes/.env`` as ``BWS_ACCESS_TOKEN`` (or whatever name the user picked in ``secrets.bitwarden.access_token_env``). This is the one bootstrap secret — every other provider key can live in Bitwarden. * Pulling secrets is a single ``bws secret list --output json`` call. We cache the result in-process for ``cache_ttl_seconds`` so back-to-back ``hermes`` invocations don't hammer the API. * Failures NEVER block Hermes startup. Missing binary, no network, expired token, etc. all emit a one-line warning and continue with whatever credentials ``.env`` already had. The module is intentionally subprocess-driven rather than going through the ``bitwarden-sdk-secrets`` Python package: one cross-platform binary is easier to lazy-install than a wheels-with-Rust-extension dependency. ) annotationsN)Path)DictListOptionalTuple)hashes)AESGCM)HKDF) CachedFetch DiskCache FetchResultis_valid_env_name) ErrorKind SecretSourcez2.0.0z;https://github.com/bitwarden/sdk-sm/releases/download/bws-vzbws-sha256-checksums-z.txt<zDict[_CacheKey, _CachedFetch]_CACHEzbws_cache.jsonzbws_cache.enc.jsonshermes-bws-encrypted-cache-v1 cache_key _CacheKeyreturnstrc"|\}}}|d|d|S)z:Serialize a cache key to a stable string for JSON storage.|)rtoken_fp project_id server_urls @/home/ice/.hermes/hermes-agent/agent/secret_sources/bitwarden.py_cache_key_strr!is*'0$Hj* 2 2 2 2j 2 22)key_serializerr _DISK_CACHE home_pathOptional[Path]rc6t|S)zReturn the disk cache path under hermes_home/cache/. Thin wrapper over the shared DiskCache, kept for tests and any direct callers; falls back to `$HERMES_HOME` / `~/.hermes` when home is None. )r$pathr%s r _disk_cache_pathr*ts   I & &&r"c:ddlm}||dz tz S)z>Return the encrypted disk cache path under hermes_home/cache/.r)resolve_cache_homecache)agent.secret_sources._cacher,_ENCRYPTED_CACHE_BASENAME)r%r,s r _encrypted_disk_cache_pathr0}s0>>>>>>  i ( (7 25N NNr"c(ddlm}|dz S)z9Where Hermes stores its managed binaries. Profile-aware.rget_hermes_homebin)hermes_constantsr3r2s r _hermes_bin_dirr6s'000000 ?  u $$r"Finstall_if_missingr8boolc|ttz }|r!tj|tjr|St jd}|rt|S|rB tS#t$r&}t d|Yd}~dSd}~wwxYwdS)uRReturn a path to a usable ``bws`` binary, or None. Resolution order: 1. ``/bin/bws`` (our managed copy — preferred) 2. ``shutil.which("bws")`` (system PATH) When ``install_if_missing`` is True and neither resolves, this calls :func:`install_bws` to download and verify the pinned version. bwszbws auto-install failed: %sN) r6_platform_binary_nameexistsosaccessX_OKshutilwhichr install_bws Exceptionloggerwarning)r8managedsystemexcs r find_bwsrJs"7"9"99G~~BIgrw77 \% F F|| ==     NN8# > > >44444  4s; B B9B44B9c8tjdkrdndS)NWindowszbws.exer;)platformrHrr"r r<r<s ))Y6699EAr"ctj}tj}|dkr dtdS|dkr|dvrdnd}d|d tdS|d kr|dvrdnd}d } t jd d gdddt j}d|j|j zvrd}n#tt j f$rYnwxYwd|d|dtdStd|d|)uMap (uname, arch, libc) → the upstream asset filename. Asset names follow Rust's target triple convention. Linux defaults to gnu (glibc); we switch to musl only if ldd --version says so. Darwinzbws-macos-universal-z.ziprL)arm64aarch64rQx86_64zbws-z-pc-windows-msvc-Linuxgnulddz --versionT)capture_outputtexttimeoutstdinmuslz-unknown-linux--z+Unsupported platform for bws auto-install:  ) rMrHmachinelower _BWS_VERSION subprocessrunDEVNULLstdoutstderrOSErrorTimeoutExpired RuntimeError)rHr^archlibcress r _platform_asset_namerlsm _  F  &&((G 9l8888 #';;;yy?d??\???? #';;;yy . $# ( C#*sz188::::23    D DdDD4DD,DDDD HfHHwHH  s7A CCC)forcermc \t}|dd|tz }|r|s|St }t d|}t dt }tjd5}t|}||z }|t z } t d|t||t|| t| |} t|} | | krt!d|d| d | t#j|5} t'| t} t)| | |}d d d n #1swxYwYtjt-|d \}}t/j|t3j||t/j|t8jt8jzt8jzt8j zt8j!zt8j"zt8j#zt/j$||d d d n #1swxYwYt d tJ||S)uZDownload, verify, and install the pinned ``bws`` binary. Returns the path to the installed executable. Raises on any failure (network, checksum, extraction) — callers in the auto-install path catch these; the user-facing ``hermes secrets bitwarden setup`` surface lets them propagate so the wizard can show a clear error. Tparentsexist_ok/z hermes-bws-)prefixzDownloading %szChecksum mismatch for z : expected z, got Nz.bws_)dirrszInstalled bws %s at %s)&r6mkdirr<r=rl_BWS_RELEASE_BASE_BWS_CHECKSUM_NAMEtempfileTemporaryDirectoryrrEinfo_http_download_expected_sha256 _sha256_filer_rhzipfileZipFile_pick_zip_member_safe_extract_membermkstemprr>closerAcopy2chmodstatS_IRUSRS_IWUSRS_IXUSRS_IRGRPS_IXGRPS_IROTHS_IXOTHreplacer`)rmbin_dirtarget asset_name asset_url checksum_urltmpdirtmpzip_path checksum_pathexpectedactualzfmember extractedfdstageds r rCrCsG MM$M... ,.. .F }}u %''J$33z33I'>>*<>>L  $M : : :$#f6ll#00  $i000y(+++|]333#M:>>h'' >>  v||~~ - -555$55,255  _X & & >"%b*?*A*ABBF -R==I  > > > > > > > > > > > > > > >%#g,,wGGG F   Y'''   L4< '$, 6l !\ *l !\ *   66"""I$#$#$#$#$#$#$#$#$#$#$#$#$#$#$#L KK(,??? Ms8CJ.F JF JF CJJJurldestNonectj|ddi} tj|t5}t |d5}t j||dddn #1swxYwYddddS#1swxYwYdS#tjj $r}td|d||d}~wwxYw)Nz User-Agentz hermes-agent)headers)rYwbzFailed to download : ) urllibrequestRequesturlopen_BWS_DOWNLOAD_TIMEOUTopenrA copyfileobjerrorURLErrorrh)rrreqrespfrIs r r{r{sd . |^.L M MCH ^ # #C1F # G G ,4dD!! ,Q"4+++ , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , < HHH=====>>CGHs_&B# BA>2 B>B BB B B#BB#BB##C7C  C checksum_filerc0|dd}|D]Q}|}t |dkr|d|kr |dcSRt d|d|j) zParse the upstream ``bws-sha256-checksums-X.Y.Z.txt`` file. Format is the standard ``sha256sum`` output: `` ``, one per line. utf-8r)encodingerrorsrVrzNo checksum entry for z in ) read_text splitlinesstripsplitlenrhname)rrrXlinepartss r r|r|!s  " "GI " F FD!! ""$$ u::??uRyJ668OOO EEE1CEE  r"r(ctj}t|d5tfddD]}|| dddn #1swxYwY|S)Nrbc.dS)Ni)read)rsr z_sha256_file..4s!&&--r"r")hashlibsha256riterupdate hexdigest)r(hchunkrs @r r}r}1sA dD  Q////55  E HHUOOOO  ;;==s,AA"%A"rzipfile.ZipFile binary_namecfd|D}|s0tdd|ddd|t|dS) zFind the binary inside the upstream zip. Historically the archive has been flat (``bws`` at the root) but we tolerate a top-level directory just in case upstream changes. cRg|]#}|ddk!|$S)rrr)r).0nrs r z$_pick_zip_member..?s2NNNaggcll2.>+.M.M!.M.M.Mr"zCould not find z% inside downloaded archive (members: Nz...))keyr)namelistrhsortr)rr candidatess ` r rr9s ONNNR[[]]NNNJ   1k 1 1rr* 1 1 1   OOO a=r"rdest_dirctj|}tjtj||} tj||g|k}n#t $rd}YnwxYw|r||krt d|d|||t|S)aMExtract a single archive member, refusing path traversal. ``ZipFile.extract`` will happily honour member names containing ``../`` or absolute paths, letting a malicious archive write outside ``dest_dir`` (a "zip-slip"). We resolve the would-be target and confirm it stays within ``dest_dir`` before extracting. Fz*Refusing to extract unsafe archive member z%: it escapes the extraction directory) r>r(realpathjoin commonpath ValueErrorrhextractr)rrr dest_rootr containeds r rrJs  **I W  bgll9f== > >FG&& 6':;;yH    )++ 3 3 3 3   JJvy!!! <<s%B BBtokenctj|dddS)uESHA-256 prefix used as a cache key — never logged, never displayed.rN)rrencoder)rs r _token_fingerprintrjs3 >%,,w// 0 0 : : < rrfurandomr!rjsondumpsrrrr encrypt_ENCRYPTED_CACHE_VERSIONrrxrrfdopendumprr*unlinkFileNotFoundError BaseExceptionrD)rrrr%r( cache_dirrrserialized_keyr plaintextrpayloadrrrs r _write_encrypted_disk_cachers &i 0 0D0K t444  HY & & & &    D z"~~ 2' 22),==J U5E F F!    &// C[[(( 9n33G<<  0!$KK5\\ ++   "$VY   C 2sW555 & '1%%% & & & & & & & & & & & & & & & HS% JsD ! ! !  ++224444$       54     #        sI AI  AI ADI &H=F HF##H&F#'-H!G76H7 HH H HHH I #H87I 8 II II  I IImax_age_secondsfloatOptional[_CachedFetch]c$|dkrdSt|} tj|d}t |t sdSt |}|dtkrdS|d|krdStt|dd}tt|d d}tt|d d} t||} t|  || |d} tj| d} t | t sdS| d } | d }t | t rt |t t"fsdSt%jt#|z }|dks||krdSd | D}t)|t#|S#t*$rYdSwxYw)zHReturn a decrypted encrypted-cache entry if it matches and is in-window.rNrr rrrrrrrcni|]2\}}t|tt|t/||3Sr) isinstancer)rkvs r z._read_encrypted_disk_cache..sP   Q!S!! &0C&8&8 q   r"r)r0rloadsrr"dictr!getrrrrr decryptrrintrtimeitemsrrD)rrrr%r(rrrrrrrinnerrinner_fetched_at entry_agetypeds r _read_encrypted_disk_cacher1sd!t %i 0 0D *T^^W^==>>'4(( 4' 22 ;;y ! !%= = =4 ;;u   / /4SVR001122c'++gr2233443w{{<<<==>> ),==Skk!! :~44W==   3::g..//%&& 4))I&& 99\22'4((  ;KcSX\0Z0Z 4IKK%(8"9"99 q==I774  $]]__   Ee<=== <:;;;#L11:z?ORPI+&**I&&  &foo&788 &>2% % " T4#) 1# KK&**96GSSK  "!,F9 &* *  5H555C { 0   0)#|ZTT ...*#3s88,,  )"3Y5F!GGG& 2'!-$E'  $c49;;1A#ABBC(-F9% =H#HH7:3xxHHH+%#Q&&#((E%LL)LL$c49;;1A#ABBC(-F9% =N#NN=@XXNNN+ ].^ TY[[ A A AEN q %F9  " N (#)#        " "   i0A9 M M M H s2$C;; H:B H5&H:,BH5.H:4H55H:cx|dd}|s|Sg}|D]_}|}|drn3|dvr2t jdd|}|r||`|rd|n|S)aReduce a bws (Rust color-eyre) error dump to its cause line(s). bws failures look like:: Error: 0: Received error message from server: [400 Bad Request] {"error":"invalid_client"} Location: crates/bws/src/main.rs:108 ... Everything from ``Location:`` on is diagnostic noise for a Hermes user. Keep the numbered cause lines (joined), drop the rest, and fall back to the stripped raw text when the shape is unrecognized. r )z Location:zBacktrace omittedz Run with )r zError:z^\d+:\s*z; )rrr startswithresubappendr)rrXcausesrstrippeds r _summarize_bws_stderrrRys ;;vr " " ( ( * *D  F!! $ $::<<   N O O  E ~ % % 6+r844  $ MM( # # # & 0499V   D0r"r;ct|dd|ddg}tj}||d<|dd|r||d< t j||d d tt j }nP#t j $r}td td |d}~wt$r}td ||d}~wwxYw|j dkr?t|jp|jpd}td|j d|dd|j} | sidgfS t#j| } n*#t"j$r}td||d}~wwxYwt)| t*s$tdt-| ji} g} | D]} t)| t0s| d}| d}t)|trt)|tsmt5|s| d|d|| |<| | fS)Nsecretlistz--outputrBWS_ACCESS_TOKENNO_COLOR1BWS_SERVER_URLT)envrWrXrYrZzbws timed out after zs fetching secretszfailed to invoke bws: rr z bws exited rz'bws returned no output (empty project?)zbws returned non-JSON output: zbws returned unexpected shape: rvaluezSkipping secret z: not a valid env-var name)rr>environcopy setdefaultrarb_BWS_RUN_TIMEOUTrcrgrhrf returncoderRrerdrrr&JSONDecodeErrorr"rUtype__name__r'r(_is_valid_env_namerO)r;rrrcmdrZprocrIerrrrrrEitemrr\s r r=r=s s88Xvz:v FC *//  C*CNN:s### + * D~ $$      $ G#3 G G G    DDD9C99::CD ! $DK$D4;$D"EE 8$/ 8 8S#Y 8 8    +    C ?=>>>L*S//  LLLACAABBKL gt $ $  Fd7mm.D F F   !GH  $%%  hhuoo!!#s## :eS+A+A  !#&&  OOD3DDD     H s<)BCB)) C6C  C<EE8 E33E8rV) access_token_envroverride_existingr4 auto_installrr%r6r7enabledrjrkrlrc t} |s| Stj|d} | s d|d| _| S|s d| _| St |} | | _| d| _| S t| || ||||| \} }n-#t$r }t|| _| cYd}~Sd}~wwxYw| | _ | j || D]\}}||kr| j|&|s:tj|r| j|b|tj|<| j|| S) u8Pull secrets from BSM and set them on ``os.environ``. This is the function ``load_hermes_dotenv()`` calls after the .env files have loaded. It is intentionally defensive — any failure returns a :class:`FetchResult` with ``error`` set; it never raises. ``server_url`` selects the Bitwarden region or self-hosted endpoint (e.g. ``https://vault.bitwarden.eu`` for EU Cloud). Empty string means use ``bws``'s default (US Cloud). Parameters mirror the ``secrets.bitwarden.*`` config keys so the caller can just splat the dict in. r &secrets.bitwarden.enabled is true but 3 is not set. Run `hermes secrets bitwarden setup`.Msecrets.bitwarden.project_id is empty. Run `hermes secrets bitwarden setup`.r7Nhbws binary not available and auto-install is disabled. Run `hermes secrets bitwarden setup` to install.rrr3r4rr%r6r7)rr>r]r(rrrJ binary_pathrIrhrrrEextendr,skippedrOapplied)rmrjrrkr4rlrr%r6r7resultrr3rrErIrr\s r apply_bitwarden_secretsrys4]]F  :>>"2B77==??L  >5E > > >    4    6 6 6FF ~ ?    3%!/!$;.O     3xx  FN O8$$$mmoo # # U " " " N ! !# & & &   RZ^^C%8%8  N ! !# & & &  3c"""" MsB C'C<CCcTeZdZdZdZdZdZdZdd Zdd Z dd Z ddZ dfd Z xZ S)BitwardenSourceuBitwarden Secrets Manager as a registered secret source. Thin adapter over the module's fetch machinery. ``fetch()`` only *fetches* — precedence, override semantics, conflict warnings, and the ``os.environ`` writes are the orchestrator's job (see ``agent.secret_sources.registry.apply_all``). Bitwarden is a **bulk** source: it injects every secret in the configured BSM project, so explicit per-var bindings from mapped sources (e.g. the 1Password ``env:`` map) outrank it. bitwardenzBitwarden Secrets Managerbulkr;cfgr'rr9crtt|to|ddS)NrkT)r9r"r'r()selfr~s r rkz!BitwardenSource.override_existingYs0 JsD))Pcgg6I4.P.PQQQr"cd}t|tr$t|dp|}t |hS)NrVrj)r"r'rr( frozenset)rr~ token_envs r protected_env_varsz"BitwardenSource.protected_env_vars`sI& c4  FCGG$677D9EEI)%%%r"c Nddddddddddd dd dd d dd dddddddddS)Nz Master switchF) descriptiondefaultz0Env var holding the machine-account access tokenrVzBSM project UUIDr z9Fresh disk+memory cache TTL; 0 disables fresh-cache reuser2z6Encrypted last-good cache for network/timeout fallbackr)rmmax_stale_secondsz&BSM values overwrite .env/shell valuesTz#Auto-download the pinned bws binaryz0Region / self-hosted endpoint (empty = US Cloud))rmrjrr4encrypted_cacherkrlrr)rs r config_schemazBitwardenSource.config_schemafs'65IIQ-!!+=LLZ"" X$)*   H"" E R5   r"r%rrc t|tr|ni}t}t|dpd}t j|d}|sd|d|_tj |_ |St|dpd}|sd|_tj |_ |St|dd }t| }||_|d |_tj|_ |S t!|d d } n#t"t$f$rd} YnwxYw|d} t| tr| ni} t| dd} t!| dd} n#t"t$f$rd} YnwxYw t'|||| t|ddpd|| | \} }nv#t($ri}t||_t+t||_ |j tjkrd|d|jd|_|cYd}~Sd}~wwxYw| |_|j||S)NrjrVr rorprrqrlTr7rrr4r2gr@rrmFrrr:rrsz5Bitwarden rejected the machine-account access token (uF) — it was likely revoked, expired, or belongs to another region. ())r"r'rrr(r>r]rrrNOT_CONFIGURED error_kindr9rJrtBINARY_MISSINGr TypeErrorrrIrhr> AUTH_FAILEDrrEru)rr~r%rxrjrrrlr3ttl encrypted_cfgencrypted_enabledencrypted_max_stalerrErIs r fetchzBitwardenSource.fetchsBT**2ccsww'9::P>PQQz~~&6;;AACC  B9IBBB L!* 8F M..4"55  8 L!* 8F MCGGND99:: \:::# >C L!* 8F M  3S99::CC:&   CCC  122 )3M4)H)HP b  !2!29e!D!DEE &"' (9(9:Mq(Q(Q"R"R  :& & & &"%    &  7)%"%sww|R88>B??EEGG#(92E ! ! ! GXX   s88FL 3CHH = =F  I$999G(GG7=|GGG MMMMMM !x((( sD5#EE/.E/#G((G>=G>AI KAK:KKrc|tjtjfvr dSt||S)NuRun `hermes secrets bitwarden token` to paste a fresh access token (create one in the Bitwarden web app: Secrets Manager → Machine accounts → Access tokens). Wrong region? Re-run `hermes secrets bitwarden setup` and pick EU/self-hosted.)rr AUTH_EXPIREDsuper remediation)rrFr~ __class__s r rzBitwardenSource.remediationsE I)9+AB B BL   ww""4---r")r~r'rr9)r~r')rr')r~r'r%rrr)r~r'rr)rd __module__ __qualname____doc__rlabelshapeschemerkrrrr __classcell__)rs@r r{r{Gs   D 'E E FRRRR&&&&     BIIIIV..........r"r{messagerc(|dvr tjSdvsdvr tjSt fddDr tjSt fddDr tjStjS)zABest-effort mapping of bws failure text onto the shared taxonomy.z timed outzbinary not availablezfailed to invokec3 K|]}|vV dSNrrtoklowereds r z&_classify_bws_error..s7 : :c3'> : : : : : :r") unauthorizedz invalid tokenz access token401403invalid_client invalid_grantz400 bad requestc3 K|]}|vV dSrrrs r rz&_classify_bws_error..s7 : :c3'> : : : : : :r")network connectionresolvedownloaddns)r_rr@ranyrr?INTERNAL)rrs @r r>r>smmooGg  ((,>',I,I''  : : : :&9 : : :::%$$  : : : :&9 : : :::!   r"ctt| t|dS#t t f$rYdSwxYw)aYDrop in-process AND disk caches (plaintext and encrypted). Used after a token rotation (`hermes secrets bitwarden token`) so the next startup fetches fresh with the new credential instead of serving a pull cached under the old token's fingerprint. The encrypted cache is keyed off the old token too, so it must go as well. N)rclearr$r0rrrfr)s r clear_cachesrsq LLNNNi    "9--4466666 w '     s!AA-,A-c$t|dS)zClear in-process AND disk caches. Tests can pass ``home_path`` to scope the disk cleanup to a tmpdir. Without it we fall back to the same default resolution as the cache writer itself. N)rr)s r _reset_cache_for_testsrsr")rrrrr)r%r&rr)rr)r8r9rr&)rr)rmr9rr)rrrrrr)rrrrrr)r(rrr)rrrrrr)rrrrrrrr)rrrr)rrrr)rXrrr)rrrrrr) rrrrrrr%r&rr) rrrrrrr%r&rr)rrrrr3r&r4rr5r9rrr%r&r6r9r7rrr8)rrrr)r ) r;rrrrrrrrr8)rmr9rjrrrrkr9r4rrlr9rrr%r&r6r9r7rrr)rrrr)r%r&rr)Vr __future__rrrrloggingr>rMrMrArrarxr+ urllib.errorrurllib.requestr~pathlibrtypingrrrrcryptography.hazmat.primitivesr +cryptography.hazmat.primitives.ciphers.aeadr 'cryptography.hazmat.primitives.kdf.hkdfr r.r rr rrreagent.secret_sources.baserr getLoggerrdrEr`rvrwrr`rrr__annotations___DISK_CACHE_BASENAMEr/rrr!r$r*r0r6rJr<rlrCr{r|r}rrrrrrrr1rIrRr=ryr{r>rrrr"r rsN:#"""""     ............111111>>>>>>888888 >=======  8 $ $ Q,PP@\??? #sC- (*****(083333 #  '''''OOOOO%%%%,16BBBB((((V"'::::::zHHHH     "@BBBB 1111AAAA++++!% ======J!% ++++++d"" $$)/0GGGGGGT1111DFHGGGGGd/#" $$)/0VVVVVV|S.S.S.S.S.lS.S.S.l6      r"