nSj*(dZddlmZddlZddlZddlmZmZmZddl m Z ej e Z ddZdd Zdd Zdd ZeZeZddZGdde ZdS)uParallel.ai web search + content extraction — plugin form. Subclasses :class:`agent.web_search_provider.WebSearchProvider`. Uses two distinct Parallel SDK clients: - ``Parallel`` (sync) — for :meth:`search` - ``AsyncParallel`` (async) — for :meth:`extract` This is the first plugin to exercise the **async-extract** code path in the ABC: :meth:`extract` is declared ``async def``, and the dispatcher in :func:`tools.web_tools.web_extract_tool` detects coroutines via :func:`inspect.iscoroutinefunction` and awaits. Config keys this provider responds to:: web: search_backend: "parallel" # explicit per-capability extract_backend: "parallel" # explicit per-capability backend: "parallel" # shared fallback # Optional: search mode (default "agentic"; also "fast" or "one-shot") # via the PARALLEL_SEARCH_MODE env var. Env vars:: PARALLEL_API_KEY=... # https://parallel.ai (required) PARALLEL_SEARCH_MODE=agentic # optional: agentic|fast|one-shot ) annotationsN)AnyDictList)WebSearchProviderreturnNonec ddlm}|dddS#t$rYdSt$r!}tt |d}~wwxYw)aMTrigger lazy install of the parallel SDK if it isn't present. Mirrors the lazy-deps pattern used by the legacy implementation. Swallows benign ImportError from the lazy_deps helper itself; if the SDK is genuinely missing the subsequent ``from parallel import ...`` raises ImportError that the caller can handle. r)ensurezsearch.parallelF)promptN)tools.lazy_depsr ImportError Exceptionstr) _lazy_ensureexcs ?/home/ice/.hermes/hermes-agent/plugins/web/parallel/provider.py_ensure_parallel_sdk_installedr.s$:::::: &u555555      $$$#c((###$s A AA  Arcddlm}t|dd}||Sddlm}|d}|st dt ddlm}||}||_ |S) zLazy-load + cache the sync Parallel client. Cache lives on :mod:`tools.web_tools` (as ``_parallel_client``) so unit tests that reset that name between cases keep working. rN_parallel_clientget_provider_envPARALLEL_API_KEYVPARALLEL_API_KEY environment variable not set. Get your API key at https://parallel.ai)Parallelapi_key) tools.web_tools web_toolsgetattragent.web_search_providerr ValueErrorrparallelrr)_wtcachedrrrclients r_get_sync_clientr'@s "!!!!! S,d 3 3F  ::::::122G   6   #$$$!!!!!! Xg & & &F!C Mcddlm}t|dd}||Sddlm}|d}|st dt ddlm}||}||_ |S) z}Lazy-load + cache the async Parallel client. Cache lives on :mod:`tools.web_tools` (as ``_async_parallel_client``). rN_async_parallel_clientrrr) AsyncParallelr) rrr r!rr"rr#r+r*)r$r%rrr+r&s r_get_async_clientr,]s "!!!!! S2D 9 9F  ::::::122G   6   #$$$&&&&&& ]7 + + +F!'C Mr(c.ddlm}d|_d|_dS)zDrop both cached clients so tests can re-instantiate cleanly. Clears the canonical slots on :mod:`tools.web_tools` (where :func:`_get_sync_client` / :func:`_get_async_client` read/write them). rN)rrrr*)r$s r_reset_clients_for_testsr.ys, "!!!!!C!%Cr(rctjdd}|dvrd}|S)zDReturn the validated PARALLEL_SEARCH_MODE value (default "agentic").PARALLEL_SEARCH_MODEagentic>one-shotfastr1)osgetenvlowerstrip)modes r_resolve_search_moder9sB 9+Y 7 7 = = ? ? E E G GD 222 Kr(cteZdZdZeddZeddZddZddZdd Z dddZ ddZ ddZ dS)ParallelWebSearchProviderz,Parallel.ai search + async extract provider.rrcdS)Nr#selfs rnamezParallelWebSearchProvider.namezr(cdS)Nrr=r>s r display_namez&ParallelWebSearchProvider.display_namerAr(boolc>ddlm}t|dS)zBReturn True when ``PARALLEL_API_KEY`` is set to a non-empty value.rrr)r!rrD)r?rs r is_availablez&ParallelWebSearchProvider.is_availables/>>>>>>$$%788999r(cdSNTr=r>s rsupports_searchz)ParallelWebSearchProvider.supports_searchtr(cdSrHr=r>s rsupports_extractz*ParallelWebSearchProvider.supports_extractrJr(querylimitintDict[str, Any]c  ddlm}|rdddSt}td|||t j|g||t|d}g}t|j pgD]P\}}|j pg} | |j pd |jpd | rd | nd |d zd Qd d|idS#t $r} dt#| dcYd} ~ Sd} ~ wt$$r} dd| dcYd} ~ Sd} ~ wt&$r-} td| dd| dcYd} ~ Sd} ~ wwxYw)zExecute a Parallel search (sync). Uses the ``beta.search`` endpoint with the configured mode (``PARALLEL_SEARCH_MODE`` env var, default "agentic"). Limit is capped at 20 server-side. ris_interruptedF Interrupted)successerrorz)Parallel search: '%s' (mode=%s, limit=%d))search_queries objectiver8 max_results )urltitle descriptionpositionTweb)rVdataNParallel SDK not installed: zParallel search error: %szParallel search failed: )tools.interruptrTr9loggerinfor'betasearchmin enumerateresultsexcerptsappendr_r`joinr"rrrwarning) r?rNrOrTr8response web_resultsiresultrnrs rrjz ParallelWebSearchProvider.searchs)' Q 6 6 6 6 6 6~ B#(=AAA'))D KK;UD%   ()).55 %wrNN 6HK&x'7'=2>>   6!?0b""%z/R!'!3=E'Msxx'9'9'92$%E  $e[-ABB B 9 9 9$s3xx88 8 8 8 8 8 8    ===       Q Q Q NN6 < < <$/O#/O/OPP P P P P P P QsGC+CC++ E 5D E  E D& E & E 3"EE E urls List[str]kwargsrList[Dict[str, Any]]c F K ddlm}|r d|DStdt |t j|dd{V}g}|jpgD]Y}|j pd}|sd |j pg}|j pd}|j pd} ||| |||| d d Z|jpgD];} || j pddd| jp| jpd d | j pdid<|S#t$$r fd|DcYd Sd wt&$r fd|DcYd Sd wt($r3 td  fd|DcYd Sd wwxYw)uSExtract content from one or more URLs via the async SDK. Returns the legacy list-of-results shape that :func:`tools.web_tools.web_extract_tool` expects: one entry per successful URL plus one entry per failed URL with an ``error`` field. Errors are not raised — they're returned as per-URL items. rrScg|]}|ddd S)rUr\)r_rWr`r=).0us r z5ParallelWebSearchProvider.extract..s/HIA CCr(zParallel extract: %d URL(s)T)rv full_contentNr\z ) sourceURLr`)r_r`content raw_contentmetadatazextraction failedr)r_r`rrWrc8g|]}|ddtdS)r\r_r`rrW)rr|r}rs rr~z5ParallelWebSearchProvider.extract..s,\\\RSArCHHMM\\\r(c$g|] }|dddd S)r\rerr=rs rr~z5ParallelWebSearchProvider.extract..s?B2@d_b@d@deer(zParallel extract error: %sc$g|] }|dddd S)r\zParallel extract failed: rr=rs rr~z5ParallelWebSearchProvider.extract..s?B2@a\_@a@abbr()rfrTrgrhlenr,riextractrmrrprnr_r`roerrorsr error_typer"rrrq) r?rvrxrTrrrmrurr_r`rWrs @rrz!ParallelWebSearchProvider.extracts7  6 6 6 6 6 6~ MQ KK5s4yy A A A.005==!>H -/G"*0b   -3A$kk&/*?R@@Gj&B *"!&#*'.25$F$F ".B  $yB!##%!&!Y%2B!YFY%0%)/r$B N ] ] ]\\\\W[\\\ \ \ \ \ \ \             NN7 = = =       sGD#DD## F - E:F  F  E F  F -(FF F cdddddddgdS) Nrpaidz2Objective-tuned search + parallel page extraction.rzParallel API keyzhttps://parallel.ai)keyr r_)r@badgetagenv_varsr=r>s rget_setup_schemaz*ParallelWebSearchProvider.get_setup_schemas4G.00   r(Nrr)rrD)rM)rNrrOrPrrQ)rvrwrxrrry)rrQ) __name__ __module__ __qualname____doc__propertyr@rCrFrIrLrjrrr=r(rr;r;s66 XX:::: .Q.Q.Q.Q.Q`AAAAF       r(r;)rr )rrr)r __future__rloggingr4typingrrrr!r getLoggerrrgrr'r,r._get_parallel_client_get_async_parallel_clientr9r;r=r(rrs(8#""""" """"""""""777777  8 $ $$$$$$:8 & & & &(.V V V V V 1V V V V V r(