.cj4UdZddlmZddlmZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z mZmZddlmZejeZdZdZdZGd d eZd dZdZded<daded<d!dZedd"dZd dZ GddeZ!dS)#uDuckDuckGo search — plugin form (via the ``ddgs`` package). Subclasses the plugin-facing :class:`agent.web_search_provider.WebSearchProvider`. The legacy in-tree module ``tools.web_providers.ddgs`` was removed in the same commit that moved this code under ``plugins/``; this file is now the canonical implementation. The ``ddgs`` package is an optional dependency. ``is_available()`` reflects whether the package is importable; the plugin still registers either way so ``hermes tools`` can prompt the user to install it. Isolation note (#68096): ``ddgs``/``primp`` can block inside native code while holding the Python GIL. A ``ThreadPoolExecutor`` + ``future.result(timeout=…)`` cap (see #52118) cannot fire in that state — the waiter never reacquires the GIL — so the whole Hermes process freezes through Ctrl+C/SIGTERM. Each search therefore runs in a disposable child process the parent can terminate/kill. ) annotationsN)AnyDictOptional)WebSearchProviderg?g?ceZdZdZdS)_SearchInterruptedzHRaised when tools.interrupt.is_interrupted() trips during a search wait.N)__name__ __module__ __qualname____doc__;/home/ice/.hermes/hermes-agent/plugins/web/ddgs/provider.pyr r 0sRRRRrr querystr safe_limitintreturnlist[dict[str, Any]]c ddlm}g}|d5}t|||D]\}}||krnt |dp|dpd}|t |d d|t |d d|d zd d d d n #1swxYwY|S)uORun the blocking ddgs query and return normalized hits. Module-level (not a closure) so the child worker can import it and so tests can patch it for in-process unit tests. ``DDGS(timeout=…)`` bounds each individual HTTP request; the overall wall-clock cap is enforced by the parent via process timeout (#68096). r)DDGS timeout) max_resultshrefurltitlebody)r!r descriptionpositionN)ddgsr enumeratetextrgetappend)rrrresultsclientihitrs r_run_ddgs_searchr/4sL$&G b    V Ez J JKK  FAsJcggfoo==2>>C NN "!5!566#&swwvr':':#;#; !A                     NsC C,,C03C0z Optional[str] _test_hookOptional[subprocess.Popen]_last_worker_procc 6 ddl}t|dd}|rYtjtjtj|Sn#t $rYnwxYwtjtjtjtjtjtS)uReturn the ``sys.path`` entry that makes ``import plugins`` work. Prefer the live ``plugins`` package location over counting ``dirname``s from this file — that stays correct for source checkouts and site-packages. rN__file__)pluginsgetattrospathdirnameabspath Exceptionr4) plugins_pkgpkg_files r_plugins_path_entryr>Ws  %%%%; D99  O7??27??27??83L3L#M#MNN N O      7??  GOOBGOOBGOOH,E,EFF G G    sA/A33 B?B)graceprocr?floatNonecdSd fd } ||A||s$tdjdSdSdS#t $r&}td|Yd}~dSd}~wwxYw) uTerminate a worker, escalate to kill, and wait so no orphan remains. Does not close the parent's pipe ends — the caller must finish any ``communicate()``/reader first. Closing stdout while another thread is blocked in ``read()`` deadlocks on some platforms. NsecondsrArboolc tj|z}tj|krAdStjdtj|kAduS)NTg?)time monotonicpollsleep)rDdeadliner@s r_wait_until_deadz-_terminate_and_reap.._wait_until_deadzsu>##g-n))yy{{&t Jt   n))yy{{$&&rz*DDGS worker pid=%s did not exit after killzDDGS worker reap error: %s)rDrArrE)rI terminatekillloggerwarningpidr;debug)r@r?rLexcs` r_terminate_and_reaprTls |'''''' 8 99;;  NN     U # # # 99;;  IIKKK##E** WKTXVVVVV   W W 888 137777777778sBB C #CC c " ddlm}||d}tr t|d<ddlm}|t t j}trd|d<|dd }t}|r:|| t j vr|r|t j z|zn||d<t j t j t j t d }i} t"jd krt&j| d <nd | d<t'jt"j|gft&jt&jt&j|d d| } | at5jd} | | jt=j|} d} d}d } tAj!tDz} |rd }nf|tAj!z }|dkrd } nG | #tItJ|\}}|pd }n#t4j&$rYpwxYwtO| | (s6 | #tR\}}|s|pd }n#tT$rYnwxYw| +dd nu#tO| | (s6 | #tR\}}|s|pd }n#tT$rYnwxYw| +dd wxYw|rtYd| rtMdtDd|-}|s%t]d| /d t=j0|}n2#t<j1$r }t]d|dd|d}~wwxYwte|t st]d||dr=|dpg}te|tfst]d |St]ti|d!pd")#u\Run ``_run_ddgs_search`` in a disposable process with a hard deadline. The parent never joins the child while it may be inside native code holding *its* GIL — it only polls a communicator thread and, on timeout/interrupt, terminates the child OS process. Raises ``TimeoutError``, ``_SearchInterrupted``, or ``RuntimeError``. r)is_interrupted)rr test_hook)_sanitize_subprocess_env1HERMES_DDGS_ALLOW_TEST_HOOKS PYTHONPATHr z_search_worker.pywin32 creationflagsTstart_new_session)stdinstdoutstderrenvr(r#) max_workersFr)waitcancel_futuresDuckDuckGo search interrupted"DuckDuckGo search timed out after sz*DDGS worker exited without a result (code=)z#DDGS worker returned invalid JSON: Nz*DDGS worker returned an invalid envelope: okr+z%DDGS worker returned non-list resultserrorzDDGS worker failed)5tools.interruptrVr0tools.environments.localrXdictr7environr)r>splitpathsepr8joinr9r:r4sysplatform subprocessCREATE_NEW_PROCESS_GROUPPopen executablePIPEDEVNULLr2cfThreadPoolExecutorsubmit communicatejsondumpsrGrH_SEARCH_TIMEOUT_SECSresultmin_POLL_INTERVAL_SECS TimeoutErrorrTdone_TERMINATE_GRACE_SECSr;shutdownr strip RuntimeErrorrIloadsJSONDecodeError isinstancelistr)rrrVrequestrXrbchild_pythonpath path_entry worker_path extra_kwargsr@poolfut timed_out interruptedrawrK remainingout_errenveloperSr+s r_run_ddgs_search_boundedrs/.....).ZHHG*) AAAAAA " "4 #3#3 4 4C2.1 *+ ww|R00$&&J j(8(>(>rz(J(JJJ:J ZJ #&6 6 6PZ L',,rwrwx/H/HIIK^__K$&L |w(2(K _%%-1 ()   % o!       D  Q / / /D ++d& 7(;(; < ##&:: ~ "  4>#3#33IA~~  JJs3F /R/RJSS TiR?     D!!!xxzz  JJ/DJEE T$)C     5 6666 D!!!xxzz  JJ/DJEE T$)C     5 6666B !@AAA  H1E H H H    ))++C   G G G G   :c??   ?#dsd) ? ?    h % %VTTTUUU||D,,y))/R'4(( HFGG G s8<<00H4HII J JJsAK 0H>=K>I KIK7$J J)(J)$L6)$L L6 LL6LL6 N55O$OO$cleZdZdZeddZeddZddZddZdd Z dddZ ddZ dS)DDGSWebSearchProvideraDuckDuckGo HTML-scrape search provider. No API key needed. Rate limits are enforced server-side by DuckDuckGo; the provider surfaces ``DuckDuckGoSearchException`` and other ddgs errors as ``{"success": False, "error": ...}`` rather than raising. rrcdS)Nr&rselfs rnamezDDGSWebSearchProvider.namesvrcdS)NDuckDuckGo (ddgs)rrs r display_namez"DDGSWebSearchProvider.display_names""rrEc2 ddl}dS#t$rYdSwxYw)uReturn True when the ``ddgs`` package is importable. Probes the import once; cheap because Python caches the import. Must NOT perform network I/O — runs at tool-registration time and on every ``hermes tools`` paint. rNTF)r& ImportError)rr&s r is_availablez"DDGSWebSearchProvider.is_availables7  KKK4   55 s  cdS)NTrrs rsupports_searchz%DDGSWebSearchProvider.supports_search'strcdS)NFrrs rsupports_extractz&DDGSWebSearchProvider.supports_extract*surrlimitrDict[str, Any]c6 ddl}n#t$rdddcYSwxYwtdt|} t ||}n#t $r2t dt|ddtd dcYSt$r#t d |dd dcYSt$r-}t d |dd |dcYd}~Sd}~wwxYwt d|t||dd|idS)a*Execute a DuckDuckGo search and return normalized results. The synchronous ``ddgs`` call runs in a disposable child process with a hard wall-clock timeout (``_SEARCH_TIMEOUT_SECS``) so a hung native ``primp`` call cannot freeze the Hermes process (#36776, #68096). rNFu8ddgs package is not installed — run `pip install ddgs`)successrlr#z-DDGS search timed out after %ds for query: %rrguhs — DuckDuckGo may be rate-limiting or slow. Try again later or switch to a different search provider.z%DDGS search interrupted for query: %rrfzDDGS search error: %szDuckDuckGo search failed: z'DDGS search '%s': %d results (limit %d)Tweb)rdata) r&rmaxrrrrOrPrr infor;len)rrrr&r web_resultsrSs rsearchzDDGSWebSearchProvider.search-s  KKKK    S    CJJ''  S25*EEKK    NN?$    !@9M@@@   "    KK? G G G 8    S S S NN2C 8 8 8$/QC/Q/QRR R R R R R R S  5uc+>N>NPU    %)=>>>s5A 9C')C'1 C':"C"C'"C'cdddgddS)Nrufree · no key · search onlyuRSearch via the ddgs Python package — no API key (pair with any extract provider)r&)rbadgetagenv_vars post_setuprrs rget_setup_schemaz&DDGSWebSearchProvider.get_setup_schema_s"'4g!   rNrr)rrE)r)rrrrrr)rr) r r r rpropertyrrrrrrrrrrrr sX###X#    0?0?0?0?0?d       rr)rrrrrrr)r@r1r?rArrB)"r __future__rconcurrent.futuresfuturesr|rloggingr7rvrtrGtypingrrragent.web_search_providerr getLoggerr rOrrrr;r r/r0__annotations__r2r>rTrrrrrrs$#"""""   &&&&&&&&&&777777  8 $ $SSSSSSSS:! 1544440)888888DxKxKxKxKv_ _ _ _ _ -_ _ _ _ _ r