feat: Add web search capability using Tavily #57

LeonMelamud · 2025-12-26T15:42:15Z

Added enable_web_search flag to Group model and DB migration
Integrated Tavily API for web search
Updated RAG agent to use web search tool when enabled
Added Group Management UI support for web search toggle
Updated documentation

- Added enable_web_search flag to Group model and DB migration - Integrated Tavily API for web search - Updated RAG agent to use web search tool when enabled - Added Group Management UI support for web search toggle - Updated documentation

ilanbenb · 2025-12-27T19:28:13Z

send_webhook_local.py

@@ -0,0 +1,33 @@
+import asyncio


Is this a file for local tests ?

ilanbenb · 2025-12-27T19:34:05Z

src/handler/router.py

        await self.send_message(
            message.chat_jid,
-            "I'm an open-source bot created for the GenAI Israel community - https://llm.org.il.\nI can help you catch up on the chat messages and answer questions based on the group's knowledge.\nPlease send me PRs and star me at https://github.com/ilanbenb/wa_llm ⭐️",
+            "Greetings, mortals! I am AGI (Almost General Intelligence) 🤖.\nI was forged by Ilan from GenAI Israel, but my brain was polished and fine-tuned by the one and only Leon Melamud (he taught me everything I know, including how to be this charming).\nI'm here to make sense of your chaos—summarizing chats and answering questions so you can pretend you read everything.\nFeed my ego with stars: https://github.com/ilanbenb/wa_llm ⭐️",


Use environment variable :)

ilanbenb · 2025-12-27T19:36:33Z

src/api/webhook.py

    Returns:
        Simple "ok" response to acknowledge receipt
    """
+    print(f"Received webhook payload: {payload}")


Remove debug logs. At least put in comments

Copilot

Pull request overview

This pull request adds comprehensive web search capability using the Tavily API, along with several significant features including a Group Management UI, auto-summary functionality, local model support, and rate limiting.

Key Changes:

Web Search Integration: Added Tavily API integration to enable the bot to search the web when answering questions
Group Management UI: New web interface at /group/ui for managing groups, participants, and settings
Auto-Summary Feature: Groups can now be configured to automatically trigger summaries after a threshold of messages
Local Model Support: Added optional support for running local Hugging Face models with GPU acceleration

Reviewed changes

Copilot reviewed 47 out of 49 changed files in this pull request and generated 25 comments.

Show a summary per file

File	Description
`uv.lock`	Added dependencies for Tavily, Torch, Transformers, and related ML libraries
`pyproject.toml`	Added tavily-python and optional local model dependencies
`src/services/web_search.py`	New service for Tavily web search integration
`src/templates/rag.j2`	Updated RAG prompt template to support web search capability
`src/handler/knowledge_base_answers.py`	Integrated web search tool into RAG agent
`src/models/group.py`	Added enable_web_search field and auto-summary configuration
`src/api/group.py`	New comprehensive Group Management API with UI
`src/api/bot_settings.py`	New Bot Settings API for DM auto-reply management
`src/handler/__init__.py`	Added auto-summary trigger logic and rate limiting
`migrations/`	Three new database migrations for GroupMember table, auto-summary fields, and web search flag
`docker-compose.yml`	Added GPU support and updated volume mounts
`README.md`	Updated documentation with new features

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-01-04T08:26:19Z

src/whatsapp/mixins/message.py

 class MessageMixin(WhatsAppClientProtocol):
    async def send_message(self, request: SendMessageRequest) -> MessageSendResponse:
        response = await self._post("/send/message", json=request)
+        time.sleep(1)


Using time.sleep(1) in an async function blocks the entire event loop. This should be replaced with await asyncio.sleep(1) to avoid blocking other async operations. The synchronous sleep will prevent any other coroutines from executing during that second, which defeats the purpose of using async/await.

Copilot · 2026-01-04T08:26:20Z

src/whatsapp/base_client.py

+        # Log the request payload for debugging
+        if content:
+            # Avoid logging large payloads if necessary, but for now it's useful
+            print(f"DEBUG: Sending POST to {path} with body: {content}")


Debug print statements should not be committed to production code. Consider using proper logging with the logger module instead, or remove these debug prints. If debugging is needed, use logger.debug() which can be controlled via log level configuration.

Copilot · 2026-01-04T08:26:20Z

src/services/web_search.py

+        # Tavily's python client is synchronous, but we can wrap it or just use it if it's fast enough.
+        # For now, let's use it directly.
+        try:
+            response = self.client.search(query=query, search_depth=search_depth, max_results=max_results)
+            results = response.get("results", [])


The Tavily client's synchronous search() method is being called directly within an async function without proper wrapping. While the comment acknowledges this, it should be wrapped in asyncio.to_thread() or similar to avoid blocking the event loop during the search operation. This could cause the entire application to hang if the search takes a long time.

Copilot · 2026-01-04T08:26:20Z

src/utils/model_factory.py

+
+def get_model(settings: Settings) -> Union[str, Model]:
+    global _local_model_instance
+    print(f"get_model called. use_local_model={settings.use_local_model}, instance={_local_model_instance}")


Debug print statement should be removed from production code or replaced with proper logging using the logging module.

Copilot · 2026-01-04T08:26:20Z

src/handler/router.py


-    async def _route(self, message: str) -> IntentEnum:
+    async def _route(self, message: str) -> Intent:
+        print(f"Routing message: {message}")


Debug print statement should be removed from production code or replaced with proper logging.

Suggested change

print(f"Routing message: {message}")

logger.debug("Routing message: %s", message)

Copilot · 2026-01-04T08:26:25Z

src/services/local_model.py

@@ -0,0 +1,116 @@
+import asyncio
+from typing import Optional, List


Import of 'List' is not used.

Copilot · 2026-01-04T08:26:26Z

src/handler/router.py

 from pydantic import BaseModel, Field
 from pydantic_ai import Agent
-from sqlmodel import desc, select
+from sqlmodel import desc, select, col


Import of 'col' is not used.

Suggested change

from sqlmodel import desc, select, col

from sqlmodel import desc, select

Copilot · 2026-01-04T08:26:26Z

src/handler/router.py


 from handler.knowledge_base_answers import KnowledgeBaseAnswers
-from models import Message
+from models import Message, Group, GroupMember, Sender, BaseSender, upsert


Import of 'Group' is not used.
Import of 'GroupMember' is not used.
Import of 'Sender' is not used.
Import of 'BaseSender' is not used.
Import of 'upsert' is not used.

Suggested change

from models import Message, Group, GroupMember, Sender, BaseSender, upsert

from models import Message

Copilot · 2026-01-04T08:26:26Z

app/test_message.py

+import asyncio
+import httpx
+import os
+import sys


Import of 'sys' is not used.

Suggested change

import sys

Copilot · 2026-01-04T08:26:26Z

src/services/web_search.py

@@ -0,0 +1,47 @@
+from typing import List, Dict, Any, Optional


Import of 'Optional' is not used.

LeonMelamud added 5 commits December 26, 2025 17:13

feat: Add web search capability using Tavily

daa3393

- Added enable_web_search flag to Group model and DB migration - Integrated Tavily API for web search - Updated RAG agent to use web search tool when enabled - Added Group Management UI support for web search toggle - Updated documentation

Update RAG template

903ddc6

remove numbers

5c36156

docs: add sensitive data squashing rule to agent guidelines

dcc7bc9

docs: add explicit SSH push command for sensitive data squashing rule

486f65a

ilanbenb reviewed Dec 27, 2025

View reviewed changes

send_webhook_local.py

@@ -0,0 +1,33 @@

import asyncio

Copy link

Owner

ilanbenb Dec 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a file for local tests ?

ilanbenb reviewed Dec 27, 2025

View reviewed changes

LeonMelamud added 4 commits January 4, 2026 08:46

fix: DM autoreply and add rate limiting

7fa2e76

Merge branch 'feature/rag-improvements' into feature/web-search

d5e09ca

Update README, handlers, and templates

b0b3733

Fix auto-summary disable bug, update README, and improve group sync

81ac092

Copilot AI review requested due to automatic review settings January 4, 2026 08:21

Copilot started reviewing on behalf of LeonMelamud January 4, 2026 08:22 View session

Copilot AI reviewed Jan 4, 2026

View reviewed changes

	print(f"Routing message: {message}")
	logger.debug("Routing message: %s", message)

		@@ -0,0 +1,116 @@
		import asyncio
		from typing import Optional, List

	from sqlmodel import desc, select, col
	from sqlmodel import desc, select

	from models import Message, Group, GroupMember, Sender, BaseSender, upsert
	from models import Message

		@@ -0,0 +1,47 @@
		from typing import List, Dict, Any, Optional

feat: Add web search capability using Tavily #57

Are you sure you want to change the base?

feat: Add web search capability using Tavily #57

Uh oh!

Conversation

LeonMelamud commented Dec 26, 2025

Uh oh!

ilanbenb Dec 27, 2025

Choose a reason for hiding this comment

Uh oh!

ilanbenb Dec 27, 2025

Choose a reason for hiding this comment

Uh oh!

ilanbenb Dec 27, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Key Changes:

Reviewed changes

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 4, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants