[PR #7906] [MERGED] chore: support multiple source search in chat #8200

New issue

Closed

opened 2026-03-23 23:23:05 +00:00 by mirror · 0 comments

mirror commented

2026-03-23 23:23:05 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/AppFlowy-IO/AppFlowy/pull/7906
Author: @appflowy
Created: 5/10/2025
Status: ✅ Merged
Merged: 5/10/2025
Merged by: @appflowy

Base: main ← Head: chat_embed_fallback_search

📝 Commits (2)

44fada4 chore: support multiple source search in chat
0d2c213 chore: clippy

📊 Changes

22 files changed (+642 additions, -248 deletions)

View changed files

📝 frontend/rust-lib/flowy-ai/src/ai_manager.rs (+2 -3)
📝 frontend/rust-lib/flowy-ai/src/embeddings/store.rs (+86 -64)
📝 frontend/rust-lib/flowy-ai/src/local_ai/chat/chains/context_question_chain.rs (+48 -21)
📝 frontend/rust-lib/flowy-ai/src/local_ai/chat/chains/conversation_chain.rs (+61 -73)
📝 frontend/rust-lib/flowy-ai/src/local_ai/chat/chains/related_question_chain.rs (+5 -13)
📝 frontend/rust-lib/flowy-ai/src/local_ai/chat/format_prompt.rs (+1 -1)
📝 frontend/rust-lib/flowy-ai/src/local_ai/chat/llm_chat.rs (+41 -21)
📝 frontend/rust-lib/flowy-ai/src/local_ai/chat/mod.rs (+61 -39)
➕ frontend/rust-lib/flowy-ai/src/local_ai/chat/retriever/mod.rs (+31 -0)
➕ frontend/rust-lib/flowy-ai/src/local_ai/chat/retriever/multi_source_retriever.rs (+120 -0)
➕ frontend/rust-lib/flowy-ai/src/local_ai/chat/retriever/sqlite_retriever.rs (+71 -0)
📝 frontend/rust-lib/flowy-ai/src/local_ai/controller.rs (+8 -4)
📝 frontend/rust-lib/flowy-ai/tests/chat_test/qa_test.rs (+1 -1)
📝 frontend/rust-lib/flowy-ai/tests/main.rs (+8 -1)
📝 frontend/rust-lib/flowy-core/src/deps_resolve/chat_deps.rs (+67 -0)
📝 frontend/rust-lib/flowy-core/src/server_layer.rs (+8 -0)
📝 frontend/rust-lib/flowy-search-pub/src/entities.rs (+1 -0)
📝 frontend/rust-lib/flowy-search-pub/src/tantivy_state.rs (+10 -2)
📝 frontend/rust-lib/flowy-search/src/document/local_search_handler.rs (+1 -1)
📝 frontend/rust-lib/flowy-server/src/af_cloud/impls/search.rs (+1 -1)

...and 2 more files

📄 Description

Support keyword search when chat with page

Summary by Sourcery

Implement multiple source search support for chat functionality, allowing retrieval of documents from different sources with configurable search parameters

New Features:

Support keyword search across multiple vector stores
Introduce configurable retriever with multiple source support
Add flexible document retrieval with score thresholding

Enhancements:

Refactor retriever architecture to support multiple sources
Improve document search flexibility with configurable parameters
Add support for retrieving documents from different storage backends

Chores:

Restructure chat and retriever modules
Update interfaces for document retrieval
Modify existing search implementations

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/AppFlowy-IO/AppFlowy/pull/7906 **Author:** [@appflowy](https://github.com/appflowy) **Created:** 5/10/2025 **Status:** ✅ Merged **Merged:** 5/10/2025 **Merged by:** [@appflowy](https://github.com/appflowy) **Base:** `main` ← **Head:** `chat_embed_fallback_search` --- ### 📝 Commits (2) - [`44fada4`](https://github.com/AppFlowy-IO/AppFlowy/commit/44fada42edc2f9ac70349728c79030216e1d7685) chore: support multiple source search in chat - [`0d2c213`](https://github.com/AppFlowy-IO/AppFlowy/commit/0d2c2130651fa9c12277b097915c5a4bec02b900) chore: clippy ### 📊 Changes **22 files changed** (+642 additions, -248 deletions) <details> <summary>View changed files</summary> 📝 `frontend/rust-lib/flowy-ai/src/ai_manager.rs` (+2 -3) 📝 `frontend/rust-lib/flowy-ai/src/embeddings/store.rs` (+86 -64) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/chat/chains/context_question_chain.rs` (+48 -21) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/chat/chains/conversation_chain.rs` (+61 -73) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/chat/chains/related_question_chain.rs` (+5 -13) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/chat/format_prompt.rs` (+1 -1) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/chat/llm_chat.rs` (+41 -21) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/chat/mod.rs` (+61 -39) ➕ `frontend/rust-lib/flowy-ai/src/local_ai/chat/retriever/mod.rs` (+31 -0) ➕ `frontend/rust-lib/flowy-ai/src/local_ai/chat/retriever/multi_source_retriever.rs` (+120 -0) ➕ `frontend/rust-lib/flowy-ai/src/local_ai/chat/retriever/sqlite_retriever.rs` (+71 -0) 📝 `frontend/rust-lib/flowy-ai/src/local_ai/controller.rs` (+8 -4) 📝 `frontend/rust-lib/flowy-ai/tests/chat_test/qa_test.rs` (+1 -1) 📝 `frontend/rust-lib/flowy-ai/tests/main.rs` (+8 -1) 📝 `frontend/rust-lib/flowy-core/src/deps_resolve/chat_deps.rs` (+67 -0) 📝 `frontend/rust-lib/flowy-core/src/server_layer.rs` (+8 -0) 📝 `frontend/rust-lib/flowy-search-pub/src/entities.rs` (+1 -0) 📝 `frontend/rust-lib/flowy-search-pub/src/tantivy_state.rs` (+10 -2) 📝 `frontend/rust-lib/flowy-search/src/document/local_search_handler.rs` (+1 -1) 📝 `frontend/rust-lib/flowy-server/src/af_cloud/impls/search.rs` (+1 -1) _...and 2 more files_ </details> ### 📄 Description Support keyword search when chat with page ## Summary by Sourcery Implement multiple source search support for chat functionality, allowing retrieval of documents from different sources with configurable search parameters New Features: - Support keyword search across multiple vector stores - Introduce configurable retriever with multiple source support - Add flexible document retrieval with score thresholding Enhancements: - Refactor retriever architecture to support multiple sources - Improve document search flexibility with configurable parameters - Add support for retrieving documents from different storage backends Chores: - Restructure chat and retriever modules - Update interfaces for document retrieval - Modify existing search implementations --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>