feat(search): add summary_embedding semantic search for nodes #1163
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add summary_embedding field to EntityNode and CommunityNode - Add generate_summary_embedding() and load_summary_embedding() methods - Extend create_entity_node_embeddings() to generate summary embeddings - Update save queries for all DB providers (Neo4j, FalkorDB, Neptune, Kuzu) - Add NodeSearchMethod.summary_similarity enum value - Implement node_summary_similarity_search() function - Integrate summary search into node_search() with RRF reranking This enables searching nodes by their summary content, allowing queries like "when to write tests" to find nodes with descriptive summaries. Closes: Milofax/marakanda-infrastructure#1 Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Add summary_similarity search method to all node-related search recipes so the new summary_embedding feature is actually used in searches performed by the MCP server and other consumers. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Author
|
Hi maintainers! 👋 I noticed the CI workflows (Tests, Lint, Pyright) are waiting for approval. Could someone please approve them so we can verify the changes pass all checks? I also have a few other PRs open (#1156, #1157, #1159, #1160) that are in the same state - would appreciate if those could be approved as well when you have a moment. Thanks! |
3 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
summary_embeddingfield toEntityNodefor semantic search over node summariesNodeSearchMethod.summary_similarityfor querying nodes by summary contentExample: Query "when to write unit tests" now finds a node named "Software Testing Best Practices" with summary "describes when to write unit tests, integration tests, e2e tests".
Changes
Data Model (
nodes.py)summary_embedding: list[float] | Nonefield toEntityNodegenerate_summary_embedding()method (mirrorsgenerate_name_embedding())load_summary_embedding()method for all providerscreate_entity_node_embeddings()for batch generationCommunityNodefor consistencySearch (
search_config.py,search_utils.py,search.py)NodeSearchMethod.summary_similarityenum valuenode_summary_similarity_search()functionnode_search()dispatchPersistence (
node_db_queries.py)Recipes (
search_config_recipes.py)summary_similarityto all node-related search recipes (RRF, MMR, etc.)Test plan
make lint)pyright)summary_embeddingis optional (Noneby default)🤖 Generated with Claude Code