Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add a unified local vector store #6995

Merged
merged 26 commits into from
Mar 31, 2025
Merged

feat: add a unified local vector store #6995

merged 26 commits into from
Mar 31, 2025

Conversation

rodrigosnader
Copy link
Contributor

@rodrigosnader rodrigosnader commented Mar 10, 2025

This pull request introduces a new component, LocalDBComponent, to the vector store components of the backend. The changes include importing the new component, defining its class, and updating the list of available components.

New Component Addition:

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Mar 10, 2025
@edwinjosechittilappilly edwinjosechittilappilly changed the title add a unified local vector store Feat: add a unified local vector store Mar 10, 2025
@edwinjosechittilappilly edwinjosechittilappilly changed the title Feat: add a unified local vector store feat: add a unified local vector store Mar 11, 2025
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Overview

This pull request introduces the LocalDBComponent that implements a unified local vector store with search capabilities. Key changes include creating a new LocalDBComponent class, setting up various input/output configurations for data ingestion and retrieval, and incorporating methods for building, searching, and managing collections.

Reviewed Changes

File Description
src/backend/base/langflow/components/vectorstores/local_db.py Added LocalDBComponent with configurations, collection management, and vector store operations

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 11, 2025
@edwinjosechittilappilly
Copy link
Collaborator

@rodrigosnader We have the issue of eq when testing.

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 11, 2025
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Overview

This pull request introduces a new LocalDBComponent class that implements a local vector store with semantic search capabilities. The key changes include the implementation of a new vector store component with configurable inputs/outputs, methods for managing collections and persistence directories, and integration with the Chroma backend.

Reviewed Changes

File Description
src/backend/base/langflow/components/vectorstores/local_db.py New LocalDBComponent class definition providing local vector store functionality with search and collection management methods
src/backend/base/langflow/components/vectorstores/init.py Updated to export the new LocalDBComponent
Tests (various files) Minor import ordering adjustments for consistency

Copilot reviewed 13 out of 13 changed files in this pull request and generated 1 comment.

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 11, 2025
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request adds a new LocalDBComponent class that implements a unified local vector store with semantic search capabilities. Key changes include:

  • Introduction of LocalDBComponent with configurations for data ingestion and search operations.
  • Implementation of dynamic form updates via update_build_config.
  • Integration of vector store operations such as build_vector_store, document ingestion, and search_documents.

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
src/backend/base/langflow/components/vectorstores/local_db.py Adds the new LocalDBComponent class with methods for collection management and vector store operations.
src/backend/base/langflow/components/vectorstores/init.py Updates the module exports to include the LocalDBComponent.

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 13, 2025
Copy link
Collaborator

@edwinjosechittilappilly edwinjosechittilappilly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Mar 26, 2025
@edwinjosechittilappilly edwinjosechittilappilly removed their assignment Mar 26, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 26, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 26, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 27, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 28, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Mar 30, 2025
@Cristhianzl Cristhianzl added this pull request to the merge queue Mar 31, 2025
Merged via the queue into main with commit fecd2b5 Mar 31, 2025
34 checks passed
@Cristhianzl Cristhianzl deleted the local_db branch March 31, 2025 15:53
QDDCoder pushed a commit to QDDCoder/langflow that referenced this pull request Apr 1, 2025
* commit '6c2ff92ccf083f038d9a97a749b4e0f30a60247a': (255 commits)
  docs: Update documentation and add TAVILY_API_KEY to environment variables (langflow-ai#7366)
  docs: mcp server component and integrations (langflow-ai#7286)
  docs: v1.3 (langflow-ai#7160)
  chore(deps-dev): bump vite from 5.4.14 to 5.4.16 in /src/frontend (langflow-ai#7365)
  fix: add secret key loading functionality to basic templates (langflow-ai#7363)
  docs: platform content (langflow-ai#7091)
  chore: bump langflow and langflow-base for 1.3.0 release (langflow-ai#7362)
  docs: ensure asset paths update on draft rebuilds (langflow-ai#7355)
  fix: Prevent API key banner from displaying when key is unavailable (langflow-ai#7356)
  fix: MCP SSE Model tool mode issue (langflow-ai#7360)
  feat: deprecate Parsing component and replace them in starter projects (langflow-ai#6697)
  fix: fixed the parser component (langflow-ai#7303)
  ref: split ast parsing / class exec loops (langflow-ai#7248)
  feat: Update AgentQL templates (langflow-ai#7165)
  feat: add a unified local vector store (langflow-ai#6995)
  fix: update currentflow to be fetched from Flow Store for icon to be rendered correctly (langflow-ai#7354)
  feat: expose serialization truncation constants in /config route (langflow-ai#7316)
  feat: lmprove MCP langflow port selection and error handling (langflow-ai#7327)
  fix: adds priority sorting for sidebar components and makes LanguageModel appear first (langflow-ai#7322)
  fix: make agent work with new tool mode backend updates (langflow-ai#7314)
  ...

# Conflicts:
#	src/frontend/src/utils/styleUtils.ts

更新到V1.3.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:XL This PR changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants