Skip to content

Comments

feat: Add Pinecone vector store backend support#202

Merged
Oxazolidinone merged 4 commits intomainfrom
201-feature-implement-pinecone-vector-store
Aug 15, 2025
Merged

feat: Add Pinecone vector store backend support#202
Oxazolidinone merged 4 commits intomainfrom
201-feature-implement-pinecone-vector-store

Conversation

@Oxazolidinone
Copy link
Contributor

No description provided.

@Oxazolidinone Oxazolidinone linked an issue Aug 12, 2025 that may be closed by this pull request
@willingWill17 willingWill17 self-requested a review August 13, 2025 08:57
@willingWill17
Copy link
Collaborator

Please resolve your bug

@Oxazolidinone Oxazolidinone force-pushed the 201-feature-implement-pinecone-vector-store branch from bf1ae66 to 96ac8fc Compare August 15, 2025 02:44
@Oxazolidinone
Copy link
Contributor Author

Implement Pinecone Vector Storage Backend for Cipher

Summary

This PR adds a complete Pinecone vector storage backend implementation to Cipher, enabling production-ready vector search capabilities using Pinecone's cloud-native vector database.


Features Implemented

1. Pinecone Backend Implementation

  • Full CRUD operations: insert, search, update, delete
  • Batch operations with configurable batch sizes
  • Namespace support for data isolation
  • Comprehensive error handling and retry logic
  • Metadata filtering and search capabilities

2. Configuration Support

VECTOR_STORE_TYPE=pinecone
VECTOR_STORE_API_KEY=your-api-key
PINECONE_NAMESPACE=default

3. Schema Validation

const PineconeBackendSchema = BaseVectorStoreSchema.extend({
  type: z.literal('pinecone'),
  apiKey: z.string().describe('Pinecone API key'),
  indexName: z.string().describe('Pinecone index name'),
  namespace: z.string().default(DEFAULTS.PINECONE_NAMESPACE).optional(),
  dimension: z.number().positive().default(DEFAULTS.DIMENSION).optional(),
});

4. Key Features

  • Namespace Isolation: Multiple environments/projects supported
  • Batch Processing: Optimized for large-scale operations
  • Metadata Support: Rich filtering and search capabilities
  • Error Handling: Retry logic and structured error management
  • Type Safety: Full TypeScript support

5. Integration Points

  • Added to discriminated union in BackendConfigSchema
  • Environment variable support in 'env.ts`
  • Factory pattern integration for seamless backend switching
    Constants defined for default values

Files Modified

  • src/core/vector_storage/backend/pinecone.ts
  • src/core/vector_storage/config.ts
  • src/core/vector_storage/constants.ts
  • src/core/vector_storage/factory.ts
  • src/core/env.ts
  • src/core/vector_storage/backend/types.ts

@Oxazolidinone Oxazolidinone merged commit 0a9b706 into main Aug 15, 2025
5 checks passed
@RyanNg1403 RyanNg1403 deleted the 201-feature-implement-pinecone-vector-store branch August 16, 2025 11:26
Ptah-CT pushed a commit to DerAuctor/ct-cipher that referenced this pull request Oct 2, 2025
…nt-pinecone-vector-store

feat: Add Pinecone vector store backend support
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Implement Pinecone Vector Store

2 participants