Skip to content

Communication indexer #9523

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Jul 17, 2025
Merged

Communication indexer #9523

merged 25 commits into from
Jul 17, 2025

Conversation

n1kolasM
Copy link
Contributor

Will require reindexing after update to consume communication messages and change mapping of elastic fields, will delete old index due to version change

@n1kolasM n1kolasM self-assigned this Jul 11, 2025
Copy link

Connected to Huly®: UBERF-12360

Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds communication indexing capabilities to the full-text search system, enabling search functionality for messages and attachments associated with cards. The implementation introduces pseudo-classes for messages and blobs, updates Elasticsearch mappings, and processes both historical communication data and real-time events.

  • Adds communication message and blob indexing with pseudo-classes (Card%message and Card%blob)
  • Updates Elasticsearch adapter with new field mappings and query methods (updateByQuery, removeByQuery)
  • Implements real-time processing of communication events through domain event transactions

Reviewed Changes

Copilot reviewed 12 out of 13 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
server/middleware/src/fulltext.ts Adds card-based message indexing support to middleware
server/middleware/package.json Adds card dependency for middleware
server/indexer/src/mapper.ts Extends search result mapping with attachment metadata
server/indexer/src/indexer/utils.ts Defines pseudo-classes and message indexing utilities
server/indexer/src/indexer/indexer.ts Core indexing logic for communication messages and events
server/indexer/package.json Adds communication and text-markdown dependencies
server/elastic/src/adapter.ts Updates Elasticsearch mapping and adds bulk query operations
server/core/src/types.ts Extends FullTextAdapter interface with new query methods
pods/fulltext/src/workspace.ts Integrates communication API into workspace indexer
pods/fulltext/src/manager.ts Updates transaction processing to handle domain events
pods/fulltext/package.json Adds communication server dependencies
packages/core/src/storage.ts Extends SearchResultDoc interface with attachment fields

@n1kolasM n1kolasM force-pushed the communication-indexer branch from 6b50a1a to 28abd5e Compare July 11, 2025 06:24
@n1kolasM n1kolasM marked this pull request as draft July 11, 2025 07:29
@n1kolasM n1kolasM marked this pull request as ready for review July 13, 2025 09:46
@haiodo
Copy link
Member

haiodo commented Jul 14, 2025

@NikitaSkrynnik You also need to add a core migration to push a full-reindex for workspace.

n1kolasM added 20 commits July 14, 2025 15:49
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
n1kolasM added 5 commits July 14, 2025 15:55
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
Signed-off-by: Nikolay Marchuk <nikolay.marchuk@hardcoreeng.com>
@n1kolasM n1kolasM force-pushed the communication-indexer branch from 6ce3517 to 627d0e5 Compare July 14, 2025 09:04
@haiodo haiodo merged commit 360a251 into develop Jul 17, 2025
23 of 24 checks passed
@haiodo haiodo deleted the communication-indexer branch July 17, 2025 09:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants