Skip to content

Conversation

@deepanshupal09-datazip
Copy link
Collaborator

Description

This PR adds append only mode in UI

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

  • Tested append only mode in job edit
  • Tested append only mode in job creation
  • Tested "All Upsert" and "All Append" in streams

Screenshots or Recordings

Screenshot 2025-10-16 at 4 06 23 PM Screenshot 2025-10-16 at 4 06 36 PM Screenshot 2025-10-16 at 4 06 59 PM

Related PR's (If Any):

@vishalm0509
Copy link
Collaborator

vishalm0509 commented Oct 22, 2025

After saving with all_append and reopening edit_streams, the tab still shows all_upsert even though all streams are already in append_only. Just checking is this the intended behavior?

Screen.Recording.2025-10-22.at.2.40.38.PM.mov

@deepanshupal09-datazip
Copy link
Collaborator Author

After saving with all_append and reopening edit_streams, the tab still shows all_upsert even though all streams are already in append_only. Just checking is this the intended behavior?

Screen.Recording.2025-10-22.at.2.40.38.PM.mov

This switch's default mode is "All Upsert", only when user changes that switch to "All Append", all streams are made to append only mode.

vishalm0509
vishalm0509 previously approved these changes Oct 23, 2025
Copy link
Collaborator

@vishalm0509 vishalm0509 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Minor comments

@shubham19may shubham19may merged commit 4cf9938 into staging Oct 29, 2025
10 checks passed
hash-data added a commit that referenced this pull request Oct 31, 2025
* feat: show error logs in test connection in source and destination

* fix: fix test connection fail modal

* fix: resolve comments

* chore: add comments (#224)

* chore: add comments

* chore: 🚨 lint fix

* feat: add error logs in check connection for source and destination (#195)

* feat: add error logs i check conenction for source and destination

* fix: parse json message as string

* chore: update response key

* chore: refactor

* chore: remove logEntry struct

* fix: log parsing

* fix: log parsing

* fix: logs parsing logic

* docs: updated api contract

* test: ✅ base setup for automation testing using play… (#203)

* test: ✅ base setup for automation testing using playwright , add test cases fro major flows

* fix: integration workflow changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* test: add postgres flow

* fix: lint changes

* test: add iceberg specific test

* fix: tests

* fix: stream name

* fix: test fix

* fix: test fix

* fix: test fix

* fix: test fix

* fix: changes

* fix: ci changes

* fix: ci changes

* fix: ci changes

* test: fail test on test connection failure

* fix: ci changes

* fix: changes

* fix: changes

* fix: changes

* fix: changes

* fix: changes

* fix: changes

* fix: test fix

* fix: changes

* fix: changes

* fix: test-data fix

* fix: test-data fix

* fix: changes

* fix: changes

* fix: changes

* fix: host and port changes

* fix: changes

* fix: change

* test: login test updated

* test: refactor create source and destination page

* test: refactor tests

* fix: test fix

* fix: changes

* fix: fix changes

* fix: changes

* fix: changes

* fix: review changes

* refactor: refactor tests to use authenticated state of playwright

* fix: changes

* docs: update tests readme

* test: intercept and log destination spec response

* docs: update readme

* fix: update timeouts for playwright tests

* test: update readme

* fix: add retries in playwright config

* test: fix timeout duration

* fix: update readme

* test: add connector data test-id

* fix: resolve comments

* refactor(test): make and use enums instead of strings

* fix: fix test data builder

* fix: test data job name

* fix: add todo

---------

Co-authored-by: Duke Dhal <duke@datazip.io>
Co-authored-by: deepanshupal09-datazip <deepanshu@datazip.io>

* feat: show refetch success message in job history page (#227)

* Added success message on Job History refetch

* Update ui/src/modules/jobs/pages/JobHistory.tsx

Co-authored-by: deepanshupal09-datazip <deepanshu@datazip.io>

---------

Co-authored-by: vikash choudhary <vikash@datazip.io>
Co-authored-by: deepanshupal09-datazip <deepanshu@datazip.io>

* fix: replace deprecated Phosphor icons with latest *Icon alternatives (#216)

* fix: replace deprecated Phosphor icons with latest *Icon alternatives

* fix: update Phosphor icons to latest alternatives in DestinationEdit and SourceEdit components and fix Lint issue

* refactor: remove EditSourceModal

* fix: update icon import

---------

Co-authored-by: vikash choudhary <vikash@datazip.io>

* feat: add clear destination

* fix: merge conflicts

* fix: build error fix

* feat: append only mode (#232)

* feat: add append only mode in ui

* fix: data filter bug

* fix: fix color of append only mode switch

* fix: add custom option in all streams ingestion mode change

* fix: use clsx for conditional styling

* fix: fix icons

* chore: add utils

---------

Co-authored-by: Taraka Swathi <swathi@datazip.io>
Co-authored-by: Ankit Sharma <111491139+hash-data@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
Co-authored-by: Duke Dhal <duke@datazip.io>
Co-authored-by: SARTHAK RANA <23510370.dit@dypvp.edu.in>
Co-authored-by: vishalm0509 <vishal@datazip.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants