Skip to content

Conversation

@hash-data
Copy link
Collaborator

@hash-data hash-data commented Oct 17, 2025

Description

Refactored the backend
-> Temporal Client
-> Service
-> Database Package
-> Handlers

Fixes # (issue)

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

  • Scenario A
  • Scenario B

Screenshots or Recordings

Related PR's (If Any):

@hash-data hash-data merged commit 9912f5d into refactor/bff Oct 24, 2025
1 check passed
@hash-data hash-data deleted the refactor/refactor_pr branch October 24, 2025 15:41
hash-data added a commit that referenced this pull request Nov 7, 2025
* fix(api): refactor raw queries and add constants

* chore(api): Adding service layer

* chore(api): adding service layer

* fix: resolve conflict errors

* feat: improve Worker design by passing existing Client

* feat: improving error handling a

* feat: add info logging

* fix: changes after testing

* feat(docker): use Docker Go SDK instead of shell commands for container operations

* feat: updated GoSec security ci

* feat: delete config files

* chore: update project name to olake-ui

* chore: addressed review comments

* chore: creatign dto packaghe

* chore: using GetIDFromPath function for id

* feat: implement dto layer and validation for request

* merge staging

* chore: refactor based on self review

* chore: refactor

* docs: updated api contract

* refactor: initialize services once at startup and standardize error logging

* fix: remove unnecessary checks

* fix: ci issues

* fix: ci issues

* fix: ci issues

* fix: lint  issues

* fix: refactor unmarshal and validation for req body

* chore: refactor dto and nil checks

* chore: use errorf

* fix: dto and db queries

* chore: resovle review comments

* chore: remove nil checks and added request uri in error logs

* fix: lint issue

* chore: refactor bff (#237)

* chore: refactored refactor pr

* chore: some more refactor related changes

* chore: refactor temporal service

* chore: remove comments

* chore: refactor error throwing

* chore: updating handler

* chore: rename service and db thing

* chore: adding back vikash commit of package name change

* chore: adding back vikash commit of package name change

* refactor: merge k8s and docker workers  (#205)

* fix: commands -> check, discover

* fix: sync worklfow

* refactor: remove worker from olake-ui

* chore: remove worker files & add timeout utility

* chore: update branch name in worklfow to release an image

* fix: remove worker from release.sh

* fix: add pre and post sync worker callback

* fix: add telemetry event for sync workflow

* fix: latest changes

* chore: remove stale code

* fix: update env var - container_persistence_dir and host_persistence_dir

* chore: remove worker job api

* chore: cleanup files

* fix: fix refactor bff changes

* chore: move encryptionkey to app.conf

* chore: add unmarshal-and-validate util

* chore: add robust error logging (resolve comments)

* chore: remove container_persistent_path env var

* fix: update sync workflow to match the old worker

* chore: add wrong workflow name

* chore: add correct workflow name

* fix: resolve comments

* chore: add constants for app.conf keys

* fix: call pause and unpause in activate job service

* chore: api success response update

* fix: lint issue

* fix: source and job dataitems

* fix: api according to bff refactor

* fix: build errors

* chore: consistant logger accorss files

* fix: security ci

* fix: security ci

* fix: panic issue and add unique name check in job creation

* feat: added job cancel in job updatea and return error from test connection

* chore: move temporal and etl into services folder

* chore: use same name in sevice and handlers

* fix: source test connection

* fix: move result nil check before error in source and destiantion test connection

* fix: fix job history retry and destination spec api  (#244)

* fix: fix job history retry

* fix: fix destination spec api

* fix: remove hardcoding branch name  in build-ui workflow

* fix: remove k8s and docker task queue

* fix: lint issue

* fix: error in login and test destiantion

* fix: add retry logic for temporal client init

* fix: send id in job edit (#245)

* fix: send id in job edit

* fix: add modal for spec error, fix double error messages

* fix: integration test fix

* fix: minor fix

* chore: update worker tag in docker-compose for int. test

* chore: remove temporal address from constant (#246)

* chore: remove temporalAddr constant and make retry simple

* chore: remove logs

* fix: add cleanup on cancelling fetchSpec API

* chore: resolve review comments

* chore: remove unused messages

* fix: integration test - attempt 1

* chore: added a todo

---------

Co-authored-by: Ankit Sharma <111491139+hash-data@users.noreply.github.com>
Co-authored-by: hashcode-ankit <ankit@datazip.io>
Co-authored-by: vishal-datazip <vishal@datazip.io>
Co-authored-by: deepanshupal09-datazip <deepanshu@datazip.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants