Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
77 commits
Select commit Hold shift + click to select a range
0ca9bab
fix(api): refactor raw queries and add constants
vikaxsh Jun 12, 2025
b6c00d6
chore(api): Adding service layer
vikaxsh Jun 12, 2025
190b89f
chore(api): adding service layer
vikaxsh Jun 17, 2025
922c2da
Merge branch 'staging' of https://github.com/datazip-inc/olake-fronte…
vikaxsh Jul 1, 2025
9a00631
fix: resolve conflict errors
vikaxsh Jul 1, 2025
b4bb565
feat: improve Worker design by passing existing Client
vikaxsh Jul 3, 2025
679e4ce
Merge branch 'staging' of https://github.com/datazip-inc/olake-fronte…
vikaxsh Jul 10, 2025
934cb1e
feat: improving error handling a
vikaxsh Jul 13, 2025
d152357
feat: add info logging
vikaxsh Jul 14, 2025
a1142de
fix: changes after testing
vikaxsh Jul 17, 2025
3bdd367
Merge branch 'staging' of https://github.com/datazip-inc/olake-fronte…
vikaxsh Jul 17, 2025
c4e93e8
feat(docker): use Docker Go SDK instead of shell commands for contain…
vikaxsh Jul 17, 2025
489a2ea
feat: updated GoSec security ci
vikaxsh Jul 18, 2025
5942237
feat: delete config files
vikaxsh Jul 18, 2025
376a12b
chore: update project name to olake-ui
vikaxsh Jul 30, 2025
8213098
chore: addressed review comments
vikaxsh Jul 30, 2025
61bfd98
chore: merge staging branch
vikaxsh Aug 13, 2025
abc47c8
chore: creatign dto packaghe
vikaxsh Aug 13, 2025
33640af
chore: using GetIDFromPath function for id
vikaxsh Aug 14, 2025
6ab7a04
feat: implement dto layer and validation for request
vikaxsh Aug 18, 2025
500306c
chore: saving changes
vikaxsh Oct 7, 2025
c163f6c
merge staging
vikaxsh Oct 7, 2025
d0c0815
chore: refactor based on self review
vikaxsh Oct 8, 2025
de35522
Merge branch 'staging' of https://github.com/datazip-inc/olake-fronte…
vikaxsh Oct 8, 2025
50017ff
chore: refactor
vikaxsh Oct 8, 2025
0412835
docs: updated api contract
vikaxsh Oct 8, 2025
52321d2
refactor: initialize services once at startup and standardize error l…
vikaxsh Oct 15, 2025
072698e
Merge branch 'staging' of https://github.com/datazip-inc/olake-fronte…
vikaxsh Oct 15, 2025
bfe5015
fix: remove unnecessary checks
vikaxsh Oct 15, 2025
d3c4c93
fix: ci issues
vikaxsh Oct 15, 2025
931dbb1
fix: ci issues
vikaxsh Oct 15, 2025
4d4cac8
fix: ci issues
vikaxsh Oct 15, 2025
da49039
fix: lint issues
vikaxsh Oct 15, 2025
1192f2e
fix: refactor unmarshal and validation for req body
vikaxsh Oct 15, 2025
8a3845f
chore: refactor dto and nil checks
vikaxsh Oct 15, 2025
aa7a200
chore: use errorf
vikaxsh Oct 15, 2025
bdf7708
fix: dto and db queries
vikaxsh Oct 16, 2025
7398e8b
chore: resovle review comments
vikaxsh Oct 16, 2025
cdffdcf
chore: remove nil checks and added request uri in error logs
vikaxsh Oct 16, 2025
e080a8a
fix: lint issue
vikaxsh Oct 16, 2025
9912f5d
chore: refactor bff (#237)
hash-data Oct 24, 2025
b0cf000
chore: adding back vikash commit of package name change
hash-data Oct 24, 2025
7b6d22c
chore: adding back vikash commit of package name change
hash-data Oct 24, 2025
6275f0d
refactor: merge k8s and docker workers (#205)
vishalm0509 Oct 30, 2025
24a0747
chore: add constants for app.conf keys
vishalm0509 Oct 30, 2025
ab425b3
fix: call pause and unpause in activate job service
vishalm0509 Oct 30, 2025
a2ce1db
chore: api success response update
vikaxsh Oct 31, 2025
d718f06
Merge branch 'staging' of https://github.com/datazip-inc/olake-fronte…
vikaxsh Oct 31, 2025
948d57b
fix: lint issue
vikaxsh Oct 31, 2025
7efe398
fix: source and job dataitems
vikaxsh Oct 31, 2025
a2e13b6
fix: api according to bff refactor
deepanshupal09-datazip Nov 1, 2025
808c269
fix: build errors
deepanshupal09-datazip Nov 1, 2025
8fc26ef
Merge branch 'refactor/bff' into refactor/ui-api-changes
deepanshupal09-datazip Nov 1, 2025
b2c2f88
chore: consistant logger accorss files
vikaxsh Nov 2, 2025
ba6d558
fix: security ci
vikaxsh Nov 2, 2025
7e527f9
fix: security ci
vikaxsh Nov 2, 2025
b12fafc
fix: panic issue and add unique name check in job creation
vikaxsh Nov 2, 2025
a6ad22a
feat: added job cancel in job updatea and return error from test conn…
vikaxsh Nov 3, 2025
0f566d8
chore: move temporal and etl into services folder
vikaxsh Nov 3, 2025
68b2397
chore: use same name in sevice and handlers
vikaxsh Nov 3, 2025
b9bbc49
fix: source test connection
vikaxsh Nov 3, 2025
ce8b05c
fix: move result nil check before error in source and destiantion tes…
vikaxsh Nov 3, 2025
6ffd9f6
fix: fix job history retry and destination spec api (#244)
deepanshupal09-datazip Nov 3, 2025
d0053fb
fix: remove hardcoding branch name in build-ui workflow
vishalm0509 Nov 3, 2025
268e7b2
fix: remove k8s and docker task queue
vishalm0509 Nov 3, 2025
7b62dd2
fix: lint issue
vishalm0509 Nov 3, 2025
e5dfb84
fix: error in login and test destiantion
vikaxsh Nov 4, 2025
a849ec9
fix: add retry logic for temporal client init
vishalm0509 Nov 4, 2025
4091964
fix: send id in job edit (#245)
deepanshupal09-datazip Nov 5, 2025
a825e8c
chore: update worker tag in docker-compose for int. test
vishalm0509 Nov 7, 2025
029ebfb
chore: remove temporal address from constant (#246)
vishalm0509 Nov 7, 2025
dad4009
fix: add cleanup on cancelling fetchSpec API
deepanshupal09-datazip Nov 7, 2025
f54819f
chore: resolve review comments
vikaxsh Nov 7, 2025
2c09805
chore: remove unused messages
vikaxsh Nov 7, 2025
df41e5d
Merge pull request #248 from datazip-inc/fix/add-cleanup-fetchSpec-api
vishalm0509 Nov 7, 2025
58f5edd
fix: integration test - attempt 1
vishalm0509 Nov 7, 2025
292b8a3
chore: added a todo
vikaxsh Nov 7, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 9 additions & 28 deletions .github/workflows/build-and-release.yml
Original file line number Diff line number Diff line change
@@ -1,52 +1,34 @@
name: Olake UI Build And Release

on:
workflow_call:
workflow_dispatch:
inputs:
environment:
description: "Environment to build (master, staging, dev)"
required: true
default: ""
type: string
version:
description: "Version to release"
required: true
default: ""
type: string
workflow_dispatch:
workflow_call:
inputs:
environment:
description: "Environment to build (master, staging, dev)"
required: true
default: "dev"
type: choice
options:
- master
- staging
- dev
version:
description: "Version to release"
required: true
default: "v0.0.0.dev"
type: string
default: ""

jobs:
build_and_publish_frontend:
name: Build and publish frontend image for ${{ inputs.environment }}
environment: ${{ inputs.environment }}
name: Build and publish frontend image
runs-on: ubuntu-latest
environment: Build UI

env:
DOCKER_LOGIN: ${{ secrets.DOCKER_USERNAME }}
DOCKER_PASSWORD: ${{ secrets.DOCKER_PASSWORD }}
DOCKER_REPO: ${{ secrets.DOCKER_REPO || 'olakego' }}
DOCKER_REPO_WORKER: ${{ secrets.DOCKER_REPO_WORKER || 'olakego' }}
ENVIRONMENT: ${{ inputs.environment }}
VERSION: ${{ inputs.version }}
VERSION: ${{ inputs.version || github.event.inputs.version || 'v0.0.0.dev' }}

steps:
- name: Checkout code
uses: actions/checkout@v3
with:
ref: ${{ inputs.environment == 'master' && 'master' || (inputs.environment == 'staging' && 'staging' || inputs.environment == 'dev' && 'ci/workerReleaseIssues' || 'develop') }}

- name: Set up Node.js
uses: actions/setup-node@v3
Expand All @@ -66,9 +48,8 @@ jobs:
- name: Setup environment variables
run: |
echo "ENVIRONMENT=${{ env.ENVIRONMENT }}" >> $GITHUB_ENV
echo "VERSION=${{ env.VERSION }}" >> $GITHUB_ENV
echo "Building frontend application for $ENVIRONMENT with version $VERSION"
echo "Building frontend for branch $GITHUB_REF_NAME with version $VERSION"
- name: Run Release tool
run: |
Expand Down
10 changes: 4 additions & 6 deletions .github/workflows/security-ci.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3,18 +3,17 @@ on:
push:
branches:
- "master"
- "feat/bff-api"
pull_request:
branches:
- "*"
- "feat/bff-api"
workflow_dispatch:
inputs:
logLevel:
description: "Log level"
required: true
default: "warning"


jobs:
govulncheck:
name: govulncheck
Expand All @@ -23,22 +22,21 @@ jobs:
- uses: actions/checkout@v3
- uses: actions/setup-go@v3
with:
check-latest: "true"
go-version: "1.24.x"
go-version: "1.24.x" # Exact version for stability
- name: Install govulncheck
run: go install golang.org/x/vuln/cmd/govulncheck@latest
- name: Run vulnerability checks
working-directory: ./server
run: govulncheck ./...

gosec:
name: GoSec Security Scanner
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: actions/setup-go@v3
with:
check-latest: "true"
go-version: "1.24.x"
go-version: "1.24.x" # Removed check-latest to prevent upgrade to 1.25.x
- name: install gosec
run: curl -sfL https://raw.githubusercontent.com/securego/gosec/master/install.sh | sh -s -- -b $(go env GOPATH)/bin
- name: Run Gosec Security Scanner
Expand Down
3 changes: 3 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# Stage 1: Go Builder (Backend)
FROM golang:1.24.2-alpine AS go-builder


# Install git, as it might be needed by go mod download or go build
RUN apk add --no-cache git

Expand All @@ -19,6 +20,8 @@ RUN cd server && go build -ldflags="-w -s" -o /app/olake-server .

# Stage 2: Frontend Builder
FROM node:20-alpine AS node-builder

# Reuse build-time arguments during UI build if needed
WORKDIR /app/ui

# Install pnpm globally
Expand Down
5 changes: 3 additions & 2 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -51,10 +51,11 @@ BACKEND_ENV_VARS = \
OLAKE_POSTGRES_PORT=5432 \
OLAKE_POSTGRES_DBNAME=postgres \
OLAKE_POSTGRES_SSLMODE=disable \
LOGS_DIR=./logger/logs \
LOGS_DIR=$(PWD)/logger/logs \
SESSION_ON=true \
TEMPORAL_ADDRESS=localhost:7233 \
CONTAINER_REGISTRY_BASE=registry-1.docker.io
CONTAINER_REGISTRY_BASE=registry-1.docker.io \
PERSISTENT_DIR=$(PWD)/olake-config

# Frontend environment variables
FRONTEND_ENV_VARS = \
Expand Down
Loading
Loading