Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
77 commits
Select commit Hold shift + click to select a range
97e45f5
test: :white_check_mark: base setup for automation testing using play…
tarakaswathi-datazip Sep 30, 2025
96e4d60
fix: integration workflow changes
ImDoubD-datazip Oct 3, 2025
02a3af9
fix: ci changes
ImDoubD-datazip Oct 5, 2025
ee2f45f
fix: ci changes
ImDoubD-datazip Oct 5, 2025
78672e8
fix: ci changes
ImDoubD-datazip Oct 5, 2025
938330d
fix: ci changes
ImDoubD-datazip Oct 5, 2025
2938ff3
fix: ci changes
ImDoubD-datazip Oct 5, 2025
61430b4
fix: ci changes
ImDoubD-datazip Oct 5, 2025
9555c5d
fix: ci changes
ImDoubD-datazip Oct 5, 2025
9b8abca
fix: ci changes
ImDoubD-datazip Oct 5, 2025
7be83e9
fix: ci changes
ImDoubD-datazip Oct 5, 2025
b906ef7
fix: ci changes
ImDoubD-datazip Oct 5, 2025
2a9dcce
fix: ci changes
ImDoubD-datazip Oct 5, 2025
2cf0915
fix: ci changes
ImDoubD-datazip Oct 5, 2025
1dd4cf1
fix: ci changes
ImDoubD-datazip Oct 6, 2025
f1834d1
fix: ci changes
ImDoubD-datazip Oct 6, 2025
f11ed8f
fix: ci changes
ImDoubD-datazip Oct 6, 2025
b68c301
fix: ci changes
ImDoubD-datazip Oct 6, 2025
3b44943
test: add postgres flow
tarakaswathi-datazip Oct 6, 2025
f522e72
fix: lint changes
ImDoubD-datazip Oct 6, 2025
d03cb42
test: add iceberg specific test
deepanshupal09-datazip Oct 6, 2025
d014303
fix: tests
deepanshupal09-datazip Oct 6, 2025
045a175
fix: stream name
deepanshupal09-datazip Oct 6, 2025
488cc3c
fix: test fix
deepanshupal09-datazip Oct 6, 2025
7c557c3
fix: test fix
deepanshupal09-datazip Oct 7, 2025
4fa9f89
fix: test fix
deepanshupal09-datazip Oct 7, 2025
092415f
fix: test fix
deepanshupal09-datazip Oct 7, 2025
147055b
fix: changes
ImDoubD-datazip Oct 8, 2025
f72b1cf
fix: ci changes
ImDoubD-datazip Oct 8, 2025
8ef78f4
fix: ci changes
ImDoubD-datazip Oct 8, 2025
08a732c
fix: ci changes
ImDoubD-datazip Oct 8, 2025
8af7f9e
test: fail test on test connection failure
deepanshupal09-datazip Oct 8, 2025
aa53e2a
fix: ci changes
ImDoubD-datazip Oct 8, 2025
ad70813
fix: changes
ImDoubD-datazip Oct 8, 2025
cd7e53c
fix: changes
ImDoubD-datazip Oct 8, 2025
fdf1790
fix: changes
ImDoubD-datazip Oct 8, 2025
acd1162
fix: changes
ImDoubD-datazip Oct 8, 2025
cc8f508
fix: changes
ImDoubD-datazip Oct 8, 2025
c25755d
fix: changes
ImDoubD-datazip Oct 8, 2025
a72d282
fix: changes
ImDoubD-datazip Oct 8, 2025
b0b5284
fix: test fix
deepanshupal09-datazip Oct 8, 2025
e77ee76
fix: changes
ImDoubD-datazip Oct 8, 2025
9df9bd9
fix: changes
ImDoubD-datazip Oct 8, 2025
98c3ef8
fix: test-data fix
deepanshupal09-datazip Oct 8, 2025
5be9679
fix: test-data fix
deepanshupal09-datazip Oct 8, 2025
9b95ebb
fix: changes
ImDoubD-datazip Oct 8, 2025
19a1b13
fix: changes
ImDoubD-datazip Oct 8, 2025
37d1e90
fix: changes
ImDoubD-datazip Oct 8, 2025
ee8e71b
fix: host and port changes
deepanshupal09-datazip Oct 8, 2025
b53c435
fix: changes
ImDoubD-datazip Oct 8, 2025
a384880
fix: change
ImDoubD-datazip Oct 8, 2025
1472452
test: login test updated
tarakaswathi-datazip Oct 9, 2025
f3f6093
test: refactor create source and destination page
deepanshupal09-datazip Oct 9, 2025
8d1833a
test: refactor tests
deepanshupal09-datazip Oct 9, 2025
247ad60
fix: test fix
deepanshupal09-datazip Oct 9, 2025
302bbce
fix: changes
deepanshupal09-datazip Oct 9, 2025
a8c47c2
fix: fix changes
deepanshupal09-datazip Oct 9, 2025
89c1f9a
fix: changes
deepanshupal09-datazip Oct 10, 2025
85b9f80
fix: changes
deepanshupal09-datazip Oct 10, 2025
f3180cd
fix: review changes
ImDoubD-datazip Oct 10, 2025
f91f8fe
refactor: refactor tests to use authenticated state of playwright
deepanshupal09-datazip Oct 10, 2025
53c9263
fix: changes
ImDoubD-datazip Oct 10, 2025
455a090
docs: update tests readme
deepanshupal09-datazip Oct 10, 2025
0b050a5
test: intercept and log destination spec response
deepanshupal09-datazip Oct 10, 2025
6256e33
docs: update readme
deepanshupal09-datazip Oct 10, 2025
75d4d0e
fix: update timeouts for playwright tests
deepanshupal09-datazip Oct 13, 2025
def1063
test: update readme
deepanshupal09-datazip Oct 13, 2025
bb3c2a0
fix: add retries in playwright config
deepanshupal09-datazip Oct 13, 2025
5fdba44
test: fix timeout duration
deepanshupal09-datazip Oct 13, 2025
187f8ed
fix: update readme
deepanshupal09-datazip Oct 13, 2025
70dafe1
test: add connector data test-id
deepanshupal09-datazip Oct 13, 2025
cad58a1
Merge branch 'staging' into test/end_to_end_automation
deepanshupal09-datazip Oct 15, 2025
f095338
fix: resolve comments
deepanshupal09-datazip Oct 15, 2025
173bb4c
refactor(test): make and use enums instead of strings
deepanshupal09-datazip Oct 16, 2025
9513938
fix: fix test data builder
deepanshupal09-datazip Oct 16, 2025
8637c07
fix: test data job name
deepanshupal09-datazip Oct 16, 2025
6f44e6a
fix: add todo
deepanshupal09-datazip Oct 17, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions .github/workflows/integration-test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: Integration Tests
on:
push:
branches:
- master
pull_request:
branches:
- "*"

jobs:
integration-tests:
runs-on: 32gb-runner
timeout-minutes: 30
steps:
- name: Checkout code
uses: actions/checkout@v3

- name: Set up Go
uses: actions/setup-go@v4
with:
go-version: '1.23.2'

- name: Download Go dependencies
working-directory: ./server
run: go mod download

- name: Run Docker In Docker Container Tests
working-directory: ./server
run: go test -v ./tests -timeout 0 -run 'TestDinDIntegration'
8 changes: 8 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -45,3 +45,11 @@ npm-debug*
# ----------------------------
*.env
*.env.*

# ----------------------------
# Test Files
# ----------------------------
ui/test-results/
ui/playwright-report/
ui/blob-report/
ui/tests/.auth/
97 changes: 80 additions & 17 deletions server/go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -5,17 +5,80 @@ go 1.24.2
require github.com/beego/beego/v2 v2.3.8

require (
github.com/apache/spark-connect-go/v35 v35.0.0-20250317154112-ffd832059443
github.com/aws/aws-sdk-go-v2/config v1.31.0
github.com/aws/aws-sdk-go-v2/service/ecr v1.49.0
github.com/aws/aws-sdk-go-v2/service/kms v1.41.1
github.com/docker/docker v28.3.3+incompatible
github.com/lib/pq v1.10.9
github.com/oklog/ulid v1.3.1
github.com/spf13/viper v1.20.1
github.com/testcontainers/testcontainers-go v0.39.0
go.temporal.io/sdk v1.34.0
golang.org/x/crypto v0.35.0
golang.org/x/crypto v0.41.0
golang.org/x/mod v0.27.0
)

require (
cloud.google.com/go/compute/metadata v0.7.0 // indirect
dario.cat/mergo v1.0.2 // indirect
github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 // indirect
github.com/Microsoft/go-winio v0.6.2 // indirect
github.com/apache/arrow-go/v18 v18.2.0 // indirect
github.com/cenkalti/backoff/v4 v4.2.1 // indirect
github.com/containerd/errdefs v1.0.0 // indirect
github.com/containerd/errdefs/pkg v0.3.0 // indirect
github.com/containerd/log v0.1.0 // indirect
github.com/containerd/platforms v0.2.1 // indirect
github.com/cpuguy83/dockercfg v0.3.2 // indirect
github.com/distribution/reference v0.6.0 // indirect
github.com/docker/go-connections v0.6.0 // indirect
github.com/docker/go-units v0.5.0 // indirect
github.com/ebitengine/purego v0.8.4 // indirect
github.com/felixge/httpsnoop v1.0.4 // indirect
github.com/go-errors/errors v1.5.1 // indirect
github.com/go-logr/logr v1.4.3 // indirect
github.com/go-logr/stdr v1.2.2 // indirect
github.com/go-ole/go-ole v1.2.6 // indirect
github.com/goccy/go-json v0.10.5 // indirect
github.com/google/flatbuffers v25.2.10+incompatible // indirect
github.com/klauspost/compress v1.18.0 // indirect
github.com/klauspost/cpuid/v2 v2.2.10 // indirect
github.com/lufia/plan9stats v0.0.0-20211012122336-39d0f177ccd0 // indirect
github.com/magiconair/properties v1.8.10 // indirect
github.com/moby/docker-image-spec v1.3.1 // indirect
github.com/moby/go-archive v0.1.0 // indirect
github.com/moby/patternmatcher v0.6.0 // indirect
github.com/moby/sys/sequential v0.6.0 // indirect
github.com/moby/sys/user v0.4.0 // indirect
github.com/moby/sys/userns v0.1.0 // indirect
github.com/moby/term v0.5.0 // indirect
github.com/morikuni/aec v1.0.0 // indirect
github.com/opencontainers/go-digest v1.0.0 // indirect
github.com/opencontainers/image-spec v1.1.1 // indirect
github.com/pierrec/lz4/v4 v4.1.22 // indirect
github.com/pkg/errors v0.9.1 // indirect
github.com/power-devops/perfstat v0.0.0-20210106213030-5aafc221ea8c // indirect
github.com/shirou/gopsutil/v4 v4.25.6 // indirect
github.com/sirupsen/logrus v1.9.3 // indirect
github.com/tklauser/go-sysconf v0.3.12 // indirect
github.com/tklauser/numcpus v0.6.1 // indirect
github.com/yusufpapurcu/wmi v1.2.4 // indirect
github.com/zeebo/xxh3 v1.0.2 // indirect
go.opentelemetry.io/auto/sdk v1.1.0 // indirect
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.54.0 // indirect
go.opentelemetry.io/otel v1.38.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace v1.38.0 // indirect
go.opentelemetry.io/otel/metric v1.38.0 // indirect
go.opentelemetry.io/otel/sdk/metric v1.38.0 // indirect
go.opentelemetry.io/otel/trace v1.38.0 // indirect
go.opentelemetry.io/proto/otlp v1.8.0 // indirect
golang.org/x/exp v0.0.0-20240909161429-701f63a606c0 // indirect
golang.org/x/oauth2 v0.30.0 // indirect
golang.org/x/tools v0.35.0 // indirect
golang.org/x/xerrors v0.0.0-20240903120638-7835f813f4da // indirect
)

require (
github.com/aws/aws-sdk-go-v2 v1.38.0
github.com/aws/aws-sdk-go-v2/credentials v1.18.4 // indirect
Expand All @@ -34,46 +97,46 @@ require (
require (
github.com/beorn7/perks v1.0.1 // indirect
github.com/cespare/xxhash/v2 v2.3.0 // indirect
github.com/davecgh/go-spew v1.1.1 // indirect
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
github.com/facebookgo/clock v0.0.0-20150410010913-600d898af40a // indirect
github.com/fsnotify/fsnotify v1.8.0 // indirect
github.com/go-viper/mapstructure/v2 v2.3.0 // indirect
github.com/gogo/protobuf v1.3.2 // indirect
github.com/golang/mock v1.6.0 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/grpc-ecosystem/go-grpc-middleware v1.4.0 // indirect
github.com/grpc-ecosystem/grpc-gateway/v2 v2.22.0 // indirect
github.com/grpc-ecosystem/grpc-gateway/v2 v2.27.2 // indirect
github.com/hashicorp/golang-lru v0.5.4 // indirect
github.com/jmoiron/sqlx v1.4.0
github.com/mitchellh/mapstructure v1.5.0 // indirect
github.com/nexus-rpc/sdk-go v0.3.0 // indirect
github.com/pelletier/go-toml/v2 v2.2.3 // indirect
github.com/pmezard/go-difflib v1.0.0 // indirect
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
github.com/prometheus/client_golang v1.19.0 // indirect
github.com/prometheus/client_model v0.5.0 // indirect
github.com/prometheus/common v0.48.0 // indirect
github.com/prometheus/procfs v0.12.0 // indirect
github.com/robfig/cron v1.2.0
github.com/sagikazarmark/locafero v0.7.0 // indirect
github.com/sagikazarmark/locafero v0.8.0 // indirect
github.com/shiena/ansicolor v0.0.0-20200904210342-c7312218db18 // indirect
github.com/sourcegraph/conc v0.3.0 // indirect
github.com/spf13/afero v1.12.0 // indirect
github.com/spf13/afero v1.14.0 // indirect
github.com/spf13/cast v1.7.1 // indirect
github.com/spf13/pflag v1.0.6 // indirect
github.com/stretchr/objx v0.5.2 // indirect
github.com/stretchr/testify v1.10.0 // indirect
github.com/stretchr/testify v1.11.1
github.com/subosito/gotenv v1.6.0 // indirect
github.com/valyala/bytebufferpool v1.0.0 // indirect
go.temporal.io/api v1.46.0
go.uber.org/atomic v1.9.0 // indirect
go.uber.org/multierr v1.9.0 // indirect
golang.org/x/net v0.36.0 // indirect
golang.org/x/sync v0.11.0 // indirect
golang.org/x/sys v0.30.0 // indirect
golang.org/x/text v0.22.0 // indirect
go.uber.org/multierr v1.11.0 // indirect
golang.org/x/net v0.43.0 // indirect
golang.org/x/sync v0.16.0 // indirect
golang.org/x/sys v0.36.0 // indirect
golang.org/x/text v0.28.0 // indirect
golang.org/x/time v0.8.0 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20241209162323-e6fa225c2576 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20241223144023-3abc09e42ca8 // indirect
google.golang.org/grpc v1.67.3 // indirect
google.golang.org/protobuf v1.36.5 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20250825161204-c5933d9347a5 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20250825161204-c5933d9347a5 // indirect
google.golang.org/grpc v1.75.0 // indirect
google.golang.org/protobuf v1.36.8 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
)
Loading
Loading