Skip to content

Commit

Permalink
[0.12.0-SNAPSHOT]
Browse files Browse the repository at this point in the history
ClickHouse module in progress
  • Loading branch information
GoodforGod committed May 24, 2024
1 parent 00e65c4 commit 64b3ae2
Show file tree
Hide file tree
Showing 36 changed files with 1,003 additions and 31 deletions.
1 change: 1 addition & 0 deletions build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@ dependencies {
jacocoAggregation project(":redis")
jacocoAggregation project(":mockserver")
jacocoAggregation project(":minio")
jacocoAggregation project(":clickhouse")
}

reporting {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -293,7 +293,7 @@ public <T, E extends Throwable> Optional<T> queryOne(@Language("CQL") @NotNull S
throws E {
logger.debug("Executing CQL:\n{}", cql);
try {
var boundStatement = getConnection().prepare(cql).bind().setTimeout(Duration.ofMinutes(5));
var boundStatement = getConnection().prepare(cql).bind().setTimeout(Duration.ofMinutes(2));
var row = getConnection().execute(boundStatement).one();
return (row != null)
? Optional.ofNullable(extractor.apply(row))
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ protected CassandraContainer<?> createContainerDefault(CassandraMetadata metadat
.withMdc("image", image.asCanonicalNameString())
.withMdc("alias", alias));
container.waitingFor(Wait.forListeningPort());
container.withStartupTimeout(Duration.ofMinutes(5));
container.withStartupTimeout(Duration.ofMinutes(2));
container.setNetworkAliases(new ArrayList<>(List.of(alias)));
if (metadata.networkShared()) {
container.withNetwork(Network.SHARED);
Expand Down
314 changes: 314 additions & 0 deletions clickhouse/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,314 @@
# Testcontainers Extensions Cockroachdb

[![Minimum required Java version](https://img.shields.io/badge/Java-11%2B-blue?logo=openjdk)](https://openjdk.org/projects/jdk/11/)
[![Maven Central](https://maven-badges.herokuapp.com/maven-central/io.goodforgod/testcontainers-extensions-cockroachdb/badge.svg)](https://maven-badges.herokuapp.com/maven-central/io.goodforgod/testcontainers-extensions-cockroachdb)
[![GitHub Action](https://github.com/goodforgod/testcontainers-extensions/workflows/Release/badge.svg)](https://github.com/GoodforGod/testcontainers-extensions/actions?query=workflow%3A"CI+Master"++)
[![Coverage](https://sonarcloud.io/api/project_badges/measure?project=GoodforGod_testcontainers-extensions&metric=coverage)](https://sonarcloud.io/dashboard?id=GoodforGod_testcontainers-extensions)
[![Maintainability Rating](https://sonarcloud.io/api/project_badges/measure?project=GoodforGod_testcontainers-extensions&metric=sqale_rating)](https://sonarcloud.io/dashboard?id=GoodforGod_testcontainers-extensions)
[![Lines of Code](https://sonarcloud.io/api/project_badges/measure?project=GoodforGod_testcontainers-extensions&metric=ncloc)](https://sonarcloud.io/dashboard?id=GoodforGod_testcontainers-extensions)

Testcontainers Cockroachdb Extension with advanced testing capabilities.

Features:
- Container easy run *per method*, *per class*, *per execution*.
- Container easy migration with *[Flyway](https://documentation.red-gate.com/fd/cockroachdb-184127591.html)* / *[Liquibase](https://www.liquibase.com/databases/cockroachdb-2)*.
- Container easy connection injection with asserts.

## Dependency :rocket:

**Gradle**
```groovy
testImplementation "io.goodforgod:testcontainers-extensions-cockroachdb:0.12.0"
```

**Maven**
```xml
<dependency>
<groupId>io.goodforgod</groupId>
<artifactId>testcontainers-extensions-cockroachdb</artifactId>
<version>0.12.0</version>
<scope>test</scope>
</dependency>
```

### JDBC Driver
Cockroachdb works natively with [Postgres JDBC Driver](https://mvnrepository.com/artifact/org.postgresql/postgresql). Driver must be on classpath, if it is somehow not on your classpath already,
don't forget to add:

**Gradle**
```groovy
testRuntimeOnly "org.postgresql:postgresql:42.6.0"
```

**Maven**
```xml
<dependency>
<groupId>org.postgresql</groupId>
<artifactId>postgresql</artifactId>
<version>42.6.0</version>
<scope>test</scope>
</dependency>
```

## Content
- [Usage](#usage)
- [Connection](#connection)
- [Migration](#connection-migration)
- [Annotation](#annotation)
- [Manual Container](#manual-container)
- [Connection](#annotation-connection)
- [External Connection](#external-connection)
- [Migration](#annotation-migration)

## Usage

Test with container start in `PER_RUN` mode and migration per method will look like:

```java
@TestcontainersCockroach(mode = ContainerMode.PER_RUN,
migration = @Migration(
engine = Migration.Engines.FLYWAY,
apply = Migration.Mode.PER_METHOD,
drop = Migration.Mode.PER_METHOD))
class ExampleTests {

@ConnectionCockroach
private JdbcConnection connection;

@Test
void test() {
connection.execute("INSERT INTO users VALUES(1);");
var usersFound = connection.queryMany("SELECT * FROM users;", r -> r.getInt(1));
assertEquals(1, usersFound.size());
}
}
```

## Connection

`JdbcConnection` is an abstraction with asserting data in database container and easily manipulate container connection settings.
You can inject connection via `@ConnectionCockroach` as field or method argument or manually create it from container or manual settings.

```java
class ExampleTests {

private static final CockroachContainer container = new CockroachContainer();

@Test
void test() {
container.start();
JdbcConnection connection = JdbcConnection.forContainer(container);
connection.execute("INSERT INTO users VALUES(1);");
}
}
```

### Connection Migration

`Migrations` allow easily migrate database between test executions and drop after tests.
You can migrate container via `@TestcontainersCockroach#migration` annotation parameter or manually using `JdbcConnection`.

```java
@TestcontainersCockroach
class ExampleTests {

@Test
void test(@ConnectionCockroach JdbcConnection connection) {
connection.migrationEngine(Migration.Engines.FLYWAY).apply("db/migration");
connection.execute("INSERT INTO users VALUES(1);");
connection.migrationEngine(Migration.Engines.FLYWAY).drop("db/migration");
}
}
```

Available migration engines:
- [Flyway](https://documentation.red-gate.com/fd/cockroachdb-184127591.html)
- [Liquibase](https://www.liquibase.com/databases/cockroachdb-2)

## Annotation

`@TestcontainersCockroach` - allow **automatically start container** with specified image in different modes without the need to configure it.

Available containers modes:

- `PER_RUN` - start container one time per *test execution*. (Containers must have same instance, e.g. compare by `==`)
- `PER_CLASS` - start new container each *test class*.
- `PER_METHOD` - start new container each *test method*.

Simple example on how to start container per class, **no need to configure** container:
```java
@TestcontainersCockroach(mode = ContainerMode.PER_CLASS)
class ExampleTests {

@Test
void test(@ConnectionCockroach JdbcConnection connection) {
assertNotNull(connection);
}
}
```

**That's all** you need.

It is possible to customize image with annotation `image` parameter.

Image also can be provided from environment variable:
```java
@TestcontainersCockroach(image = "${MY_IMAGE_ENV|clickhouse/clickhouse-server:24.4.1-alpine}")
class ExampleTests {

@Test
void test() {
// test
}
}
```

Image syntax:

- Image can have static value: `clickhouse/clickhouse-server:24.4.1-alpine`
- Image can be provided via environment variable using syntax: `${MY_IMAGE_ENV}`
- Image environment variable can have default value if empty using syntax: `${MY_IMAGE_ENV|clickhouse/clickhouse-server:24.4.1-alpine}`

### Manual Container

When you need to **manually configure container** with specific options, you can provide such container as instance that will be used by `@TestcontainersCockroach`,
this can be done using `@ContainerCockroach` annotation for container.

Example:
```java
@TestcontainersCockroach(mode = ContainerMode.PER_CLASS)
class ExampleTests {

@ContainerCockroach
private static final CockroachContainer container = new CockroachContainer();

@Test
void test(@ConnectionCockroach JdbcConnection connection) {
// do something
}
}
```

### Network

In case you want to enable [Network.SHARED](https://java.testcontainers.org/features/networking/) for containers you can do this using `network` & `shared` parameter in annotation:
```java
@TestcontainersCockroach(network = @Network(shared = true))
class ExampleTests {

@Test
void test() {
// test
}
}
```

`Default alias` will be created by default, even if nothing was specified (depends on implementation).

You can provide also custom alias for container.
Alias can be extracted from environment variable also or default value can be provided if environment is missing.

In case specified environment variable is missing `default alias` will be created:
```java
@TestcontainersCockroach(network = @Network(alias = "${MY_ALIAS_ENV|my_default_alias}"))
class ExampleTests {

@Test
void test() {
// test
}
}
```

Image syntax:

- Image can have static value: `my-alias`
- Image can be provided via environment variable using syntax: `${MY_ALIAS_ENV}`
- Image environment variable can have default value if empty using syntax: `${MY_ALIAS_ENV|my-alias-default}`

### Annotation Connection

`JdbcConnection` - can be injected to field or method parameter and used to communicate with running container via `@ConnectionCockroach` annotation.
`JdbcConnection` provides connection parameters, useful asserts, checks, etc. for easier testing.

Example:
```java
@TestcontainersCockroach(mode = ContainerMode.PER_CLASS, image = "clickhouse/clickhouse-server:24.4.1-alpine")
class ExampleTests {

@ConnectionCockroach
private JdbcConnection connection;

@Test
void test() {
connection.execute("CREATE TABLE users (id INT NOT NULL PRIMARY KEY);");
connection.execute("INSERT INTO users VALUES(1);");
connection.assertInserted("INSERT INTO users VALUES(2);");
var usersFound = connection.queryMany("SELECT * FROM users;", r -> r.getInt(1));
assertEquals(2, usersFound.size());
connection.assertQueriesEquals(2, "SELECT * FROM users;");
}
}
```

### External Connection

In case you want to use some external Cockroachdb instance that is running in CI or other place for tests (due to docker limitations or other),
you can use special *environment variables* and extension will use them to propagate connection and no Cockroachdb containers will be running in such case.

Special environment variables:
- `EXTERNAL_TEST_COCKROACH_JDBC_URL` - Cockroachdb instance JDBC url.
- `EXTERNAL_TEST_COCKROACH_USERNAME` - Cockroachdb instance username (optional).
- `EXTERNAL_TEST_COCKROACH_PASSWORD` - Cockroachdb instance password (optional).
- `EXTERNAL_TEST_COCKROACH_HOST` - Cockroachdb instance host (optional if JDBC url specified).
- `EXTERNAL_TEST_COCKROACH_PORT` - Cockroachdb instance port (optional if JDBC url specified).
- `EXTERNAL_TEST_COCKROACH_DATABASE` - Cockroachdb instance database (`cockroachdb` by default) (optional if JDBC url specified)

Use can use either `EXTERNAL_TEST_COCKROACH_JDBC_URL` to specify connection with username & password combination
or use combination of `EXTERNAL_TEST_COCKROACH_HOST` & `EXTERNAL_TEST_COCKROACH_PORT` & `EXTERNAL_TEST_COCKROACH_DATABASE`.

`EXTERNAL_TEST_COCKROACH_JDBC_URL` env have higher priority over host & port & database.

### Annotation Migration

`@Migrations` allow easily migrate database between test executions and drop after tests.

Annotation parameters:
- `engine` - to use for migration.
- `apply` - parameter configures migration mode.
- `drop` - configures when to reset/drop/clear database.
- `locations` - configures locations where migrations are placed.

Available migration engines:
- [Flyway](https://documentation.red-gate.com/fd/cockroachdb-184127591.html)
- [Liquibase](https://www.liquibase.com/databases/cockroachdb-2)

Given engine is [Flyway](https://documentation.red-gate.com/fd/cockroachdb-184127591.html) and migration file named `V1__flyway.sql` is in resource directory on default path `db/migration`:
```sql
CREATE TABLE IF NOT EXISTS users
(
id INT NOT NULL PRIMARY KEY
);
```

Test with container and migration per method will look like:
```java
@TestcontainersCockroach(mode = ContainerMode.PER_CLASS,
migration = @Migration(
engine = Migration.Engines.FLYWAY,
apply = Migration.Mode.PER_METHOD,
drop = Migration.Mode.PER_METHOD))
class ExampleTests {

@Test
void test(@ConnectionCockroach JdbcConnection connection) {
connection.execute("INSERT INTO users VALUES(1);");
var usersFound = connection.queryMany("SELECT * FROM users;", r -> r.getInt(1));
assertEquals(1, usersFound.size());
}
}
```

## License

This project licensed under the Apache License 2.0 - see the [LICENSE](../LICENSE) file for details.
15 changes: 15 additions & 0 deletions clickhouse/build.gradle
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
dependencies {
compileOnly libs.driver.clickhouse

api project(":jdbc")
api libs.testcontainers.clickhouse

implementation "io.goodforgod:liquibase-clickhouse:4.27.0-SNAPSHOT"
implementation libs.slf4j.jul
implementation libs.flyway.clickhouse
implementation libs.junit.launcher
implementation libs.junit.api
implementation libs.hikari

testImplementation libs.driver.clickhouse
}
Loading

0 comments on commit 64b3ae2

Please sign in to comment.