forked from brianfrankcooper/YCSB
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[elasticsearch,elasticsearch5] Add Elasticsearch 5.x binding
- Loading branch information
Showing
13 changed files
with
883 additions
and
41 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,94 @@ | ||
| <!-- | ||
| Copyright (c) 2017 YCSB contributors. All rights reserved. | ||
| Licensed under the Apache License, Version 2.0 (the "License"); you | ||
| may not use this file except in compliance with the License. You | ||
| may obtain a copy of the License at | ||
| http://www.apache.org/licenses/LICENSE-2.0 | ||
| Unless required by applicable law or agreed to in writing, software | ||
| distributed under the License is distributed on an "AS IS" BASIS, | ||
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or | ||
| implied. See the License for the specific language governing | ||
| permissions and limitations under the License. See accompanying | ||
| LICENSE file. | ||
| --> | ||
|
|
||
| ## Quick Start | ||
|
|
||
| This section describes how to run YCSB on Elasticsearch 5.x running locally. | ||
|
|
||
| ### 1. Set Up YCSB | ||
|
|
||
| Clone the YCSB git repository and compile: | ||
|
|
||
| git clone git://github.com/brianfrankcooper/YCSB.git | ||
| cd YCSB | ||
| mvn clean package | ||
|
|
||
| ### 2. Run YCSB | ||
|
|
||
| Now you are ready to run! First, load the data: | ||
|
|
||
| ./bin/ycsb load elasticsearch5 -s -P workloads/workloada -p path.home=<path> | ||
|
|
||
| Then, run the workload: | ||
|
|
||
| ./bin/ycsb run elasticsearch5 -s -P workloads/workloada -p path.home=<path> | ||
|
|
||
| Note that the `<path>` specified in each execution should be the same. | ||
|
|
||
| The Elasticsearch 5 binding has two modes of operation, embedded mode and remote | ||
| mode. In embedded mode, the client creates an embedded instance of | ||
| Elasticsearch that uses the specified `<path>` to persist data between | ||
| executions. | ||
|
|
||
| In remote mode, the client will hit a standalone instance of Elasticsearch. To | ||
| use remote mode, add the flags `-p es.remote=true` and specify a hosts list via | ||
| `-p es.hosts.list=<hostname1:port1>,...,<hostnamen:portn>`. | ||
|
|
||
| ./bin/ycsb run elasticsearch5 -s -P workloads/workloada -p es.remote=true \ | ||
| -p es.hosts.list=<hostname1:port1>,...,<hostnamen:portn>` | ||
|
|
||
| Note that `es.hosts.list` defaults to `localhost:9300`. For further | ||
| configuration see below: | ||
|
|
||
| ### Defaults Configuration | ||
| The default setting for the Elasticsearch node that is created is as follows: | ||
|
|
||
| cluster.name=es.ycsb.cluster | ||
| es.index.key=es.ycsb | ||
| es.number_of_shards=1 | ||
| es.number_of_replicas=0 | ||
| es.remote=false | ||
| es.newdb=false | ||
| es.hosts.list=localhost:9300 (only applies if es.remote=true) | ||
|
|
||
| ### Custom Configuration | ||
| If you wish to customize the settings used to create the Elasticsearch node | ||
| you can created a new property file that contains your desired Elasticsearch | ||
| node settings and pass it in via the parameter to 'bin/ycsb' script. Note that | ||
| the default properties will be kept if you don't explicitly overwrite them. | ||
|
|
||
| Assuming that we have a properties file named "myproperties.data" that contains | ||
| custom Elasticsearch node configuration you can execute the following to | ||
| pass it into the Elasticsearch client: | ||
|
|
||
|
|
||
| ./bin/ycsb run elasticsearch5 -P workloads/workloada -P myproperties.data -s | ||
|
|
||
| If you wish to change the default index name you can set the following property: | ||
|
|
||
| es.index.key=my_index_key | ||
|
|
||
| If you wish to run against a remote cluster you can set the following property: | ||
|
|
||
| es.remote=true | ||
|
|
||
| By default this will use localhost:9300 as a seed node to discover the cluster. | ||
| You can also specify | ||
|
|
||
| es.hosts.list=(\w+:\d+)+ | ||
|
|
||
| (a comma-separated list of host/port pairs) to change this. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,78 @@ | ||
| <?xml version="1.0" encoding="UTF-8"?> | ||
| <!-- | ||
| Copyright (c) 2017 YCSB contributors. All rights reserved. | ||
| Licensed under the Apache License, Version 2.0 (the "License"); you | ||
| may not use this file except in compliance with the License. You | ||
| may obtain a copy of the License at | ||
| http://www.apache.org/licenses/LICENSE-2.0 | ||
| Unless required by applicable law or agreed to in writing, software | ||
| distributed under the License is distributed on an "AS IS" BASIS, | ||
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or | ||
| implied. See the License for the specific language governing | ||
| permissions and limitations under the License. See accompanying | ||
| LICENSE file. | ||
| --> | ||
|
|
||
| <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" | ||
| xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd"> | ||
| <modelVersion>4.0.0</modelVersion> | ||
| <parent> | ||
| <groupId>com.yahoo.ycsb</groupId> | ||
| <artifactId>binding-parent</artifactId> | ||
| <version>0.13.0-SNAPSHOT</version> | ||
| <relativePath>../binding-parent</relativePath> | ||
| </parent> | ||
|
|
||
| <properties> | ||
| <!-- Skip tests by default. will be activated by jdk8 profile --> | ||
| <skipTests>true</skipTests> | ||
| </properties> | ||
|
|
||
| <artifactId>elasticsearch5-binding</artifactId> | ||
| <name>Elasticsearch 5.x Binding</name> | ||
| <packaging>jar</packaging> | ||
| <dependencies> | ||
| <dependency> | ||
| <!-- jna is supported in ES and will be used when provided | ||
| otherwise a fallback is used --> | ||
| <groupId>net.java.dev.jna</groupId> | ||
| <artifactId>jna</artifactId> | ||
| <version>4.1.0</version> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>com.yahoo.ycsb</groupId> | ||
| <artifactId>core</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>provided</scope> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.elasticsearch.client</groupId> | ||
| <artifactId>transport</artifactId> | ||
| <version>${elasticsearch5-version}</version> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.elasticsearch.client</groupId> | ||
| <artifactId>rest</artifactId> | ||
| <version>${elasticsearch5-version}</version> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.apache.logging.log4j</groupId> | ||
| <artifactId>log4j-api</artifactId> | ||
| <version>2.7</version> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.apache.logging.log4j</groupId> | ||
| <artifactId>log4j-core</artifactId> | ||
| <version>2.7</version> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>junit</groupId> | ||
| <artifactId>junit</artifactId> | ||
| <version>4.12</version> | ||
| <scope>test</scope> | ||
| </dependency> | ||
| </dependencies> | ||
| </project> |
Oops, something went wrong.