Release version 0.3.0

[gkamat]

I'll be managing the release of the next version of YCSB, 0.3.0.

Sean B. has done a terrific job driving the 0.2.0 release -- the first version after a rather long gap -- and the intention now is to establish a more regular release cadence going forward.

My plan is to put this version out in about a couple of weeks. I will create the release branch off master this Friday and then cherry-pick additional features into it as appropriate. Enhancements in this release will include the following:

• New binding: aerospike
• Updated bindings: cassandra, infinispan, orientdb
• Fixes to the HBase binding to be better compatible with earlier versions of HBase

As before, it would be really helpful for folks to volunteer to test the release, especially the updated bindings.

[busbey]

I'll take care of testing on windows again, unless someone else wants to jump in.

I'd like to see us get the jdbc driver tested this time.

Thanks for driving this Govind!

[cmccoy]

I can do HBase / Cassandra 2.0 again.
Thanks, Govind!

On Thu, Jul 16, 2015 at 5:59 AM, Sean Busbey notifications@github.com
wrote:

I'll take care of testing on windows again, unless someone else wants to
jump in.

I'd like to see us get the jdbc driver tested this time.

Thanks for driving this Govind!

—
Reply to this email directly or view it on GitHub
#358 (comment)
.

[allanbank]

I can do MongoDB again and hope to get some time to look at the jdbc binding.

[gkamat]

Thanks very much for volunteering, folks! Release candidate 0.3.0-RC1 is now available.

• Testers should build and use either the distribution artifact (ycsb-0.3.0-RC1.tar.gz) or a binding specific distribution (e.g. ycsb-hbase-0.3.0-RC1.tar.gz). Please file issues for problems found.
• Fixes for issues should go into master. I will pull changes back into the release staging branch.
• As issues come up, I will periodically cut new release candidates off the 0.3.0-staging branch. After the final release is published, the staging branch will be deleted. The tag can be used to track the branch or to generate patch releases.
• Successful testing of a datastore binding should be noted in this issue. Please include the following:
  • Datastore binding name (e.g. hbase)
  • Version of datastore tested against (e.g. hbase 1.0.0 cluster)
  • If the datastore has distinct single node and clustered modes, indicate which was used (e.g. hbase standalone)
  • OS for client
  • Packaging used (either the distribution artifact or a datastore-specific artifact)
  • Workload used
  • Any other options used

I will note any additional tasks and testing we need to get done in this issue. The final release artifacts will be similar to those in release 0.2.0. I will write up the release notes as we get close to publishing the release.

[allanbank]

MongoDB Testing:

• Bindings mongodb-async and mongodb
• Testing against single mongod instance for version 3.0.4, 2.6.10, 2.4.14, 2.2.7, 2.0.9, and 1.8.5
• OS - Linux Fedora 22
  • Linux kanga 4.0.8-300.fc22.x86_64 Test issue #1 SMP Fri Jul 10 21:04:56 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
• Using the src distribution and then running from the src directory.
• Packaged workloads a-f.
• Adjusted threads and connection counts.

Still seeing these issues (as expected):

• 'mongodb' client throws timeout exceptions with scan workloads. #344 - 'mongodb' client throws timeout exceptions with scan workloads.
  • I would really like to get 'mongodb' client throws timeout exceptions with scan workloads. #344 in 0.3.0. Can someone review [mongodb] Update the MongoDB driver version to 3.0.3. #362 so I can merge it to master and then we can get it in RC2?
• StatusThread should wake up when the test has completed and exit. #316 - StatusThread should wake up when the test has completed and exit.
  • Already on master. Not sure it is worth the effort to cherry pick.
• Race condition in workload D? #327 - Race condition in workload D?
  • No work done yet.

Question: I am building up a fairly big script for automating the testing. Any interest in putting it in the repo somewhere?

[allanbank]

I would like to see #353 / 2d6185e in 0.3.0.

[gkamat]

@allanbank, thanks for finishing the MongoDB testing quite so promptly!

With regard to testing, any automation would definitely be helpful. Ideally, the script would work with all or most bindings we have. The list of workloads and bindings being tested should be configurable and it should provide a good status summary at completion.

I will merge #353 shortly into 0.3.0.

[busbey]

I have a script I use for running through the workloads for Accumulo and
HBase. I'd be glad to use a followup to your initial script to make sure I
don't need to maintain my own. :)
On Jul 18, 2015 8:45 PM, "allanbank" notifications@github.com wrote:

MongoDB Testing:

• Bindings mongodb-async and mongodb
• Testing against single mongod instance for version 3.0.4, 2.6.10,
  2.4.14, 2.2.7, 2.0.9, and 1.8.5
• OS - Linux Fedora 22
  • Linux kanga 4.0.8-300.fc22.x86_64 Test issue #1
    Test issue #1 SMP Fri Jul 10
    21:04:56 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
    • Using the src distribution and then running from the src directory.
• Packaged workloads a-f.
• Adjusted threads and connection counts.

Still seeing these issues (as expected):

• 'mongodb' client throws timeout exceptions with scan workloads. #344 'mongodb' client throws timeout exceptions with scan workloads. #344 -
  'mongodb' client throws timeout exceptions with scan workloads.
  • I would really like to get 'mongodb' client throws timeout exceptions with scan workloads. #344
    'mongodb' client throws timeout exceptions with scan workloads. #344 in 0.3.0. Can
    someone review [mongodb] Update the MongoDB driver version to 3.0.3. #362
    [mongodb] Update the MongoDB driver version to 3.0.3. #362 so I can merge
    it to master and then we can get it in RC2?
    • StatusThread should wake up when the test has completed and exit. #316 StatusThread should wake up when the test has completed and exit. #316 -
      StatusThread should wake up when the test has completed and exit.
  • Already on master. Not sure it is worth the effort to cherry pick.
    • Race condition in workload D? #327 Race condition in workload D? #327 - Race
      condition in workload D?
  • No work done yet.

Question: I am building up a fairly big script for automating the testing.
Any interest in putting it in the repo somewhere?

—
Reply to this email directly or view it on GitHub
#358 (comment)
.

[allanbank]

My test script does lots of MongoDB specific things like pull the distributions from the MongoDB web site, start/stop MongoDB and clear the collections between test runs. Most of the port test analysis is me doing greps across the stdout/stderr files generated. Let me finish adding the testing on clusters and then I'll post in a gist for all of you to tear apart.

Rob

P.S. Can someone give #362 a +1? It is jump a bump of the driver version...

[gkamat]

Merged #353 into 0.3.0 and checked #362 into master.

[busbey]

I've been too overwhelmed with other responsibilities this week to make progress on testing the current RC. I think I'm going to get some time tomorrow.

What's timing look like for RC2? I want to make the Accumulo binding a little more usable and I can probably get a first cut up by tomorrow morning.

[gkamat]

I will cut a RC2 tomorrow. Other testers: if you could wrap up testing your modules over the weekend and have results by Tuesday next week, that would be really helpful so as to get out 0.3.0 before the end of next week. Thanks!

[gkamat]

Release candidate 0.3.0-RC2 is now available.

[cmccoy]

I'm having trouble compiling 0.3.0-RC2. It looks like 2d6185e is included, which is missing an import for java.util.concurrent.atomic.AtomicInteger, but a9bc84c, which resolves the problem, is not.

[cmccoy]

With a9bc84c, HBase looks good.