CHANGELOG.md

Changelog

2.0.0-alpha1 (2021-07-19)

Note: This alpha release is a work-in-progress. For the latest stable version of java-bigtable-hbase, please refer to version 1.23.0.

This is the first alpha release of Bigtable HBase 2.0.0. This release switches the core Bigtable layer to the java-bigtable library. This is primarily an implementation detail change. Currently, users can opt out of this via the BIGTABLE_USE_GCJ_CLIENT configuration option to use the existing bigtable-client-core layer. This option is primarily intended for testing during the alpha period. Example:

Configuration configuration = new Configuration(false);
...
configuration.setBoolean(BigtableOptionsFactory.BIGTABLE_USE_GCJ_CLIENT, false);

In future releases, the configuration option to toggle the use of client core on or off will be removed, and the library will no longer use bigtable-client-core to connect to the Bigtable API.

Other notable changes include:

• Deadlines are enabled by default (google.bigtable.rpc.use.timeouts)
• Retry settings have been tweaked (timeouts, exponential backoff)
• Error handling has been improved to always be a subclass of IOException and to include the caller’s stack trace for asynchronous calls
• Dependencies have been improved (mapreduce byo-hadoop, etc)

We look forward to hearing your feedback! Please let us know any comments or issues in our issue tracker.

Complete release notes below:

Features

• Ability to import HBase Snapshot data into Cloud Bigtable using Dataflow (#2755) (5b3ab2b)
• add gcf-owl-bot[bot] to ignoreAuthors (#2974) (96d43d2)
• Add a new pipeline to validate data imported from HBase (#2828) (fa07a90)
• add client-core metrics to veneer (#2978) (68c2773)
• Add keepalive in grpc channelbuilder (#2682) (2a732d2)
• add option to configure tracing cookie (#3021) (228a60e)
• adding client wrapper interfaces (#2406) (1ad48d9)
• adding custom User agent for dataflow jobs. (#2952) (d9843b8)
• enable directpath (#2271) (d384208)
• extend RowCell to include labels field (#2397) (80a85fe)
• implement veneer metrics part 1 - implement MetricsApiTracerAdapter (#2631) (bf8a7e3)
• improve handling when crossing async and sync boundaries (#2976) (0a63256)
• managed backups implementation (#2643) (f7afd50)
• mapreduce snapshot import to cloud bigtable (#2851) (d8ad7dd)
• minimize bloat in mapreduce module (#2895) (0cd7896)
• Schema translator for HBase. (#2901) (da9e036)
• tune default settings to align with java-bigtable (#2439) (4aedcd9)
• use veneer by default (#2980) (aee2f4e)

Bug Fixes

• 1543 One line batch settings (#1950) (2bc252a)
• 1770 Fuzzy keys with integer values above 127 match no rows (#1923) (9802eda)
• 2004 - NPE when calling Watchdog.stop() twice (#2005) (b638828)
• 2788 Using bom files to avoid possible version discrepancy among grpc (#2789) (6e77eac)
• 691 SingleColumnValueFilter NOT_EQUALS empty value not working (#1946) (c5d5c7e)
• add bigtable-hbase version to user agent (#3033) (7c45f2c)
• add extraFiles to 1x branch (#3160) (f6c7824)
• beam warning about accessing template values (#2400) (443a40c), closes #2389
• bigtable-hbase-2.x-hadoop incompatible with hbase-shaded-client 2.x (#2773) (1792c60)
• bigtable-hbase-tools version (#2920) (551b49f)
• BigtableSession is never closed by Reader causing "ManagedChanne… (#2782) (5340db5)
• build: update return codes for build scripts (#2583) (96e8d8e)
• close BigtableInstanceAdminClient and batcher (#2963) (77d5b21)
• conversion from hbase to veneer settings (#2912) (5c12fd8)
• deadlock scenario from BulkReadVeneerApi and fixed flaky tests (#2484) (e4cd4ef)
• dont use channel pools for admin api for veneer (#2917) (d9d54c3)
• enabling the integration test on the correct kokoro target (#2911) (2c5492d)
• fix race condition in auto flush (#2772) (ff8e489)
• fix retry when rowCount == rowsLimit (#2931) (c5da82f)
• hbase 2x shell (bigtable2.0) (#2906) (eb9e756)
• includes fixes for the gap between HBase and this client (#2267) (51f0617)
• keep only failed actions in List (#3020) (aac0522)
• logs: type aligned to in log statement (#2536) (76c41ca)
• manifests in executable jars (#2896) (9736b06)
• max mutation comparison to include 100k (#3008) (5434e5e)
• multithreaded batch operations (#2930) (8c1eb6c)
• qualifier filter comparators (#2684) (#2688) (f57affc)
• race condition where a retry triggers a full table scan (#2758) (8d3bd4d)
• ReadRows not counting the rpc as the first attempt (#2568) (c748f23)
• Refactoring methods in TemplateUtils. Using CamelCasing for names. (#2967) (93a1c2d)
• remove duplicate classic setting parsing (#2918) (b6b44a7)
• remove duplicated cell when interleave filter is applied (#2491) (2915bfd)
• retry rst_stream (#3002) (ace17b7)
• Set a 20 mins timeout for bulk mutations for HBase over Veneer. (#3052) (10a6ce8)
• temporarily disable reporting to unblock releases (#2620) (9611a91)
• the options of CreateTableHelper to be public (#2366) (072ccc9)
• to fix deleteRowRangeByPrefix for integer values above 127 (#2511) (1ae8c03)
• update readRowsAsync to use RetryingReadRowsOperation (#2738) (#2759) (3c4f3b2)
• update url in pom file (#2279) (2e2f638)
• updated assertions and scan for firstKeyOnlyFilter test (#2483) (a2cbe7a)
• use binary search in getRegionLocation (#3044) (48951ab)
• use random with permanent seed (#2722) (a882f9a)
• validation of TimeRange (#1890) (7f404e4)
• veneer adapter batching (#3053) (6768357)
• ZeroCopyByteStringUtil can return incorrect results in some cases (#2628) (1667a40)

Reverts

• Revert "fix: BigtableSession is never closed by Reader causing "ManagedChanne… (#2782)" (#2873) (3568c27)

Miscellaneous Chores

• bump release please to 2.0.0-alpha-1 (#2927) (7b0edcd)
• make release please version 2.0.0-alpha1 (#3155) (890b679)

Documentation

• add javadoc for classes marked as InternalApi (#2350) (c86d7d2)
• Add README for HBase Tools and Beam import/export and validator pipelines (#2949) (e05b548)
• automatically update version numbers with release (#2476) (2ad78e9)
• Fix broken links for HBase Migration tools (#3097) (83238e7)
• fix link to 1x branch in readme (#3161) (b4e1757)
• fix readme title for Bigtable HBase tools (#3013) (de5970d)
• update CONTRIBUTING.md to include code formatting (#534) (#2542) (1c92056)
• Update CONTRIBUTING.md with integration test instructions (#2560) (9b1a6e5)
• update readme to align more with standard templates (#3162) (1721ae1)
• Updated readme to redirect user to veneer client (#2288) (aa9ac47)

Dependencies

• add maven-enforcer-plugin (#2401) (1ef4b9c)
• align bigtable-hbase-1.x-mapreduce to use the same hadoop version as other 1.x modules (#2455) (60a5f82)
• fix dependency build (#2305) (e92fd2e)
• fix hbaseLocalMiniClusterTestH2 tests (#2308) (b7f48f5)
• fix undeclared used dependencies (#2419) (d9b109f)
• fix: add log4j12 to mincluster h2 tests (#2450) (bf5ef7c)
• manually update dependency org.mockito:mockito-core to v3.3.0 (#2392) (918340d)
• Update beam version to 2.24.0 (#2775) (82ca972)
• update bigtable veneer to 1.15.0 (#2630) (9034822)
• update bigtable veneer version to 1.12.2 (#2526) (c422b07)
• update bigtable.version to v1.11.0 (#2395) (50de5d7)
• update bigtable.version to v1.13.0 (#2540) (2167870)
• update bigtable.version to v1.16.1 (#2646) (a48a456)
• update bigtable.version to v1.16.2 (#2654) (ad48fb1)
• update bigtable.version to v1.17.0 (#2668) (15a2f39)
• update bigtable.version to v1.17.1 (#2674) (7ee5f0a)
• update bigtable.version to v1.17.3 (#2695) (75cf25c)
• update bigtable.version to v1.18.0 (#2700) (48a60f6)
• update bigtable.version to v1.19.0 (#2721) (b813bd4)
• update bigtable.version to v1.19.1 (#2763) (b5d9ec2)
• update bigtable.version to v1.19.2 (#2767) (792f7f5)
• update bigtable.version to v1.20.0 (#2829) (098d370)
• update bigtable.version to v1.20.1 (#2843) (c4126da)
• update bigtable.version to v1.21.0 (#2868) (8fbf496)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.10.2 (#2340) (437557f)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.10.3 (#2394) (95834d1)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.11.0 (#2505) (dd8856f)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.11.1 (#2557) (65373ce)
• update dependency com.fasterxml.jackson.core:jackson-databind to v2.11.2 (#2603) (046affa)
• update dependency com.google.auto.value:auto-value to v1.7.2 (#2513) (409b309)
• update dependency com.google.auto.value:auto-value to v1.7.3 (#2549) (1161524)
• update dependency com.google.auto.value:auto-value to v1.7.4 (#2571) (4dd36a7)
• update dependency com.google.auto.value:auto-value-annotations to v1.7.2 (#2532) (818f435)
• update dependency com.google.auto.value:auto-value-annotations to v1.7.3 (#2550) (218bcbe)
• update dependency com.google.auto.value:auto-value-annotations to v1.7.4 (#2572) (bf79eaf)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.129.0 (#2832) (4a6b1f4)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.129.1 (#2844) (abcdcc3)
• update dependency com.google.cloud:google-cloud-bigtable-emulator to v0.130.0 (#2869) (207be9b)
• update dependency com.google.guava:guava to v30 (#2666) (8289a54)
• update dependency com.google.guava:guava to v30.1-android (#2761) (07f263e)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.35.0 (#2507) (73f5c5e)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.36.0 (#2559) (5567896)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.37.0 (#2652) (64ea0e1)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.38.0 (#2675) (95cde54)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.38.1 (#2802) (442e279)
• update dependency com.google.http-client:google-http-client-jackson2 to v1.39.0 (#2848) (6da8736)
• update dependency commons-codec:commons-codec to v1.14 (#2339) (41a3d98)
• update dependency commons-codec:commons-codec to v1.15 (#2636) (e604c3e)
• update dependency io.grpc:grpc-bom to v1.26.0 (6c616c9)
• update dependency junit:junit to v4.13 (#2335) (92537f0)
• update dependency org.apache.commons:commons-compress to v1.20 (#2376) (65ac9cd)
• update dependency org.codehaus.plexus:plexus-utils to v3.3.0 (#2860) (c6bf393)
• update dependency org.mockito:mockito-core to v3.2.4 (#2290) (2e2e4f9)
• update dependency org.mockito:mockito-core to v3.3.3 (#2414) (e82bc10)
• update dependency org.mockito:mockito-core to v3.4.0 (#2578) (d6a351e)
• update dependency org.mockito:mockito-core to v3.4.6 (#2593) (6fe4fc1)
• update dependency org.mockito:mockito-core to v3.5.13 (#2638) (47741d7)
• update dependency org.mockito:mockito-core to v3.5.15 (#2660) (500eed1)
• update dependency org.mockito:mockito-core to v3.5.7 (#2609) (7c6c3c8)
• update dependency org.slf4j:slf4j-api to v1.7.30 (#2309) (8182b5d)
• update hbase1-hadoop.version to v2.10.1 (#2575) (486589b)
• update jmh.version to v1.22 (#2348) (cdec57f)
• update jmh.version to v1.23 (#2370) (4959c8f)
• update jmh.version to v1.27 (#2739) (b6bf3c7)
• update jmh.version to v1.28 (#2853) (ad7a80b)
• update shared config to 0.9.2 (#2635) (fcdde22)
• upgrade veneer to 1.27.2 (#3056) (5c63d34)
• upgrade veneer to 1.27.3 (#3164) (053398c)