|
| 1 | +[appendix] |
| 2 | +[[release-notes]] |
| 3 | += Release Notes |
| 4 | + |
| 5 | +[float] |
| 6 | +[[change-list]] |
| 7 | +== Change List |
| 8 | + |
| 9 | +[float] |
| 10 | +[[eshadoop-5.0.0]] |
| 11 | +=== 5.0.0 |
| 12 | +October 26, 2016 |
| 13 | + |
| 14 | +[float] |
| 15 | +[[breaking-5.0.0]] |
| 16 | +==== Breaking Changes |
| 17 | +* Update to compat with Storm 1.x.x |
| 18 | +http://github.com/elastic/elasticsearch-hadoop/issues/769[#769] |
| 19 | +* Why does EsBolt still use the old JAR |
| 20 | +http://github.com/elastic/elasticsearch-hadoop/issues/754[#754] |
| 21 | +* Drop HDFS repository |
| 22 | +http://github.com/elastic/elasticsearch-hadoop/issues/741[#741] |
| 23 | +* Drop support for Spark 1.0-1.2 |
| 24 | +http://github.com/elastic/elasticsearch-hadoop/issues/740[#740] |
| 25 | +* Remove legacy Hive version |
| 26 | +http://github.com/elastic/elasticsearch-hadoop/issues/739[#739] |
| 27 | + |
| 28 | +[float] |
| 29 | +[[new-5.0.0]] |
| 30 | +==== New Features |
| 31 | +Mapping:: |
| 32 | +* Add support for 16-bit/half floats in ES 5.x |
| 33 | +http://github.com/elastic/elasticsearch-hadoop/issues/800[#800] |
| 34 | +* New ES type scaled_float |
| 35 | +http://github.com/elastic/elasticsearch-hadoop/issues/822[#822] |
| 36 | +MR:: |
| 37 | +* Integrating with ES ingest node pipeline |
| 38 | +http://github.com/elastic/elasticsearch-hadoop/issues/806[#806] |
| 39 | +New Slice API:: |
| 40 | +* Add the ability to create IndexPartition based on the desired |
| 41 | +number of documents per split |
| 42 | +http://github.com/elastic/elasticsearch-hadoop/issues/812[#812] |
| 43 | +(issue: http://github.com/elastic/elasticsearch-hadoop/issues/778[#778]) |
| 44 | +Spark:: |
| 45 | +* Support for Spark 2.0 / Datasets |
| 46 | +http://github.com/elastic/elasticsearch-hadoop/issues/647[#647] |
| 47 | +* Provided dedicated support for Spark 1.3-1.6 DStreams |
| 48 | +http://github.com/elastic/elasticsearch-hadoop/issues/[#802] |
| 49 | + |
| 50 | +[float] |
| 51 | +[[enhancements-5.0.0]] |
| 52 | +==== Enhancements |
| 53 | +Build:: |
| 54 | +* 2.3.1 release notes list many bugs as fixed without commits |
| 55 | +http://github.com/elastic/elasticsearch-hadoop/issues/770[#770] |
| 56 | +REST:: |
| 57 | +* Expire Unused Pooled Transports in Spark Streaming |
| 58 | +http://github.com/elastic/elasticsearch-hadoop/issues/849[#849] |
| 59 | +* Validate field exclusion settings when EsSpark.saveJsonToEs() |
| 60 | +is executed |
| 61 | +http://github.com/elastic/elasticsearch-hadoop/issues/782[#782] |
| 62 | +* Review the error messages in ES 5.x and properly parse them |
| 63 | +http://github.com/elastic/elasticsearch-hadoop/issues/779[#779] |
| 64 | +* Align extended Boolean parsing with Elasticsearch |
| 65 | +http://github.com/elastic/elasticsearch-hadoop/issues/798[#798] |
| 66 | +* Fields replacement in es.update.script.params fails for objects |
| 67 | +http://github.com/elastic/elasticsearch-hadoop/issues/760[#760] |
| 68 | +* Replace/Ignore DOT character in field names before inserting |
| 69 | +into Elastic Search |
| 70 | +http://github.com/elastic/elasticsearch-hadoop/issues/758[#758] |
| 71 | +Spark:: |
| 72 | +* Improve ElasticsearchRelation extensibility |
| 73 | +http://github.com/elastic/elasticsearch-hadoop/issues/829[#829] |
| 74 | +* Explicitly specify buildScan return type |
| 75 | +http://github.com/elastic/elasticsearch-hadoop/issues/826[#826] |
| 76 | +* Upgrade to Spark 1.6.2 |
| 77 | +http://github.com/elastic/elasticsearch-hadoop/issues/797[#797] |
| 78 | +* Fix example for spark. |
| 79 | +http://github.com/elastic/elasticsearch-hadoop/issues/768[#768] |
| 80 | +(issue: http://github.com/elastic/elasticsearch-hadoop/issues/767[#767]) |
| 81 | + |
| 82 | +[float] |
| 83 | +[[bugs-5.0.0]] |
| 84 | +==== Bug Fixes |
| 85 | +Build:: |
| 86 | +* Repository HDFS still referred in the build system |
| 87 | +http://github.com/elastic/elasticsearch-hadoop/issues/775[#775] |
| 88 | +* Spark 1.2 artifacts are still referenced |
| 89 | +http://github.com/elastic/elasticsearch-hadoop/issues/774[#774] |
| 90 | +Hive:: |
| 91 | +* Date type not properly inserted into ES |
| 92 | +http://github.com/elastic/elasticsearch-hadoop/issues/757[#757] |
| 93 | +MR:: |
| 94 | +* Reading boolean 0/1 values from ES into Spark does not work |
| 95 | +(although false/true is ok) |
| 96 | +http://github.com/elastic/elasticsearch-hadoop/issues/795[#795] |
| 97 | +* Elasticsearch Mapreduce write "es.mapping.exclude" not working |
| 98 | +http://github.com/elastic/elasticsearch-hadoop/issues/752[#752] |
| 99 | +MR and Spark:: |
| 100 | +* Restore data locality preference for hadoop and spark |
| 101 | +http://github.com/elastic/elasticsearch-hadoop/issues/819[#819] |
| 102 | +(issue: http://github.com/elastic/elasticsearch-hadoop/issues/814[#814]) |
| 103 | +NetworkClient:: |
| 104 | +* Node [127.0.0.1:9200] failed (Read timed out); no other nodes |
| 105 | +left - aborting... |
| 106 | +http://github.com/elastic/elasticsearch-hadoop/issues/753[#753] |
| 107 | +* Invalid target URI POST@null/pharmadata/test/_search |
| 108 | +http://github.com/elastic/elasticsearch-hadoop/issues/748[#748] |
| 109 | +Pig:: |
| 110 | +* Pig maps can have values of different types |
| 111 | +http://github.com/elastic/elasticsearch-hadoop/issues/777[#777] |
| 112 | +Rest:: |
| 113 | +http://github.com/elastic/elasticsearch-hadoop/issues/817[#817] |
| 114 | +* Shard size estimations for Slice API do not target shards |
| 115 | +http://github.com/elastic/elasticsearch-hadoop/issues/843[#843] |
| 116 | +* Elasticsearch-spark connector failing to save data with an Illegal |
| 117 | +Argument Exception : "No class name given" |
| 118 | +http://github.com/elastic/elasticsearch-hadoop/issues/837[#837] |
| 119 | +* Spark Datasource: Non empty BINARY fields are always considered empty |
| 120 | +http://github.com/elastic/elasticsearch-hadoop/issues/835[#835] |
| 121 | +* Fix memory leak caused by re-wrapping DelegatedProtocol |
| 122 | +http://github.com/elastic/elasticsearch-hadoop/issues/823[#823] |
| 123 | +* Fixed parsing of ES mapping with OBJECT field named 'properties' |
| 124 | +http://github.com/elastic/elasticsearch-hadoop/issues/810[#810] |
| 125 | +(issue: http://github.com/elastic/elasticsearch-hadoop/issues/809[#809]) |
| 126 | +* Not all errors in ES are reported when writing |
| 127 | +http://github.com/elastic/elasticsearch-hadoop/issues/720[#720] |
| 128 | +* es.index.auto.create setting doesn't work as expected |
| 129 | +http://github.com/elastic/elasticsearch-hadoop/issues/793[#793] |
| 130 | +* Parsing error messages can cause a NPE |
| 131 | +http://github.com/elastic/elasticsearch-hadoop/issues/776[#776] |
| 132 | +Spark:: |
| 133 | +* Dropping a whole column of a DataFrame while indexing the DF into ES |
| 134 | +http://github.com/elastic/elasticsearch-hadoop/issues/841[#841] |
| 135 | +* Fix: Non empty BINARY fields are considered empty |
| 136 | +http://github.com/elastic/elasticsearch-hadoop/issues/834[#834] |
| 137 | +* saveToEs saves fields with NULL values |
| 138 | +http://github.com/elastic/elasticsearch-hadoop/issues/792[#792] |
| 139 | +* Failed to write data back to ES by using Spark DataFrame save() API !! |
| 140 | +http://github.com/elastic/elasticsearch-hadoop/issues/749[#749] |
| 141 | +* Pushdown option not working as expected with Spark data frames |
| 142 | +http://github.com/elastic/elasticsearch-hadoop/issues/734[#734] |
| 143 | +URLDecoder:: |
| 144 | +* Illegal hex characters in escape (%) pattern - For input string: " S" |
| 145 | +http://github.com/elastic/elasticsearch-hadoop/issues/747[#747] |
| 146 | +Yarn:: |
| 147 | +* Authenticate with a local keytab in the YARN Application Master |
| 148 | +http://github.com/elastic/elasticsearch-hadoop/issues/807[#807] |
| 149 | + |
| 150 | +[float] |
| 151 | +[[docs-5.0.0]] |
| 152 | +==== Documentation |
| 153 | +* es.read.field.as.array.include NOT es.field.read.as.array.include |
| 154 | +http://github.com/elastic/elasticsearch-hadoop/issues/860[#860] |
| 155 | +* Corrected property name |
| 156 | +http://github.com/elastic/elasticsearch-hadoop/issues/805[#805] |
| 157 | +* Repository HDFS doc improvements |
| 158 | +http://github.com/elastic/elasticsearch-hadoop/issues/781[#781] |
| 159 | +* Snapshot Creation Exception |
| 160 | +http://github.com/elastic/elasticsearch-hadoop/issues/813[#813] |
| 161 | +* Corrected link to 'ADD' command |
| 162 | +http://github.com/elastic/elasticsearch-hadoop/issues/788[#788] |
| 163 | +* Update spark.adoc |
| 164 | +http://github.com/elastic/elasticsearch-hadoop/issues/785[#785] |
| 165 | +* Update cloud.adoc |
| 166 | +http://github.com/elastic/elasticsearch-hadoop/issues/773[#773] |
| 167 | +* Update configuration.adoc |
| 168 | +http://github.com/elastic/elasticsearch-hadoop/issues/772[#772] |
| 169 | +* Tests fail in build |
| 170 | +http://github.com/elastic/elasticsearch-hadoop/issues/755[#755] |
| 171 | + |
| 172 | +[float] |
| 173 | +[[nonissue-5.0.0]] |
| 174 | +==== Non-issue |
| 175 | +Hive:: |
| 176 | +* Error Loading Data |
| 177 | +http://github.com/elastic/elasticsearch-hadoop/issues/839[#839] |
| 178 | +* EsHadoopIllegalArgumentException: Cannot detect ES version |
| 179 | +http://github.com/elastic/elasticsearch-hadoop/issues/794[#794] |
| 180 | +* ES-Hive throwing exception while reading for bulk no. of columns |
| 181 | +http://github.com/elastic/elasticsearch-hadoop/issues/790[#790] |
| 182 | +* Create a external table with 'location' command success while |
| 183 | +elasticsearch-hadoop do not support 'location' function |
| 184 | +http://github.com/elastic/elasticsearch-hadoop/issues/786[#786] |
| 185 | +Pig:: |
| 186 | +* Store Map as object with Pig in Elasticsearch |
| 187 | +http://github.com/elastic/elasticsearch-hadoop/issues/848[#848] |
| 188 | +* Get fields with documents in Elasticsearch |
| 189 | +http://github.com/elastic/elasticsearch-hadoop/issues/825[#825] |
| 190 | +* Failure while using EsStorage twice on a single Pig script to store a Parent Child relation |
| 191 | +http://github.com/elastic/elasticsearch-hadoop/issues/756[#756] |
| 192 | +* Store Tuple as object with Pig in Elasticsearch |
| 193 | +http://github.com/elastic/elasticsearch-hadoop/issues/746[#746] |
| 194 | +REST:: |
| 195 | +* Some way to query "total" field from result set? |
| 196 | +http://github.com/elastic/elasticsearch-hadoop/issues/830[#830] |
| 197 | +* PROBLEM: Failed to write data back to ES by using Spark DataFrame save() API !! |
| 198 | +http://github.com/elastic/elasticsearch-hadoop/issues/836[#836] |
| 199 | +* Elasticsearch : Cannot detect ES version |
| 200 | +http://github.com/elastic/elasticsearch-hadoop/issues/791[#791] |
| 201 | +Spark:: |
| 202 | +* Class Not Found Exception |
| 203 | +http://github.com/elastic/elasticsearch-hadoop/issues/863[#863] |
| 204 | +* java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class |
| 205 | +http://github.com/elastic/elasticsearch-hadoop/issues/862[#862] |
| 206 | +* Array types not supported in automatic mapping |
| 207 | +http://github.com/elastic/elasticsearch-hadoop/issues/847[#847] |
| 208 | +* Connection error with Elasticsearch 2.4.0 |
| 209 | +http://github.com/elastic/elasticsearch-hadoop/issues/846[#846] |
| 210 | +* Handling decimal type in dataset |
| 211 | +http://github.com/elastic/elasticsearch-hadoop/issues/842[#842] |
| 212 | +* Fix import of JavaEsSparkSQL |
| 213 | +http://github.com/elastic/elasticsearch-hadoop/issues/840[#840] |
| 214 | +* Got exception when I tried to invoke _mtermvector |
| 215 | +http://github.com/elastic/elasticsearch-hadoop/issues/796[#796] |
| 216 | +* ES-Hadoop on Spark 2.0 |
| 217 | +http://github.com/elastic/elasticsearch-hadoop/issues/759[#759] |
| 218 | +* elasticsearch-hadoop exception about mapping |
| 219 | +http://github.com/elastic/elasticsearch-hadoop/issues/766[#766] |
| 220 | +* Parameter ES_MAPPING_TIMESTAMP is not working using saveToEs |
| 221 | +http://github.com/elastic/elasticsearch-hadoop/issues/765[#765] |
0 commit comments