@@ -74,13 +74,13 @@ You can link against this library in your program at the following coordinates:
74
74
</tr >
75
75
<tr >
76
76
<td >
77
- <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.11<br >version: 2.7.9 </pre >
77
+ <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.11<br >version: 2.7.10 </pre >
78
78
</td >
79
79
<td >
80
- <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.12<br >version: 2.7.9 </pre >
80
+ <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.12<br >version: 2.7.10 </pre >
81
81
</td >
82
82
<td >
83
- <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.13<br >version: 2.7.9 </pre >
83
+ <pre >groupId: za.co.absa.cobrix<br >artifactId: spark-cobol_2.13<br >version: 2.7.10 </pre >
84
84
</td >
85
85
</tr >
86
86
</table >
@@ -91,17 +91,17 @@ This package can be added to Spark using the `--packages` command line option. F
91
91
92
92
### Spark compiled with Scala 2.11
93
93
```
94
- $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.7.9
94
+ $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.7.10
95
95
```
96
96
97
97
### Spark compiled with Scala 2.12
98
98
```
99
- $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.7.9
99
+ $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.7.10
100
100
```
101
101
102
102
### Spark compiled with Scala 2.13
103
103
```
104
- $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.7.9
104
+ $SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.7.10
105
105
```
106
106
107
107
## Usage
@@ -238,18 +238,18 @@ to decode various binary formats.
238
238
239
239
The jars that you need to get are:
240
240
241
- * spark-cobol_2.12-2.7.9 .jar
242
- * cobol-parser_2.12-2.7.9 .jar
241
+ * spark-cobol_2.12-2.7.10 .jar
242
+ * cobol-parser_2.12-2.7.10 .jar
243
243
* scodec-core_2.12-1.10.3.jar
244
244
* scodec-bits_2.12-1.1.4.jar
245
245
246
246
> Versions older than 2.7.1 also need ` antlr4-runtime-4.8.jar ` .
247
247
248
248
After that you can specify these jars in ` spark-shell ` command line. Here is an example:
249
249
```
250
- $ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.7.9
250
+ $ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.7.10
251
251
or
252
- $ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.7.9 .jar,cobol-parser_2.12-2.7.9 .jar,scodec-core_2.12-1.10.3.jar,scodec-bits_2.12-1.1.4.jar
252
+ $ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.7.10 .jar,cobol-parser_2.12-2.7.10 .jar,scodec-core_2.12-1.10.3.jar,scodec-bits_2.12-1.1.4.jar
253
253
254
254
Setting default log level to "WARN".
255
255
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
@@ -320,7 +320,7 @@ The fat jar will have '-bundle' suffix. You can also download pre-built bundles
320
320
321
321
Then, run ` spark-shell` or ` spark-submit` adding the fat jar as the option.
322
322
` ` ` sh
323
- $ spark-shell --jars spark-cobol_2.12_3.3-2.7.10 -SNAPSHOT-bundle.jar
323
+ $ spark-shell --jars spark-cobol_2.12_3.3-2.7.11 -SNAPSHOT-bundle.jar
324
324
` ` `
325
325
326
326
> < b> A note for building and running tests on Windows< /b>
@@ -1779,6 +1779,13 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608)
1779
1779
A: Update hadoop dll to version 3.2.2 or newer.
1780
1780
1781
1781
## Changelog
1782
+ - #### 2.7.10 released 19 December 2024.
1783
+ - [ #728 ] ( https://github.com/AbsaOSS/cobrix/issues/728 ) Added CP1145 code page (Spain and Latin America).
1784
+ - [ #731 ] ( https://github.com/AbsaOSS/cobrix/issues/731 ) Added an option to copy data type when copying metadata.
1785
+ ``` scala
1786
+ SparkUtils .copyMetadata(schemaFrom, schemaTo, copyDataType = true )
1787
+ ```
1788
+
1782
1789
- #### 2.7.9 released 8 November 2024 .
1783
1790
- [# 722 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 722 ) Added more EBCDIC code pages (mostly European ).
1784
1791
0 commit comments