Skip to content

Commit 1d69f1a

Browse files
committed
Update README, POM files and example after the release.
1 parent e85b90d commit 1d69f1a

File tree

9 files changed

+53
-23
lines changed

9 files changed

+53
-23
lines changed

README.md

Lines changed: 35 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -72,13 +72,13 @@ You can link against this library in your program at the following coordinates:
7272
</tr>
7373
<tr>
7474
<td>
75-
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.11<br>version: 2.9.2</pre>
75+
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.11<br>version: 2.9.3</pre>
7676
</td>
7777
<td>
78-
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.12<br>version: 2.9.2</pre>
78+
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.12<br>version: 2.9.3</pre>
7979
</td>
8080
<td>
81-
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.13<br>version: 2.9.2</pre>
81+
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.13<br>version: 2.9.3</pre>
8282
</td>
8383
</tr>
8484
</table>
@@ -89,17 +89,17 @@ This package can be added to Spark using the `--packages` command line option. F
8989

9090
### Spark compiled with Scala 2.11
9191
```
92-
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.9.2
92+
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.9.3
9393
```
9494

9595
### Spark compiled with Scala 2.12
9696
```
97-
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.9.2
97+
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.9.3
9898
```
9999

100100
### Spark compiled with Scala 2.13
101101
```
102-
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.9.2
102+
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.9.3
103103
```
104104

105105
## Usage
@@ -237,18 +237,18 @@ Cobrix's `spark-cobol` data source depends on the COBOL parser that is a part of
237237

238238
The jars that you need to get are:
239239

240-
* spark-cobol_2.12-2.9.2.jar
241-
* cobol-parser_2.12-2.9.2.jar
240+
* spark-cobol_2.12-2.9.3.jar
241+
* cobol-parser_2.12-2.9.3.jar
242242

243243
> Versions older than 2.8.0 also need `scodec-core_2.12-1.10.3.jar` and `scodec-bits_2.12-1.1.4.jar`.
244244
245245
> Versions older than 2.7.1 also need `antlr4-runtime-4.8.jar`.
246246
247247
After that you can specify these jars in `spark-shell` command line. Here is an example:
248248
```
249-
$ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.9.2
249+
$ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.9.3
250250
or
251-
$ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.9.2.jar,cobol-parser_2.12-2.9.2.jar
251+
$ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.9.3.jar,cobol-parser_2.12-2.9.3.jar
252252
253253
Setting default log level to "WARN".
254254
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
@@ -316,7 +316,7 @@ The fat jar will have '-bundle' suffix. You can also download pre-built bundles
316316

317317
Then, run `spark-shell` or `spark-submit` adding the fat jar as the option.
318318
```sh
319-
$ spark-shell --jars spark-cobol_2.12_3.3-2.9.3-SNAPSHOT-bundle.jar
319+
$ spark-shell --jars spark-cobol_2.12_3.3-2.9.4-SNAPSHOT-bundle.jar
320320
```
321321

322322
> <b>A note for building and running tests on Windows</b>
@@ -1942,6 +1942,30 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608)
19421942
A: Update hadoop dll to version 3.2.2 or newer.
19431943

19441944
## Changelog
1945+
- #### 2.9.3 released 13 November 2025.
1946+
- [#792](https://github.com/AbsaOSS/cobrix/pull/792) Added EBCDIC to ASCII encoders for all single byte code pages.
1947+
```scala
1948+
df.write
1949+
.format("cobol")
1950+
.mode(SaveMode.Overwrite)
1951+
.option("copybook_contents", copybookContents)
1952+
.option("ebcdic_code_page", "cp273") // Specify the EBCDIC code page to use
1953+
.save("/some/output/path")
1954+
```
1955+
- [#795](https://github.com/AbsaOSS/cobrix/pull/795) Added the ability to process EBCDIC files in-place and convert them to VRL format.
1956+
```scala
1957+
import za.co.absa.cobrix.cobol.processor.{CobolProcessingStrategy, CobolProcessorContext, SerializableRawRecordProcessor}
1958+
import za.co.absa.cobrix.spark.cobol.SparkCobolProcessor
1959+
1960+
SparkCobolProcessor.builder
1961+
.withCopybookContents(copybook)
1962+
.withProcessingStrategy(CobolProcessingStrategy.ToVariableLength) // Convert files to RDW-based VRL format
1963+
.withRecordProcessor(...)
1964+
.load(inputPath)
1965+
.save(outputPath)
1966+
```
1967+
- [#796](https://github.com/AbsaOSS/cobrix/pull/796) Fixed redundant errors when getting the default block size for the Hadoop filesystem.
1968+
19451969
- #### 2.9.2 released 30 October 2025.
19461970
- [#790](https://github.com/AbsaOSS/cobrix/pull/790) Extended EBCDIC Encoder - added support for CP1144 (thanks by @Il-Pela).
19471971

cobol-converters/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<parent>
2323
<groupId>za.co.absa.cobrix</groupId>
2424
<artifactId>cobrix_2.12</artifactId>
25-
<version>2.9.3-SNAPSHOT</version>
25+
<version>2.9.4-SNAPSHOT</version>
2626
<relativePath>../pom.xml</relativePath>
2727
</parent>
2828

cobol-parser/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<parent>
2323
<groupId>za.co.absa.cobrix</groupId>
2424
<artifactId>cobrix_2.12</artifactId>
25-
<version>2.9.3-SNAPSHOT</version>
25+
<version>2.9.4-SNAPSHOT</version>
2626
<relativePath>../pom.xml</relativePath>
2727
</parent>
2828

examples/examples-collection/pom.xml

Lines changed: 11 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -27,11 +27,12 @@
2727

2828
<properties>
2929
<encoding>UTF-8</encoding>
30-
<scala.version>2.11.12</scala.version>
31-
<scala.compat.version>2.11</scala.compat.version>
32-
<spark.version>2.4.8</spark.version>
30+
<scala.version>2.12.20</scala.version>
31+
<scala.compat.version>2.12</scala.compat.version>
32+
<spark.version>3.5.7</spark.version>
3333
<specs.version>2.4.16</specs.version>
34-
<spark.cobol.version>2.9.2</spark.cobol.version>
34+
<spark.cobol.version>2.9.3</spark.cobol.version>
35+
<scodec_core.version>1.11.10</scodec_core.version>
3536
</properties>
3637

3738
<dependencies>
@@ -75,7 +76,12 @@
7576
<artifactId>spark-cobol_${scala.compat.version}</artifactId>
7677
<version>${spark.cobol.version}</version>
7778
</dependency>
78-
</dependencies>
79+
<dependency>
80+
<groupId>org.scodec</groupId>
81+
<artifactId>scodec-core_${scala.compat.version}</artifactId>
82+
<version>${scodec_core.version}</version>
83+
</dependency>
84+
</dependencies>
7985

8086
<build>
8187
<sourceDirectory>src/main/scala</sourceDirectory>

examples/examples-collection/src/main/scala/com/example/spark/cobol/examples/apps/StreamingExample.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ package com.example.spark.cobol.examples.apps
1818

1919
import org.apache.spark.sql.SparkSession
2020
import org.apache.spark.streaming.{Seconds, StreamingContext}
21-
import za.co.absa.cobrix.spark.cobol.parameters.CobolParametersParser._
21+
import za.co.absa.cobrix.cobol.reader.parameters.CobolParametersParser._
2222

2323
object StreamingExample {
2424

examples/spark-cobol-app/build.sbt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ ThisBuild / version := "0.1.0-SNAPSHOT"
2020
ThisBuild / scalaVersion := "2.12.20"
2121

2222
val sparkVersion = "3.5.7"
23-
val sparkCobolVersion = "2.9.2"
23+
val sparkCobolVersion = "2.9.3"
2424
val scalatestVersion = "3.2.19"
2525

2626
ThisBuild / libraryDependencies ++= Seq(

examples/spark-cobol-app/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@
3131
<scala.compat.version>2.12</scala.compat.version>
3232
<scalatest.version>3.2.19</scalatest.version>
3333
<spark.version>3.5.7</spark.version>
34-
<spark.cobol.version>2.9.2</spark.cobol.version>
34+
<spark.cobol.version>2.9.3</spark.cobol.version>
3535
</properties>
3636

3737
<dependencies>

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<groupId>za.co.absa.cobrix</groupId>
2323
<artifactId>cobrix_2.12</artifactId>
2424

25-
<version>2.9.3-SNAPSHOT</version>
25+
<version>2.9.4-SNAPSHOT</version>
2626

2727
<packaging>pom</packaging>
2828

spark-cobol/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<parent>
2323
<groupId>za.co.absa.cobrix</groupId>
2424
<artifactId>cobrix_2.12</artifactId>
25-
<version>2.9.3-SNAPSHOT</version>
25+
<version>2.9.4-SNAPSHOT</version>
2626
<relativePath>../pom.xml</relativePath>
2727
</parent>
2828

0 commit comments

Comments
 (0)