Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple copybooks null values #405

Closed
MaksymFedorchuk opened this issue Jul 23, 2021 · 2 comments · Fixed by #408
Closed

Multiple copybooks null values #405

MaksymFedorchuk opened this issue Jul 23, 2021 · 2 comments · Fixed by #408
Labels
accepted Accepted for implementation bug Something isn't working

Comments

@MaksymFedorchuk
Copy link

MaksymFedorchuk commented Jul 23, 2021

Let's say we have 2 copybooks and file with data
1st is :
01 AAA .
05 BBB PIC X.
2nd is:
01 CCC .
05 DDD PIC X.
file with data:
g
p
c
input_DF = spark.read.format("cobol")
.option("is_record_sequence", "true")
.option("is_text", "true")
.option("encoding", "ascii")
.option("copybooks", copybook_1,copybook_2)
.load(file)
then in dataframe I will have column AAA.BBB having values g,p,c for each record respectively and CCC.DDD having values null,null,null. My expectation is that both columns should have g,p,c values.

@MaksymFedorchuk MaksymFedorchuk added the bug Something isn't working label Jul 23, 2021
@yruslan
Copy link
Collaborator

yruslan commented Jul 23, 2021

This is interesting. Thanks for reporting! Will check

@yruslan yruslan added the accepted Accepted for implementation label Jul 23, 2021
@yruslan
Copy link
Collaborator

yruslan commented Jul 26, 2021

This issue is related to the fact the Cobrix currently doesn't support redefines on the top level. There is a workaround but I'm keen to fix it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
accepted Accepted for implementation bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants