Skip to content

Handle gzip compressed jsonl files #20

@macbre

Description

@macbre
$ wc -l catalog.jsonl 
 1146540 catalog.jsonl

$ du -h catalog.jsonl 
 24M	catalog.jsonl
$ cat catalog.jsonl | gzip -c > catalog.jsonl.gz
$ du -h catalog.jsonl.gz 
 12M	catalog.jsonl.gz

$ cat catalog.jsonl.gz | gzip -d | wc -l
 1146506

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions