Skip to content

incsteps/nft-parquet

Repository files navigation

nf-test-parquet Plugin

This plugin extends nf-test (Nextflow testing framework) with a custom Parquet file extension, allowing you to easily validate the content and structure of Apache Parquet files generated by your Nextflow pipelines.


Features

  • Simple Syntax: Integrates seamlessly with the existing nf-test file assertion syntax.
  • Parquet Content Validation: Easily assert the expected number of rows
    • Parquet Content Validation: Easily assert specific values within the Parquet file. (TODO!!)
  • Schema Checking: Validate the column names and their data types (e.g., STRING, INT, DOUBLE). (TODO!!)

Example

nextflow_workflow {

    name "Test Basic"
    script "workflows/hello.nf"

    test("Should run without failures") {
        setup(){
            new File('workflows/demo.parquet')?.delete()
        }
        then {
            assert workflow.success
            assert path(workflow.out.get(0)[0]).parquet.rowCount == 3
        }

    }
}

About

nf-test plugin for parquet files

Resources

Stars

Watchers

Forks

Packages

No packages published