Skip to content

durationProfiling and ioProfiling for spark application #91

@sohilgithub

Description

@sohilgithub

Hi Team,

  1. I am running spark application written in scala. I am not able to do durationProfiling for scala class. Can you please help with this?
  2. Regarding ioProfiling, How to do it with HDFS data read and write metrics. From IO metrics captured, I am not able to clearly understand that how much data read and write from HDFS

It will be good if anyone has any example related to how to use it with spark and HDFS
Thanks,
Sohil Raghwani

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions