Skip to content

Unable to consume custom java objects in spark streaming #704

@ADDale

Description

@ADDale

I have a simple java producer which is pushing message to kafka. I can read message using simple java consumer but not using spark streaming. Using spark streaming all messages are coming as null.

I have attached the code snippet.
I am passing the custom deserializer class in kafka properties.
Please confirm if we need to pass it in kafkautils.createdirect stream method as well? Somehow the method is throwing invalid argument types if I try to pass as per javdoc documents.

Please help as I am new to Spark.

img_20190122_200511

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions