[Bug]: Apache Hop version 2.12 - Crashes frequently

[JatinVenkatesh]

Apache Hop version?

2.12

Java version?

22

Operating system

Windows

What happened?

I'm experiencing frequent crashes while using Apache Hop version 2.12. The application becomes unresponsive and unexpectedly shuts down during pipeline execution and metadata edits.

Additionally, when working with a large amount of data, if there is an error in any transformation, Apache Hop does not display an error log. Instead, it crashes without providing any useful debugging information.

System Details:

Apache Hop Version: 2.12
OS: 17763.7009 (Windows Server 2019 Datacenter)
Java Version: 22

Issue Priority

Priority: 3

Issue Component

Component: Hop Gui

[bamaer]

What is your java runtime? Any errors in your startup dos prompt?
If Hop Gui crashes on large amounts of data: what is "large amounts"? Have you tried increasing the -Xmx parameter in Hop Gui and hop-run.bat?

[JatinVenkatesh]

I am processing a large amount of data (over 1 million records); Apache Hop frequently crashes if there is an error in the pipeline. Instead of displaying the error log, the application becomes unresponsive and shuts down. I have already increased the -Xmx memory allocation to 12GB (12288m), but the issue persists.

[bamaer]

can you be more specific? Does this happen on one or mulitiple pipelines? Does this happen on specific transforms? Is this in Hop Gui, hop-run or both? What do your pipelines look like (e.g. files input to MS SQL), ...?

[JatinVenkatesh]

It is not specific to a particular pipeline or transformation. When there is a fault in the pipeline during development, instead of failing gracefully and displaying an error log, Apache Hop just crashes and becomes unresponsive ("Not Responding").
The pipeline transformations involved are large and complex.

The issue occurs specifically in Hop GUI.

[bamaer]

"large and complex" is again not very specific. anything you can share?
is your Java runtime one of the supported JVMs?

[bamaer]

@JatinVenkatesh there's issue that was fixed for 2.13.0 (though it was already in 2.12.0). You could try downloading a recent 2.13.0-SNAPSHOT build and see if that fixes the issue. 2.13.0 will be available in a couple of weeks at the latest, these snapshots are not official releases, but you could give it a try to see if that makes a difference.

[JatinVenkatesh]

Sounds great, thanks! I'll give it a shot.

[johnMarcD]

Hello, I have the same issues even not processing a large amount of data.
Apache hop crashes when i encounterd an error on a fields taht cannot be retrieve on a json for example.

Windows 10
Java 17 --> zulu17.48.15-ca-jdk17.0.10-win_x64
Apache Hop Version: 2.12 --> Component: Hop Gui

Regards,
John Marc Dechaud

[hansva]

Hi @johnMarcD
Same answer, could you try 2.13.0-SNAPSHOT. We think we solved a race condition that is causing these issues (mainly on Windows systems)

So any feedback if it is fixed or still present in that version would be valuable in trying to track this issue as it is a hard one to reproduce.

[johnMarcD]

Hi @johnMarcD Same answer, could you try 2.13.0-SNAPSHOT. We think we solved a race condition that is causing these issues (mainly on Windows systems)

So any feedback if it is fixed or still present in that version would be valuable in trying to track this issue as it is a hard one to reproduce.

Ok i'll try

[hansva]

@JatinVenkatesh , do you have any feedback if it solved the issue for you?