Had a hard time working on this project

[abchen0516]

The instruction is insufficient and I was not able to implement this project.
And I ran into problem when running the android app

2025-12-26 13:29:32.762 10827-10871 libc++abi com.martinkorelic.ortmobile E terminating due to uncaught exception of type Ort::Exception: NULL input supplied for input past_key_values.0.key

But I have no idea how to fix that. Going to give up.

Maybe giving a step-by-step example can help me better understand this project.

[abchen0516]

I found so many issues in this work.
For example, InferenceSessionCache.GetModelMetadata always returns a null pointer so I have to set head_dim, num_kv_heads and num_layers by myself.
The uploaded codebase might not be the latest version of this work.

[abchen0516]

Anyway, I still need to thank the author for this codebase. It helped me a great deal, because there's no open-source work on on-device fine-tuning of LLMs.

[martinkorelic]

Hi, thank you for pointing that out.
It was my fault for not providing a starting tutorial and improving the overall guide experience, I tried to document as much of it myself and hopefully some of guide might help - Getting started.

I also admit that the codebase is currently somewhat underwhelming and would benefit from significant improvements in configuration and out-of-the-box usability. However, it should still fulfill the core functionality, or at least provide reusable components that others can adapt for their own projects. Of course, it is also open to modification. Thank you!