stack overflow after new merge

[fluffydolphin]

I get a stack over flow error after the newest merge. If I revert back to this 2259555544dbf3fadf609b3883f1edda4eb67677 commit it works fine.

[philpax]

Can you provide more information about the model, architecture, platform, and parameters you're using?

[fluffydolphin]

Yea sorry should have specified. I'm using cublas on windows with a 3080 (10gb vram), using this llama model and I have 16gb of ram. My model paras are, prefer_mmap: true, context size: 2048, lora_adapters: None, use_gpu: true, gpu_layer: 1000 and my InferenceParameters are default. anything else? I'm pretty new to this so its probs me.

[LLukas22]

This seams to be caused by an internal assert in ggml which is disabled if you run your app in release mode meaning this only occurs during debugging. Probably not something we can fix but i'll look into it.