stack smashing detected in begin_forward when compiling directly from the repo

[mkrima]

Hello,

When I compile flashinfer directly from the repo, running begin_forward of BatchPrefillWithPagedKVCacheWrapper crashes with the error:

*** stack smashing detected ***: terminated

Running the same code with the version installed from pip works without a problem. Any suggestions what could be the problem?

Thank you.

[Qubitium]

@mkrima Please provide more env info such as os, cuda, torch version.

I believe the pip wheels are compiled va this ci code for cuda 11-8/12.1 and torch 2.1/2.2:

https://github.com/flashinfer-ai/flashinfer/blob/main/scripts/run-ci-build-wheel.sh

I would recommend not deviating too much from the min cuda 11.8 and min torch 2.1 requirements if you are doing custom compile.