Question of behavior of storing custom configuration of autotune function

[SangbumChoi]

As I mentioned in the question I understand the function of

segment-anything-fast/segment_anything_fast/flash_4.py

Line 148 in 2ed7d1a

def _autotune(configs, function):

However, rather than using A100 GPU instances

segment-anything-fast/segment_anything_fast/flash_4.py

Line 225 in 2ed7d1a

def _load_best_configs():

it was intended to use saved_config.

instead of

segment-anything-fast/segment_anything_fast/flash_4.py

Line 237 in 2ed7d1a

return None

shouldn't be

    if not device_name.startswith('NVIDIA A100'):
        cwd = pathlib.Path.cwd()
        saved_configs = cwd / "flash_4_configs.p"
        print(f"We will try to read previously created kernel configurations from {saved_configs}.")
        print("You can disable this kernel by setting SEGMENT_ANYTHING_FAST_USE_FLASH_4=0")
    if saved_configs.is_file():
        import pickle
        with open(saved_configs, 'rb') as f:
            print(f"Loading best configs from file {saved_configs}")
            return pickle.load(f)
    return None

[cpuhrsch]

Hello @SangbumChoi,

Yes, this should store the config to the current directory if you're not using an A100. And yes, you're right, we should probably delete https://github.com/pytorch-labs/segment-anything-fast/blob/main/segment_anything_fast/flash_4.py#L237 ... I'll fix this asap! Does it work for you if you remove this line?

Thank you!

[SangbumChoi]

Removing this line and add it into end of the function works for me!

[cpuhrsch]

Removed it in #100 . Sorry for the delay. Hope this resolves your issue. Will also review your PR #89 . Please let me know if this doesn't work.