The experimental results cannot be replicated. script do not work!

[liveck]

when calling run_job.bash

majority/majority_exp.py", line 294, in run_experiment
    _, queries, _, keys, Q, K, _ = model(classes)
ValueError: not enough values to unpack (expected 7, got 3)

it seams that the model returns logits, qQK, keys.

how can i replicated the experimental results ?

[shakedbr]

Hi @liveck, I committed a fix. Let me know if there are any other problems.

[liveck]

tensor can not be dump as json.
so, i modified the code as below.

    _, queries, keys = model(classes)
    queries = queries.tolist()
    keys = keys.tolist()
    if hidden_dim == 3:
        wandb.run.summary['queries'] = queries
        wandb.run.summary['keys'] = keys
        with open(f'{layer_norm}_keys_queries.json', 'w') as f:
            json.dump({'keys': keys, 'queries': queries}, f)