A Multi-Domain Benchmark for Personalized Search Evaluation Baselines

Baselines from the paper A Multi-Domain Benchmark for Personalized Search Evaluation.

The following guide assumes you are using a Linux distro, such as Ubuntu.

Step 1 - Download the datasets

Install wget:

sudo apt install wget

Install 7-zip:

sudo apt install p7zip-full p7zip-rar

Download the benchmark datasets with the provided script.
It will download, decompress, and move the datasets in the appropriate folders.

sh download.sh

If you want to get rid of the original archives exectute the following command:

rm -rf ./tmp

Step 2 - Create and activate the CONDA env

conda env create -f env.yml

conda activate amdbfpse-baselines

Step 3 - Clone the language model locally

Install Git LFS:

sudo apt-get install git-lfs
git lfs install

Clone the model:

git clone https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2

Step 4 - Train & Evaluate

sh run.sh