Skip to content

ai4society/causal-sas-rating

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

causal-sas-rating

Steps to run the original rating algorithm

Step-0 (prerequisites): Run 'conda create --name --file requirements.txt' to install all the required prerequisites on your windows system.

Step-1 (Data Generation): Each of the files (gen_groupX.py) in 'code/data-generation' directory generates different data groups for the experiments. The 'composite.py' file in the same location generates data for the experiments in which we used composite data (race + gender).

Step-2 (Sentiment Analysis): In 'code/', run 'eval_groupX.py' files to get the results from each of the SASs for different data groups.

Step-3 (Rating of SASs): In 'code/rating/', run the rating.py file to get the fine-grained and overall ratings for each of the SASs.

Steps to run the rating algorithm on real-world datasets and evaluate them.

Step-0 (prerequisites): Run 'conda create --name --file requirements.txt' to install all the required prerequisites on your windows system.

Step-1 (Pre-processed real-world datasets): We have 2 datasets: ALLURE chatbot conversations dataset and Unibot conversations dataset. (a) ALLURE dataset is in 'data/real-world/allure/final'. The file 'final.csv' has multiple consecutive utterances of the chatbot in multiple lines but 'final_expt.csv' file has multiple consecutive utterances of the chatbot in the same line (this is much better for experiments). (b) Unibot dataset is in 'data/real-world/unibot/final'. The file 'final.csv' has multiple consecutive utterances of the chatbot in multiple lines but 'final_expt.csv' file has multiple consecutive utterances of the chatbot in the same line (again, this is much better for experiments).

Step-2 (Sentiment Analysis): In 'code/', run 'eval_data.py' files to get the results from each of the SASs for both the datasets: ALLURE and Unibot.

Step - 3: (optional) In 'code/rating/', run 't_test_data.py' to get the t-test values and it also tells whether the null hypothesis is accepted or rejected in each case. These results can be found in 'code/rating/calc_results/real-world/' after running the file.

Step-4 (Rating of SASs): In 'code/rating/', run the rating.py file to get the fine-grained and overall ratings for each of the SASs based on the real-world data.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published