updating requirements

[Golovneva]

Patch description
Fix for security vulnerabilities detected in some dependency versions.

• we don't actually need bart-req.txt. Instead, added pointers in the Readme to the parent folder.
• minor changes in baseline scoring to make code more user-friendly
• updated README with more detailed instructions

Testing steps
olggol@learnfair0654:~/ParlAI$ python projects/roscoe/baselines/run.py --dataset human
2022-11-02 11:47:32.366984: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-11-02 11:47:32.521721: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:32.521760: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
2022-11-02 11:47:32.555534: E tensorflow/stream_executor/cuda/cuda_blas.cc:2981] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2022-11-02 11:47:33.755245: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:33.755381: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:33.755397: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
========================================= Done with module includes
Getting scores for datasets {'drop': './projects/roscoe/roscoe_data/generated/drop.json', 'esnli': './projects/roscoe/roscoe_data/generated/esnli.json', 'cosmos': './projects/roscoe/roscoe_data/generated/cosmos.json', 'gsm8k': './projects/roscoe/roscoe_data/generated/gsm8k.json', 'semeval': './projects/roscoe/roscoe_data/generated/semevalcommonsense.json'}
On scores ['rouge_1', 'rouge_2', 'rouge_l', 'bleurt', 'bertScore_f', 'bartScore_f', 'bartScore_cnn_f', 'prism_avg', 'ctc_relevance_summary', 'ctc_consistency_summary']
11/02/2022 11:47:57 - INFO - tensorflow - Reading checkpoint /private/home/olggol/bleurt/bleurt/test_checkpoint.
11/02/2022 11:47:57 - INFO - tensorflow - Config file found, reading.
11/02/2022 11:47:57 - INFO - tensorflow - Will load checkpoint dbleurt_tiny
11/02/2022 11:47:57 - INFO - tensorflow - Loads full paths and checks that files exists.
11/02/2022 11:47:57 - INFO - tensorflow - ... name:dbleurt_tiny
11/02/2022 11:47:57 - INFO - tensorflow - ... vocab_file:vocab.txt
11/02/2022 11:47:57 - INFO - tensorflow - ... bert_config_file:bert_config.json
11/02/2022 11:47:57 - INFO - tensorflow - ... do_lower_case:True
11/02/2022 11:47:57 - INFO - tensorflow - ... max_seq_length:512
11/02/2022 11:47:57 - INFO - tensorflow - Creating BLEURT scorer.
11/02/2022 11:47:57 - INFO - tensorflow - Creating WordPiece tokenizer.
11/02/2022 11:47:57 - INFO - tensorflow - WordPiece tokenizer instantiated.
11/02/2022 11:47:57 - INFO - tensorflow - Creating Eager Mode predictor.
11/02/2022 11:47:57 - INFO - tensorflow - Loading model.
2022-11-02 11:47:57.431311: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.431477: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.431601: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.431710: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.431820: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.431927: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.432037: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.432146: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/public/slurm/20.11.8/lib
2022-11-02 11:47:57.432162: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1934] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2022-11-02 11:47:57.432445: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
11/02/2022 11:47:57 - INFO - tensorflow - BLEURT initialized.
Some weights of the model checkpoint at roberta-large were not used when initializing RobertaModel: ['lm_head.layer_norm.weight', 'lm_head.dense.weight', 'lm_head.layer_norm.bias', 'lm_head.bias', 'lm_head.decoder.weight', 'lm_head.dense.bias']

• This IS expected if you are initializing RobertaModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
• This IS NOT expected if you are initializing RobertaModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
  11/02/2022 11:48:13 - INFO - absl - Using default tokenizer.
  Using reference types [<UseRef.NO: 'no_ref'>]
  ========================================= Done loading scorers; iterating through datasets
  Scoring dataset drop
  Data loaded, about to start scoring
  Some weights of the model checkpoint at roberta-large were not used when initializing RobertaModel: ['lm_head.layer_norm.weight', 'lm_head.dense.weight', 'lm_head.layer_norm.bias', 'lm_head.bias', 'lm_head.decoder.weight', 'lm_head.dense.bias']
• This IS expected if you are initializing RobertaModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
• This IS NOT expected if you are initializing RobertaModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
  Some weights of the model checkpoint at roberta-large were not used when initializing RobertaModel: ['lm_head.layer_norm.weight', 'lm_head.dense.weight', 'lm_head.layer_norm.bias', 'lm_head.bias', 'lm_head.decoder.weight', 'lm_head.dense.bias']
• This IS expected if you are initializing RobertaModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
• This IS NOT expected if you are initializing RobertaModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
  saving scores to ./projects/roscoe/baseline_scores/drop/rouge_1-rouge_2-rouge_l-bleurt-bertScore_f-bartScore_f-bartScore_cnn_f-prism_avg-ctc_relevance_summary-ctc_consistency_summary/drop-no_ref.csv
  Scoring dataset esnli
  Data loaded, about to start scoring
  saving scores to ./projects/roscoe/baseline_scores/esnli/rouge_1-rouge_2-rouge_l-bleurt-bertScore_f-bartScore_f-bartScore_cnn_f-prism_avg-ctc_relevance_summary-ctc_consistency_summary/esnli-no_ref.csv
  Scoring dataset cosmos
  Data loaded, about to start scoring
  Warning: Empty candidate sentence detected; setting precision to be 0.
  saving scores to ./projects/roscoe/baseline_scores/cosmos/rouge_1-rouge_2-rouge_l-bleurt-bertScore_f-bartScore_f-bartScore_cnn_f-prism_avg-ctc_relevance_summary-ctc_consistency_summary/cosmos-no_ref.csv
  Scoring dataset gsm8k
  Data loaded, about to start scoring
  saving scores to ./projects/roscoe/baseline_scores/gsm8k/rouge_1-rouge_2-rouge_l-bleurt-bertScore_f-bartScore_f-bartScore_cnn_f-prism_avg-ctc_relevance_summary-ctc_consistency_summary/gsm8k-no_ref.csv

[spencerp]

Looks reasonable! I'll let Kurt accept.

Thanks for fixing, Olga!

[klshuster]

thank you!!!