BLEU Accuracy Latest Version
As a part of doing Initial evaluation I have trained the currently existing model with a different parameters and different datasets.
The resultant Blue Accuracy was found to be different for the latest version compared to the values of the initial version mentioned in the paper here.
Here is a glimpse of BLEU Accuracy value obtained for the for monument_300 data and 120000 epochs.
sh train.sh data/monument_300 120000.
The values of BLEU accuracy changed with different epochs as follows:
| Data | 12k epochs | 36k epochs | 120k epochs |
|---|---|---|---|
| Monument_300 | 75.2 | 76.8 | 77.0 |
| Monument_600 | 79.8 | 80.0 | 80.0 |
| DBNQA | 70.2 | 74.2 | 74.7 |