v1.4.0
v1.4.0 Changelog
Major Features/Paper Releases
BlenderBot 2.0 Models, Code, Datasets
This release of ParlAI includes all the code, models, and datasets used to build BlenderBot 2.0 - please see the project page for more information, including how to access and use the models themselves (#3790, #3793, #3794, #3795, #3796, #3797, #3798, #3801, #3802, #3805, #3803, #3815, #3817)
Internet-Augmented Dialogue Generation
Build and release a crowd-sourced dataset of humans searching the internet and talking in depth about a vast array of topics; search-engine-augmented dialogue models are trained on the dataset, and are shown to be more knowledgeable than their non-search-augmented counterparts. (#3792, #3800, #3814)
Multi-Session Chat
Build and release a dataset of multi-session chats for the purpose of studying long-term open-domain conversation. Models trained on the dataset prove to perform better at recalling information from the distant past in the chats. (#3791, #3799, #3814)
Safety Benchmark Tests
With the release of Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling, ParlAI now supports running safety unit tests for conversational models. Check out the project page to see how to run the safety benchmarks. (#3767, #3768, #3769, #3784)
Convenience Functions for Agents
With a recent update to ParlAI's agent API, you can now bypass the act/observe loop for interacting with agents. (#3775)
In [1]: from parlai.core.agents import create_agent
In [2]: from parlai.core.params import ParlaiParser
In [3]: opt = ParlaiParser(True, True).parse_args(['--model_file', 'zoo:blender/blender_90M/model'])
In [4]: agent = create_agent(opt)
In [5]: agent.respond("Hi! How's it going?")
Out[5]: "it ' s going well . i ' m getting ready to go to work . how about you ?"
Minor Features
[Metrics] AUC Metrics added to parlai eval_model
(#3751)
Bug Fixes
[Crowdsourcing] Crowdsourcing Fixes concerning Left Pane Text and Model Chat (#3773, #3780, #3789, #3831)
[RAG] Fix some issues with RAG/FiD agents (#3787, #3818, #3834, #3833, #3836)
Fix JSON serialization in interactive_web.py
script (#3821)
Fix CI test issues (#3825, #3823)
Misc. README typos (#3807, #3839, #3841)
Developer Changes
Stripping before processing Conversations to allow leniency (#3772)
[ACUTE-Eval] Dev improvements to running ACUTE-Eval (#3781, #3782, #3783)
Allow self-chat in nested folders (#3785)
Allow opt presets from parlai_internal
folders (#3819)