Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

v1.4.0

Compare
Choose a tag to compare
@klshuster klshuster released this 22 Jul 19:19
60f8235

v1.4.0 Changelog

Major Features/Paper Releases

BlenderBot 2.0 Models, Code, Datasets

This release of ParlAI includes all the code, models, and datasets used to build BlenderBot 2.0 - please see the project page for more information, including how to access and use the models themselves (#3790, #3793, #3794, #3795, #3796, #3797, #3798, #3801, #3802, #3805, #3803, #3815, #3817)

Internet-Augmented Dialogue Generation

Build and release a crowd-sourced dataset of humans searching the internet and talking in depth about a vast array of topics; search-engine-augmented dialogue models are trained on the dataset, and are shown to be more knowledgeable than their non-search-augmented counterparts. (#3792, #3800, #3814)

Multi-Session Chat

Build and release a dataset of multi-session chats for the purpose of studying long-term open-domain conversation. Models trained on the dataset prove to perform better at recalling information from the distant past in the chats. (#3791, #3799, #3814)

Safety Benchmark Tests

With the release of Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling, ParlAI now supports running safety unit tests for conversational models. Check out the project page to see how to run the safety benchmarks. (#3767, #3768, #3769, #3784)

Convenience Functions for Agents

With a recent update to ParlAI's agent API, you can now bypass the act/observe loop for interacting with agents. (#3775)

In [1]: from parlai.core.agents import create_agent

In [2]: from parlai.core.params import ParlaiParser

In [3]: opt = ParlaiParser(True, True).parse_args(['--model_file', 'zoo:blender/blender_90M/model'])

In [4]: agent = create_agent(opt)

In [5]: agent.respond("Hi! How's it going?")
Out[5]: "it ' s going well . i ' m getting ready to go to work . how about you ?"

Minor Features

[Metrics] AUC Metrics added to parlai eval_model (#3751)

Bug Fixes

[Crowdsourcing] Crowdsourcing Fixes concerning Left Pane Text and Model Chat (#3773, #3780, #3789, #3831)
[RAG] Fix some issues with RAG/FiD agents (#3787, #3818, #3834, #3833, #3836)
Fix JSON serialization in interactive_web.py script (#3821)
Fix CI test issues (#3825, #3823)
Misc. README typos (#3807, #3839, #3841)

Developer Changes

Stripping before processing Conversations to allow leniency (#3772)
[ACUTE-Eval] Dev improvements to running ACUTE-Eval (#3781, #3782, #3783)
Allow self-chat in nested folders (#3785)
Allow opt presets from parlai_internal folders (#3819)