Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

[TOD] World, world metrics, script, tests #4178

Merged
merged 33 commits into from
Dec 22, 2021
Merged

[TOD] World, world metrics, script, tests #4178

merged 33 commits into from
Dec 22, 2021

Conversation

moyapchen
Copy link
Contributor

See documentation in tod_world_script.py for usage of script overall.

This is the diff in this stack that I'm the most unsure of in terms of documentation. Reading tod_world_script.py is good enough to get a good "I don't know what's going on but can run stuff" understanding for this code. Some of the details about the internals (ex. the metrics setup for the world) I've tried to document, but might be a tad confusing for an outsider.

Test Plan

Code tested in the tests included which tests:

  1. TodWorld class on its own
  2. TodWorld inside of tod_world_script
  3. Metrics for TodWorld on their own
  4. TodWorld's calculations of Metrics in simulated conversations using tod_world_script

I also run a quick end-to-end test with the last diff in this stack, which includes project code.

Moya Chen added 8 commits November 16, 2021 09:37
See documentation block in `tod_agents.py`

(I'm not 100% sure if `conftest.py` is a right file to change, though I did notice that `pytest.ini` was necessary to get pytest to run.)
See documentation in `tod_world_script.py` for usage.
@moyapchen moyapchen changed the base branch from simpler_tod_2_agents_teachers to main December 18, 2021 05:50
Copy link
Contributor

@skiingpacman skiingpacman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - as requested focused mainly on comments.

parlai/core/tod/tod_world.py Outdated Show resolved Hide resolved
parlai/core/tod/tod_world.py Outdated Show resolved Hide resolved
parlai/core/tod/tod_world.py Outdated Show resolved Hide resolved
@moyapchen moyapchen merged commit c371d2f into main Dec 22, 2021
@moyapchen moyapchen deleted the simpler_tod_3_world branch December 22, 2021 17:27
EricMichaelSmith added a commit that referenced this pull request Dec 23, 2021
* Add flag for external DB

* [WIP] Fix crowdsourcing CI check

* [TOD] World, world metrics, script, tests (#4178)

* [TOD][straightforward] Tod world output jsonl structure to teacher task (#4180)

* [TOD][Dataset][Easy] Google SGD in TOD Conversations format (#4181)

* Add flag for external DB

* Try to fix unit test

* Minor

Co-authored-by: Moya Chen <72097364+moyapchen@users.noreply.github.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants