Skip to content

Commit

Permalink
update pretrained weight for vln-ce
Browse files Browse the repository at this point in the history
  • Loading branch information
wz0919 committed Mar 24, 2023
1 parent 507fc34 commit 06b6a05
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion Downstream/Visual-Language-Navigation/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,9 @@ We currently provide evaluation of our pretrained model.
2. Follow https://github.com/openai/CLIP to install CLIP.

### Data/Model preperation
The pretrained models and data for running the code will be released soon.
1. Follow https://github.com/jacobkrantz/VLN-CE to download Matterport3D environment to `data/scene_datasets`. Data ahould have the form `data/scene_datasets/mp3d/{scene}/{scene}.glb`.
2. Download preporcessed VLN-CE dataset from https://pjlab-gvm-data.oss-cn-shanghai.aliyuncs.com/internvideo/vln/dataset.zip to `data/datasets`. Data should have the form `data/datasets/R2R_VLNCE_v1-2_preprocessed_BERTidx/{split}` and `data/datasets/R2R_VLNCE_v1-2_preprocessed/{split}`.
3. Download pretrained models from https://pjlab-gvm-data.oss-cn-shanghai.aliyuncs.com/internvideo/vln/pretrained.zip to `pretrained`. It should have 6 folders: `pretrained/pretrained_models`, `pretrained/VideoMAE`, `pretrained/wp_pred`, `pretrained/ddppo-models`, `pretrained/Prevalent`, `pretrained/wp_pred`.

### Running the code
Simply run `bash eval_**.sh` to start evaluating the agent.

0 comments on commit 06b6a05

Please sign in to comment.