Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lack “R2R_VLNCE_v1-2_preprocessed” directory for VLN-CE evaluation. #17

Open
lu-renjie opened this issue May 10, 2024 · 4 comments
Open

Comments

@lu-renjie
Copy link

I was able to run the code on VLN-CE training. But I encountered an issue during VLN-CE evaluation. It appears that the 'R2R_VLNCE_v1-2_preprocessed' directory is missing. The data provided by ETPNav only includes 'R2R_VLNCE_v1-2_preprocessed_BERTidx'.

@MarSaKi
Copy link
Owner

MarSaKi commented May 10, 2024

Sorry for the typo, you can change the filename to 'R2R_VLNCE_v1-2_preprocessed' and try again.

@lu-renjie
Copy link
Author

It seems that it is not a typo. The files in the 'R2R_VLNCE_v1-2_preprocessed_BERTidx' directory follow the format '{split}/{split}_bertidx.json.gz', whereas in the 'R2R_VLNCE_v1-2_preprocessed' directory, the files follow the format '{split}/{split}_gt.json.gz'.

Additionally, based on the code, the data in '{split}/{split}_gt.json.gz' is used by self.gt_data[ep_id]['locations']. However, the data in '{split}/{split}_bertidx.json.gz' appears as follows:

{
 ''episodes': {'episode_id': 1,
   'trajectory_id': 15,
   'scene_id': 'mp3d/zsNo4HB9uLZ/zsNo4HB9uLZ.glb',
   'start_position': [15.068599700927734, 0.17162801325321198, -4.4848198890686035],
   'start_rotation': [0, 0.6198966754439885, 0, -0.7846834468583432],
   'info': {'geodesic_distance': 7.9608235359191895},
   'goals': [{'position': [...], 'radius': 3.0}],
   'instruction': {'instruction_text': ..., 'instruction_tokens': [...]},
   'reference_path': [...]
  },
 'instruction_vocab': {...}
}

As you can see, there is no 'locations' field in it."

@MarSaKi
Copy link
Owner

MarSaKi commented May 10, 2024

Hi, you can try this one "https://drive.google.com/file/d/1FJ2xs1Q0lSI-bN1Gi8BElN8xbEft8aum/view?usp=sharing".
I just upload it.

@lu-renjie
Copy link
Author

It works! Thank you very much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants