Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About nuScene data preprocessing and afterwards #6

Open
moonyy929 opened this issue Dec 4, 2023 · 7 comments
Open

About nuScene data preprocessing and afterwards #6

moonyy929 opened this issue Dec 4, 2023 · 7 comments

Comments

@moonyy929
Copy link

moonyy929 commented Dec 4, 2023

Hello! I have some questions regarding your model. I have already performed preprocessing on nuScene and generated the file ex_list. However, when preparing to train the model, I noticed that while iterating over ex_list, there are indices with a type of dict. I also observed that the code of train.py, the "Dataset" inside the "def distributed_run()" function is using dataset_argoverse.
I would like to ask what could be the issue here?

Thank you!

@mengmengliu1998
Copy link
Owner

Hi, I don't quite understand your question, can you provide more details, or a screenshot of the code reporting the error.

@moonyy929
Copy link
Author

After using the following command: "python src/datascripts/dataloader_nuscenes.py --DATAROOT path/to/nuScenes/root/directory --STOREDIR path/to/directory/with/preprocessed/data" to preprocess nuScene data, the file ex_list was generated. As shown in the following picture.
螢幕擷取畫面 2023-12-07 224133
And I noticed that, while the code is iterating over ex_list, there are indices with a dictionary type.
This is the error message I encountered. It looks like it is using dataset_argoverse.
螢幕擷取畫面 2023-12-07 225003

@mengmengliu1998
Copy link
Owner

Sorry, I haven't come across this before, I guess you could debug to see what the idx is
image

@moonyy929
Copy link
Author

image
I had iterated through each index and printed them as shown in the figure. Starting from the 32nd index, it becomes a dictionary. I'm wondering if there is an issue with the part of preprocessing , resulting in the generation of such data (ex_list).

@mengmengliu1998
Copy link
Owner

Hi,Did you change the code, the original code doesn't have this problem.

@moonyy929
Copy link
Author

I went through my code, and the only modification I made was to replace the part of your code that uses DistributedDataParallel. This is because my environment only supports a single GPU. Or I should do the NuScene data preprocessing again?

@mengmengliu1998
Copy link
Owner

Yes, I think you can do the NuScene data preprocessing again?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants