Unescaped config names with special characters in the URL

[marcenacp]

When playing with mlcroissant, we observed the following issue:

bigcode/commitpackft has both the configs c and c#. When going to https://huggingface.co/api/datasets/bigcode/commitpackft/parquet/c#/train/0.parquet, it lists https://huggingface.co/api/datasets/bigcode/commitpackft/parquet/c/train/0.parquet (instead of https://huggingface.co/api/datasets/bigcode/commitpackft/parquet/c%23/train/0.parquet).

Should dataset names / config names be escaped in the URLs?

cc @severo @lhoestq

[severo]

sure. Thanks for reporting.

[severo]

related to #2343 and more generally to https://github.com/huggingface/dataset-viewer/issues?q=is%3Aopen+is%3Aissue+label%3A%22name+issue%22

[marcenacp]

@severo Do I understand correctly that each service should:

1. deserialize the names from the URL before using the name
2. call other services with serialized names in the URL?

Do you see a way to fix it more gradually service by service (e.g., starting by /parquet)? How can we make sure that we don't break anybody relying on names not being serialized in the URL?

Thanks!