[WIP] Feat/add fsspec back

[bhimrazy]

Before submitting

• Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure to update the docs?
• Did you write any new necessary tests?

What does this PR do?

This PR is an extension of #348 by @deependujha.
Initially, the PR was reverted due to some CI issues.

We will investigate those issues and resolve them in this PR.

TBD...

PR review

Not ready yet

Did you have fun?

Make sure you had fun coding 🙃

[deependujha]

Hi @bhimrazy,

The codebase has changed significantly, especially with the addition of HFDownloader, making it quite complex to integrate the old changes properly.

To avoid confusion and ensure everything aligns with the latest updates, I’m closing this PR. A fresh PR would be a better approach. Otherwise, we will be required to copy all parquet support and HF support codes from main branch to this old branch.

Thanks, and sorry for the trouble!