IndexError: list index out of range

[yanggoumao2]

Hi author, I found that there is no data_root/name.arrow file when I executed to this step pa.ipc.RecordBatchFileReader( pa.memory_map(f"{data_dir}/{name}.arrow", "r") ).read_all(), may I know the way the arrow file is generated?

[ellenzhuwang]

Hi, we follow ViLT to prepare arrow, please see the details in this link.