Skip to content

Refine flowers dataset #33649

@wanghaoshuang

Description

@wanghaoshuang

在paddle.data.flowers中,将数据以batch为单位打包成了独立的文件存放在文件系统,这种操作在多卡训练情况下容易出现问题,先在需要对其修改。
删除对batch_images_from_tar的调用:https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/dataset/flowers.py#L126

并参考paddle.vision.datasets.flowers和mnist重构paddle.data.flowers:
paddle.vision.datasets.flowers: https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/dataset/flowers.py
mnist: https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/dataset/mnist.py

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions