MineStudio: A Streamlined Package for Minecraft AI Agent Development

MineStudio is a simple and efficient Minecraft development kit for AI research.

Overview

MineStudio contains a series of tools and APIs that can help you quickly develop Minecraft AI agents:

• Simulator: Easily customizable Minecraft simulator based on MineRL.
• Data: A trajectory data structure for efficiently storing and retrieving arbitray trajectory segment.
• Models: A template for Minecraft policy model and a gallery of baseline models.
• Offline Training: A straightforward pipeline for pre-training Minecraft agents with offline data.
• Online Training: Efficient RL implementation supporting memory-based policies and simulator crash recovery.
• Inference: Pallarelized and distributed inference framework based on Ray.
• Benchmark: Automating and batch-testing of diverse Minecraft tasks.

This repository is under development. We welcome any contributions and suggestions.

Installation

For a more detailed installation guide, please refer to the documentation.

MineStudio requires Python 3.10 or later. We recommend using conda to maintain an environment on Linux systems. JDK 8 is also required for running the Minecraft simulator.

conda create -n minestudio python=3.10 -y
conda activate minestudio
conda install --channel=conda-forge openjdk=8 -y

MineStudio is available on PyPI. You can install it via pip.

pip install MineStudio

To install MineStudio from source, you can run the following command:

pip install git+https://github.com/CraftJarvis/MineStudio.git

Minecraft simulator requires rendering tools. For users with nvidia graphics cards, we recommend installing VirtualGL. For other users, we recommend using Xvfb, which supports CPU rendering but is relatively slower. Refer to the documentation for installation commands.

After the installation, you can run the following command to check if the installation is successful:

python -m minestudio.simulator.entry # using Xvfb
MINESTUDIO_GPU_RENDER=1 python -m minestudio.simulator.entry # using VirtualGL

Why MineStudio

Acknowledgement

The simulation environment is built upon MineRL and Project Malmo. We also refer to Ray, PyTorch Lightning for distributed training and inference. Thanks for their great work.

Citation

@inproceedings{MineStudio,
  title={MineStudio: A Streamlined Package for Minecraft AI Agent Development},
  author={Shaofei Cai and Zhancun Mu and Kaichen He and Bowei Zhang and Xinyue Zheng and Anji Liu and Yitao Liang},
  year={2024},
  url={https://api.semanticscholar.org/CorpusID:274992448}
}