Skip to content

use mkdocs to generate documentation #1070

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 13, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -156,4 +156,5 @@ RuntimeProfiler*
checkpoint-*/
data*/
!mindnlp/data/
!mindnlp/dataset/
!mindnlp/dataset/
!docs/api/data/
22 changes: 6 additions & 16 deletions .readthedocs.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
# .readthedocs.yaml
# Read the Docs configuration file
# Read the Docs configuration file for MkDocs projects
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details

# Required
Expand All @@ -9,21 +8,12 @@ version: 2
build:
os: ubuntu-22.04
tools:
python: "3.7"
# You can also specify other tool versions:
# nodejs: "19"
# rust: "1.64"
# golang: "1.19"
python: "3.12"

# Build documentation in the docs/ directory with Sphinx
sphinx:
configuration: docs/conf.py
mkdocs:
configuration: mkdocs.yml

# If using Sphinx, optionally build your docs in additional formats such as PDF
# formats:
# - pdf

# Optionally declare the Python requirements required to build your docs.
# Optionally declare the Python requirements required to build your docs
python:
install:
- requirements: requirements/docs_requirements.txt
- requirements: requirements/docs_requirements.txt
21 changes: 5 additions & 16 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,19 +18,16 @@
</a>
</p>

[Installation](#installation) |
[Introduction](#introduction) |
[Quick Links](#quick-links) |

### News 📢

* 🔥 **Latest Features**

* 🤗 Hugging *huggingface* ecosystem, we use **datasets** lib as default dataset loader to support
mounts of useful datasets.
* 📝 MindNLP supports NLP tasks such as *language model*, *machine translation*, *question answering*, *sentiment analysis*, *sequence labeling*, *summarization*, etc. You can access them through [examples](./examples/).
* 🚀 MindNLP currently supports industry-leading Large Language Models (LLMs), including **Llama**, **GLM**, **RWKV**, etc. For support related to large language models, including ***pre-training***, ***fine-tuning***, and **inference** demo examples, you can find them in the ["llm" directory](./llm/).
* 🤗 Pretrained models support ***huggingface transformers-like apis***, including **60+** models like **[BERT](./mindnlp/transformers/models/bert)**, **[Roberta](./mindnlp/transformers/models/roberta)**, **[GPT2](./mindnlp/transformers/models/gpt2)**, **[T5](./mindnlp/transformers/models/t5)**, etc.
* 📝 MindNLP supports NLP tasks such as *language model*, *machine translation*, *question answering*, *sentiment analysis*, *sequence labeling*, *summarization*, etc. You can access them through [examples](https://github.com/mindspore-lab/mindnlp/examples/).
* 🚀 MindNLP currently supports industry-leading Large Language Models (LLMs), including **Llama**, **GLM**, **RWKV**, etc. For support related to large language models, including ***pre-training***, ***fine-tuning***, and **inference** demo examples, you can find them in the ["llm" directory](https://github.com/mindspore-lab/mindnlp/llm/).
* 🤗 Pretrained models support ***huggingface transformers-like apis***, including **60+** models like **[BERT](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/bert)**, **[Roberta](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/roberta)**, **[GPT2](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/gpt2)**, **[T5](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/t5)**, etc.
You can use them easily by following code snippet:
```python
from mindnlp.transformers import AutoModel
Expand Down Expand Up @@ -84,18 +81,10 @@ The master branch works with **MindSpore master**.
- **Friendly NLP model toolset**: MindNLP provides various configurable components. It is friendly to customize models using MindNLP.
- **Easy-to-use engine**: MindNLP simplified complicated training process in MindSpore. It supports Trainer and Evaluator interfaces to train and evaluate models easily.

### Quick Links

- [Documentation](https://mindnlp.cqu.ai/en/latest/)
- [Tutorials](./tutorials/)
- [Examples](./examples)
- [LLMs](./llm)
- ...


### Supported models

Since there are too many supported models, please check [here](./SUPPORT_MODEL.md)
Since there are too many supported models, please check [here](https://mindnlp.cqu.ai/supported_models)

<!-- ## Tutorials

Expand Down Expand Up @@ -124,7 +113,7 @@ If you find this project useful in your research, please consider citing:

```latex
@misc{mindnlp2022,
title={{MindNLP}: a MindSpore NLP library},
title={{MindNLP}: Easy-to-use and high-performance NLP and LLM framework based on MindSpore},
author={MindNLP Contributors},
howpublished = {\url{https://github.com/mindlab-ai/mindnlp}},
year={2022}
Expand Down
20 changes: 0 additions & 20 deletions docs/Makefile

This file was deleted.

43 changes: 0 additions & 43 deletions docs/api/abc.rst

This file was deleted.

13 changes: 0 additions & 13 deletions docs/api/dataset.rst

This file was deleted.

35 changes: 0 additions & 35 deletions docs/api/dataset/hf_datasets.rst

This file was deleted.

29 changes: 0 additions & 29 deletions docs/api/dataset/machine_translation.rst

This file was deleted.

21 changes: 0 additions & 21 deletions docs/api/dataset/question_answer.rst

This file was deleted.

13 changes: 0 additions & 13 deletions docs/api/dataset/registered.rst

This file was deleted.

21 changes: 0 additions & 21 deletions docs/api/dataset/sequence_tagging.rst

This file was deleted.

Loading