Skip to content

Commit

Permalink
update eadme, safetensor
Browse files Browse the repository at this point in the history
  • Loading branch information
yadong-lu committed Oct 26, 2024
1 parent 65e1432 commit 8a3c07d
Show file tree
Hide file tree
Showing 5 changed files with 75 additions and 419 deletions.
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
weights/icon_caption_blip2
weights/icon_caption_florence
weights/icon_detect
.gradio
__pycache__
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,13 +16,20 @@
- [2024/09] OmniParser achieves the best performance on [Windows Agent Arena](https://microsoft.github.io/WindowsAgentArena/)!

## Install
Install environment:
```python
conda create -n "omni" python==3.12
conda activate omni
pip install -r requirement.txt
```

Then download the model ckpts files in: https://huggingface.co/microsoft/OmniParser, and put them under weights/, default folder structure is: weights/icon_detect, weights/icon_caption_florence, weights/icon_caption_blip2.

Finally, convert the safetensor to .pt file.
```python
python weights/convert_safetensor_to_pt.py
```

## Examples:
We put together a few simple examples in the demo.ipynb.

Expand Down
Loading

0 comments on commit 8a3c07d

Please sign in to comment.