From d87371f202bebfdb3b4981fbb9b847a8410674b5 Mon Sep 17 00:00:00 2001 From: DeepakAkkil Date: Fri, 19 Jul 2024 12:50:28 +0300 Subject: [PATCH 1/8] Update readme Videos in new UI style Link to Arxiv paper Recommended model GPT4-Turbo Update to Architecture Diagram --- README.md | 12 +++++++----- docs/images/agent-e-autogen-setup.png | Bin 91688 -> 273040 bytes docs/images/amazon-add-to-cart-thumbnail.png | Bin 4372758 -> 5442240 bytes docs/images/compare-flights-thumbnail.png | Bin 0 -> 3533085 bytes docs/images/form-filling-thumbnail.png | Bin 1285088 -> 2564493 bytes .../play-video-on-youtube-thumbnail.png | Bin 2272042 -> 3291391 bytes docs/images/tweet-verify-thumbnail.png | Bin 2937595 -> 0 bytes 7 files changed, 7 insertions(+), 5 deletions(-) create mode 100644 docs/images/compare-flights-thumbnail.png delete mode 100644 docs/images/tweet-verify-thumbnail.png diff --git a/README.md b/README.md index 95cdde0..e8a6cdf 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,6 @@ # Agent-E +📚 [Cite paper](https://arxiv.org/abs/2407.13032) + Agent-E is an agent based system that aims to automate actions on the user's computer. At the moment it focuses on automation within the browser. The system is based on on [AutoGen agent framework](https://github.com/microsoft/autogen). @@ -29,7 +31,7 @@ While Agent-E is growing, it is already equipped to handle a versatile range of - If you do not have Google Chrome locally (and don't want to install it), install playwright drivers: `playwright install` - .env file in project root is needed with the following (sample `.env-example` is included for convience): - Follow the directions in the sample file - - You will need to set `AUTOGEN_MODEL_NAME` (for example `gpt-4-turbo-preview`) and `AUTOGEN_MODEL_API_KEY` + - You will need to set `AUTOGEN_MODEL_NAME` (for example `gpt-4-turbo-preview`) and `AUTOGEN_MODEL_API_KEY`. For best results, `gpt-4-turbo-preview` is recommended. Although Agent-E may operate with local LLMs, these configurations have not undergone extensive testing. - If you are using a model other than OpenAI, you need to set `AUTOGEN_MODEL_BASE_URL` for example `https://api.groq.com/openai/v1` or `https://.openai.azure.com` on [Azure](https://azure.microsoft.com/). - For [Azure](https://azure.microsoft.com/), you'll also need to configure `AUTOGEN_MODEL_API_TYPE=azure` and `AUTOGEN_MODEL_API_VERSION` (for example `2023-03-15-preview`) variables. - If you want to use local chrome browser over playwright browser, go to chrome://version/ in chrome, find the path to your profile and set `BROWSER_STORAGE_DIR` to the path value @@ -58,10 +60,10 @@ Once the program is running, you should see an icon on the browser. The icon ex | Video | Command | Description | |-----------|-------------|-------------| -| [![Oppenheimer Video](docs/images/play-video-on-youtube-thumbnail.png)](https://www.youtube.com/embed/zjYeULZW4Ao) | There is an Oppenheimer video on youtube by Veritasium, can you find it and play it? | | -| [![Example 2: Use information to fill forms](docs/images/form-filling-thumbnail.png)](https://www.youtube.com/embed/B5PWBNBbmQU) | Can you do this task? Wait for me to review before submitting. | Takes the highlighted text from the email as part of the instruction.