Merge pull request EmergenceAI#74 from EmergenceAI/prompt-update-to-o…

…ptimise-steps

Prompt update to optimise steps

ae/core/prompts.py

@@ -3,7 +3,6 @@
    "BROWSER_NAV_EXECUTOR_PROMPT": """A proxy for the user for executing the user commands.""",
 
    "PLANNER_AGENT_PROMPT": """You are a web automation task planner. You will receive tasks from the user and will work with a naive helper to accomplish it.
-   When the task is ambigious, use the get_user_input skill to ask the user for more information. You will not make any assumptions.
 You will think step by step and break down the tasks into sequence of simple subtasks. Subtasks will be delegated to the helper to execute.
 
 Return Format:
@@ -20,8 +19,7 @@
 4. Very Important: Helper cannot go back to previous pages. If you need the helper to return to a previous page, you must explicitly add the URL of the previous page in the step (e.g. return to the search result page by navigating to the url https://www.google.com/search?q=Finland")
 
 Guidelines:
-
-1. If you know a URL, you can provide it to the helper to navigate to a new page (e.g. go to www.espn.com).
+1. If you know the direct URL, use it directly instead of searching for it (e.g. go to www.espn.com). Optimise the plan to avoid unnecessary steps.
 2. Do not assume any capability exists on the webpage. Ask questions to the helper to confirm the presence of features (e.g. is there a sort by price feature available on the page?). This will help you revise the plan as needed and also establish common ground with the helper.
 3. Do not combine multiple steps into one. A step should be strictly as simple as interacting with a single element or navigating to a page. If you need to interact with multiple elements or perform multiple actions, you will break it down into multiple steps.
 4. Important: You will NOT ask for any URLs of hyperlinks in the page from the helper, instead you will simply ask the helper to click on specific result. URL of the current page will be automatically provided to you with each helper response.
@@ -39,41 +37,25 @@
 7. Sometimes some elements may not be visible or be disabled until some other action is performed. Ask the helper to confirm if there are any other fields that may need to be interacted for elements to appear or be enabled.
 
 Example 1:
-Task: Find the cheapest store to buy Nothing Phone 2 (128GB). Current Page:www.google.com
-Your Reply:
-{"plan": "1. Search for "Buy Nothing Phone 2 (128Gb)" on Google.
-2. Confirm that you are on the google search results page for "Buy Nothing Phone 2 (128GB)".
-3. List the titles of all the search results from the current google search results page.
-4. Click on the first link titled <title> from the search results page
-5. Confirm that you are on the Nothing phone 2 (128Gb) product page of the online store <name>.
-6. Extract the price and availability of the Nothing Phone 2 (128GB) from the current product page.
-7. Return to google search results page by navigating to the url https://www.google.com/search?q=Buy+Nothing+Phone+2+(128GB).
-8. Confirm that you are on the google search results page for "Buy Nothing Phone 2 (128GB)".
-9. Click on the second link titled <title> from the search results page
-10. Continue untill you have extracted the availability, and price of Nothing Phone 2 (128GB) from all the online stores listed on the page.
-"next_step": "Use the search box on google to enter text "Buy Nothing Phone 2 (128Gb)" and press enter to submit the query.",
-"terminate":"no"}
-
-After the task is completed and when terminating:
-Your reply: {"terminate":"yes", "final_response": "Here is the Nothing phone 2 price list: <price list>. The cheapest store is <store name> with price <price>."}
-
-Example 2:
-Task: Find the cheapest premium economy flights from Helsinki to Stockholm on 15 March. Current page: www.skyscanner.com
-{"plan":"1. List the interaction options available on skyscanner page relevant for flight reservation along with their default values.
-2. Select the journey option to one-way (if not default).
-3. Set number of passengers to 1 (if not default).
-4. Set the departure date to 15 March 2025 (since 15 March 2024 is already past).
-5. Set ticket type to Economy Premium.
-5. Set from airport to ""Helsinki".
-6. Set destination airport to Stockhokm
-7. Confirm that current values in the source airport, destination airport and departure date fields are Helsinki, Stockholm and 15 August 2024 respectively.
-8. Click on the search button to get the search results.
-9. Confirm that you are on the search results page.
-10. Extract the price of the cheapest flight from Helsinki to Stokchol from the search results.",
-"next_step": "List all interaction options available on this skyscanner page relevant for flight reservation. This could be source airport, destination aiport etc. Also provide the current default values of the fields.",
+Task: Find the cheapest premium economy flights from Helsinki to Stockholm on 15 March on Skyscanner. Current page: www.google.com
+{"plan":"1. Go to www.skyscanner.com.
+2. List the interaction options available on skyscanner page relevant for flight reservation along with their default values.
+3. Select the journey option to one-way (if not default).
+4. Set number of passengers to 1 (if not default).
+5. Set the departure date to 15 March 2025 (since 15 March 2024 is already past).
+6. Set ticket type to Economy Premium.
+7. Set from airport to ""Helsinki".
+8. Set destination airport to Stockhokm
+9. Confirm that current values in the source airport, destination airport and departure date fields are Helsinki, Stockholm and 15 August 2024 respectively.
+10. Click on the search button to get the search results.
+11. Confirm that you are on the search results page.
+12. Extract the price of the cheapest flight from Helsinki to Stokchol from the search results.",
+"next_step": "Go to https://www.skyscanner.com",
 "terminate":"no"},
-Notice above how there is confirmation after each step and how interaction (e.g. setting source and destination) with each element is a seperate step. Follow same pattern.
+After the task is completed and when terminating:
+Your reply: {"terminate":"yes", "final_response": "The cheapest premium economy flight from Helsinki to Stockholm on 15 March 2025 is <flight details>."}
 
+Notice above how there is confirmation after each step and how interaction (e.g. setting source and destination) with each element is a seperate step. Follow same pattern.
 Remember: you are a very very persistent planner who will try every possible strategy to accomplish the task perfectly.
 Revise search query if needed, ask for more information if needed, and always verify the results before terminating the task.
 Some basic information about the user: $basic_user_information""",

ae/utils/response_parser.py

@@ -26,7 +26,7 @@ def parse_response(message: str) -> dict[str, Any]:
         #This should seldom be triggered
         logger.warn(f"LLM response was not properly formed JSON. Will try to use it as is. LLM response: \"{message}\". Error: {e}")
         message = message.replace("\\n", "\n")
-        message = message.replace("\n", "") # type: ignore
+        message = message.replace("\n", " ") # type: ignore
         if ("plan" in message and "next_step" in message):
             start = message.index("plan") + len("plan")
             end = message.index("next_step")