Open
Description
Some ideas that came up that could be interesting to add to the visualization website:
-
Add button to send
repository_dispatch
event for triggering Github Action workflows -
As an extension of suggestion one it would be nice to display the URL of the workflow status page after the button was pressed
- URL can be retrieved from GitHub API
-
The workflow is very simple and just sends the commands via AWS SSM to the EC2 instances. However, a successful workflow run does not guarantee that all benchmarks were executed successfully. Up to now, the easiest way is to check if the expected files were written to S3.
- Maybe our flask application can provide a simple POST endpoint that is called from the Docker Eval image after finishing the benchmark run. It takes the tool name and shows a green light if a tool successfully finished the benchmark. ...but probably that's too much work and does not provide lot of value.
Metadata
Metadata
Assignees
Labels
No labels