Skip to content

Commit ddebb9c

Browse files
committed
Deployed 72e4090 with MkDocs version: 1.6.1
1 parent 452211a commit ddebb9c

File tree

26 files changed

+106622
-2017
lines changed

26 files changed

+106622
-2017
lines changed

agent/index.html

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -432,7 +432,7 @@ <h2 id="running">Running</h2>
432432
running AI agents to assist with code development and testing.
433433
In this example we use <a href="https://aider.chat/">Aider</a> as the
434434
baseline code completion agent</p>
435-
<div class="highlight"><pre><span></span><code>pip<span class="w"> </span>install<span class="w"> </span>aider
435+
<div class="highlight"><pre><span></span><code>pip<span class="w"> </span>install<span class="w"> </span>aider-chat
436436
</code></pre></div>
437437
<p>First we assume there is an underlying <code>commit0</code>
438438
project that is configured. To create a new project,
@@ -446,15 +446,16 @@ <h2 id="running">Running</h2>
446446
agent<span class="w"> </span>config<span class="w"> </span>aider
447447
</code></pre></div>
448448
<p>Finally we run the underlying agent. This will create a display
449-
that shows the current progress of the agent.</p>
450-
<div class="highlight"><pre><span></span><code>agent<span class="w"> </span>run
449+
that shows the current progress of the agent. Specify the branch
450+
you want to commit changes on.</p>
451+
<div class="highlight"><pre><span></span><code>agent<span class="w"> </span>run<span class="w"> </span>BRANCH
451452
</code></pre></div>
452453
<h3 id="extending">Extending</h3>
453454
<p>Refer to <code>class Agents</code> in <code>agent/agents.py</code>. You can design your own agent by inheriting <code>Agents</code> class and implement the <code>run</code> method.</p>
454455
<h2 id="notes">Notes</h2>
455456
<ul>
456457
<li>Aider automatically retries certain API errors. For details, see <a href="https://github.com/paul-gauthier/aider/blob/75e1d519da9b328b0eca8a73ee27278f1289eadb/aider/sendchat.py#L17">here</a>.</li>
457-
<li>When increasing --max-parallel-repos, be mindful of aider's <a href="https://github.com/paul-gauthier/aider/blob/75e1d519da9b328b0eca8a73ee27278f1289eadb/aider/sendchat.py#L39">60-second retry timeout</a>. Set this value according to your API tier to avoid RateLimitErrors stopping processes.</li>
458+
<li>When increasing <code>--max-parallel-repos</code>, be mindful of aider's <a href="https://github.com/paul-gauthier/aider/blob/75e1d519da9b328b0eca8a73ee27278f1289eadb/aider/sendchat.py#L39">60-second retry timeout</a>. Set this value according to your API tier to avoid RateLimitErrors stopping processes.</li>
458459
<li>Currently, agent will skip file with more than 1500 lines. See <code>agent/agent_utils.py#L199</code> for details.</li>
459460
<li>Running a full <code>all</code> commit0 split costs approximately $100 with Claude Sonnet 3.5.</li>
460461
</ul>

analysis/index.html

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -409,21 +409,21 @@ <h2 id="leaderboard-lite">Leaderboard (lite)</h2>
409409
</thead>
410410
<tbody>
411411
<tr>
412-
<td>Reference (Gold)</td>
413-
<td style="text-align: center;">10</td>
414-
<td style="text-align: center;">20.94</td>
415-
<td style="text-align: center;">NA</td>
416-
<td><a href="/analysis_gold_reference">Analysis</a></td>
417-
<td><a href="https://github.com/commit-0">Github</a></td>
418-
</tr>
419-
<tr>
420412
<td>Claude Sonnet 3.5 - Base</td>
421-
<td style="text-align: center;">5</td>
422-
<td style="text-align: center;">39.56</td>
413+
<td style="text-align: center;">0</td>
414+
<td style="text-align: center;">14.84</td>
423415
<td style="text-align: center;">09/25/2024</td>
424416
<td><a href="/analysis_test-save-commit0_baseline">Analysis</a></td>
425417
<td><a href="https://github.com/test-save-commit0">Github</a></td>
426418
</tr>
419+
<tr>
420+
<td>Reference (Gold)</td>
421+
<td style="text-align: center;">10</td>
422+
<td style="text-align: center;">27.83</td>
423+
<td style="text-align: center;">NA</td>
424+
<td><a href="/analysis_commit0_reference">Analysis</a></td>
425+
<td><a href="https://github.com/commit-0">Github</a></td>
426+
</tr>
427427
</tbody>
428428
</table>
429429
<h2 id="leaderboard-all">Leaderboard (all)</h2>

analysis_gold_reference/index.html renamed to analysis_commit0_reference/index.html

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616

1717

1818

19-
<title>Analysis gold reference - Commit-0</title>
19+
<title>Analysis commit0 reference - Commit-0</title>
2020

2121

2222

@@ -95,7 +95,7 @@
9595
<div class="md-header__topic" data-md-component="header-topic">
9696
<span class="md-ellipsis">
9797

98-
Analysis gold reference
98+
Analysis commit0 reference
9999

100100
</span>
101101
</div>
@@ -331,80 +331,80 @@ <h1 id="submission-name-reference-gold-split-lite">Submission Name: <strong>Refe
331331
<td>simpy</td>
332332
<td>Yes</td>
333333
<td style="text-align: center;">140 / 150</td>
334-
<td style="text-align: center;">2.01</td>
335-
<td><a href="/analysis_gold_reference_simpy">Analysis</a></td>
334+
<td style="text-align: center;">2.20</td>
335+
<td><a href="/analysis_commit0_reference_simpy">Analysis</a></td>
336336
<td><a href="https://github.com/commit-0/simpy">Github</a></td>
337337
</tr>
338338
<tr>
339339
<td>tinydb</td>
340340
<td>Yes</td>
341341
<td style="text-align: center;">201 / 201</td>
342-
<td style="text-align: center;">1.19</td>
343-
<td><a href="/analysis_gold_reference_tinydb">Analysis</a></td>
342+
<td style="text-align: center;">2.67</td>
343+
<td><a href="/analysis_commit0_reference_tinydb">Analysis</a></td>
344344
<td><a href="https://github.com/commit-0/tinydb">Github</a></td>
345345
</tr>
346346
<tr>
347347
<td>marshmallow</td>
348348
<td>Yes</td>
349349
<td style="text-align: center;">1229 / 1229</td>
350-
<td style="text-align: center;">2.57</td>
351-
<td><a href="/analysis_gold_reference_marshmallow">Analysis</a></td>
350+
<td style="text-align: center;">6.77</td>
351+
<td><a href="/analysis_commit0_reference_marshmallow">Analysis</a></td>
352352
<td><a href="https://github.com/commit-0/marshmallow">Github</a></td>
353353
</tr>
354354
<tr>
355355
<td>wcwidth</td>
356356
<td>Yes</td>
357357
<td style="text-align: center;">38 / 39</td>
358-
<td style="text-align: center;">1.00</td>
359-
<td><a href="/analysis_gold_reference_wcwidth">Analysis</a></td>
358+
<td style="text-align: center;">1.04</td>
359+
<td><a href="/analysis_commit0_reference_wcwidth">Analysis</a></td>
360360
<td><a href="https://github.com/commit-0/wcwidth">Github</a></td>
361361
</tr>
362362
<tr>
363363
<td>imapclient</td>
364364
<td>Yes</td>
365365
<td style="text-align: center;">267 / 267</td>
366-
<td style="text-align: center;">1.45</td>
367-
<td><a href="/analysis_gold_reference_imapclient">Analysis</a></td>
366+
<td style="text-align: center;">0.50</td>
367+
<td><a href="/analysis_commit0_reference_imapclient">Analysis</a></td>
368368
<td><a href="https://github.com/commit-0/imapclient">Github</a></td>
369369
</tr>
370370
<tr>
371371
<td>voluptuous</td>
372372
<td>Yes</td>
373373
<td style="text-align: center;">149 / 149</td>
374-
<td style="text-align: center;">0.37</td>
375-
<td><a href="/analysis_gold_reference_voluptuous">Analysis</a></td>
374+
<td style="text-align: center;">0.42</td>
375+
<td><a href="/analysis_commit0_reference_voluptuous">Analysis</a></td>
376376
<td><a href="https://github.com/commit-0/voluptuous">Github</a></td>
377377
</tr>
378378
<tr>
379379
<td>jinja</td>
380380
<td>Yes</td>
381381
<td style="text-align: center;">851 / 851</td>
382-
<td style="text-align: center;">4.14</td>
383-
<td><a href="/analysis_gold_reference_jinja">Analysis</a></td>
382+
<td style="text-align: center;">6.16</td>
383+
<td><a href="/analysis_commit0_reference_jinja">Analysis</a></td>
384384
<td><a href="https://github.com/commit-0/jinja">Github</a></td>
385385
</tr>
386386
<tr>
387387
<td>deprecated</td>
388388
<td>Yes</td>
389389
<td style="text-align: center;">171 / 171</td>
390-
<td style="text-align: center;">1.15</td>
391-
<td><a href="/analysis_gold_reference_deprecated">Analysis</a></td>
390+
<td style="text-align: center;">0.46</td>
391+
<td><a href="/analysis_commit0_reference_deprecated">Analysis</a></td>
392392
<td><a href="https://github.com/commit-0/deprecated">Github</a></td>
393393
</tr>
394394
<tr>
395395
<td>cookiecutter</td>
396396
<td>Yes</td>
397397
<td style="text-align: center;">367 / 371</td>
398-
<td style="text-align: center;">6.72</td>
399-
<td><a href="/analysis_gold_reference_cookiecutter">Analysis</a></td>
398+
<td style="text-align: center;">7.27</td>
399+
<td><a href="/analysis_commit0_reference_cookiecutter">Analysis</a></td>
400400
<td><a href="https://github.com/commit-0/cookiecutter">Github</a></td>
401401
</tr>
402402
<tr>
403403
<td>cachetools</td>
404404
<td>Yes</td>
405405
<td style="text-align: center;">215 / 215</td>
406-
<td style="text-align: center;">0.35</td>
407-
<td><a href="/analysis_gold_reference_cachetools">Analysis</a></td>
406+
<td style="text-align: center;">0.34</td>
407+
<td><a href="/analysis_commit0_reference_cachetools">Analysis</a></td>
408408
<td><a href="https://github.com/commit-0/cachetools">Github</a></td>
409409
</tr>
410410
</tbody>

0 commit comments

Comments
 (0)