Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
sb-ai-lab
/
MASeval
Public
Notifications
You must be signed in to change notification settings
Fork
1
Star
3
Code
Issues
0
Pull requests
1
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Jul 10, 2026
Add demo link
alinzh
authored
5bd50b6
View commit details
Copy full SHA for 5bd50b6
Browse repository at this point
Merge pull request #9 from sb-ai-lab/refactoring
Show description for 3465560
alinzh
authored
3465560
View commit details
Copy full SHA for 3465560
Browse repository at this point
Delete md files
alinzh
committed
c2a6cbc
View commit details
Copy full SHA for c2a6cbc
Browse repository at this point
Update README
alinzh
committed
ca78097
View commit details
Copy full SHA for ca78097
Browse repository at this point
Delete unnecessary files
alinzh
committed
a431034
View commit details
Copy full SHA for a431034
Browse repository at this point
Commits on Jul 8, 2026
Merge pull request #7 from sb-ai-lab/aegis
Show description for 7ec54f5
alinzh
authored
7ec54f5
View commit details
Copy full SHA for 7ec54f5
Browse repository at this point
Merge pull request #3 from sb-ai-lab/feat/agentrx-findings-and-verifier-ablation
Show description for 5967912
alinzh
authored
5967912
View commit details
Copy full SHA for 5967912
Browse repository at this point
add FinalAnswerVerifier aegis
twice-aweek
committed
2b148a1
View commit details
Copy full SHA for 2b148a1
Browse repository at this point
agentrx: add no-GT FinalAnswerVerifier (MAS task-completion judge)
Show description for 985081a
barakhsin
and
claude
committed
985081a
View commit details
Copy full SHA for 985081a
Browse repository at this point
Merge pull request #8 from sb-ai-lab/trail
Show description for d27ceef
alinzh
authored
d27ceef
View commit details
Copy full SHA for d27ceef
Browse repository at this point
Merge pull request #6 from sb-ai-lab/non-LLM-validators-fix
Show description for ad5c63e
Samp0rt
authored
ad5c63e
View commit details
Copy full SHA for ad5c63e
Browse repository at this point
Commits on Jul 7, 2026
edit output error-quote
twice-aweek
committed
4fc826e
View commit details
Copy full SHA for 4fc826e
Browse repository at this point
fix final answer
Samp0rt
committed
76df73b
View commit details
Copy full SHA for 76df73b
Browse repository at this point
add AEGIS trace format support
twice-aweek
committed
8f976b4
View commit details
Copy full SHA for 8f976b4
Browse repository at this point
Fix Step Top-1: add first_idx_mode (top_ranked) for AgentRx paper comparison
Show description for 05c7ae7
barakhsin
and
claude
committed
05c7ae7
View commit details
Copy full SHA for 05c7ae7
Browse repository at this point
add AEGIS trace format support
twice-aweek
committed
14f8d95
View commit details
Copy full SHA for 14f8d95
Browse repository at this point
Merge remote-tracking branch 'origin/main' into validator-report-integration
Show description for 96bd0a4
barakhsin
committed
96bd0a4
View commit details
Copy full SHA for 96bd0a4
Browse repository at this point
fix non-llm validators for TRAIL
twice-aweek
committed
18a855f
View commit details
Copy full SHA for 18a855f
Browse repository at this point
Fix launch TRAIL
alinzh
committed
0f01b6b
View commit details
Copy full SHA for 0f01b6b
Browse repository at this point
Merge pull request #5 from sb-ai-lab/non-LLM-validators-fix
Show description for 787f471
alinzh
authored
787f471
View commit details
Copy full SHA for 787f471
Browse repository at this point
doesn't work
alinzh
committed
3abbb73
View commit details
Copy full SHA for 3abbb73
Browse repository at this point
fix non-llm validators for WW
twice-aweek
committed
a6d5f91
View commit details
Copy full SHA for a6d5f91
Browse repository at this point
Move results to 'data'
alinzh
committed
de7b3d9
View commit details
Copy full SHA for de7b3d9
Browse repository at this point
Merge pull request #4 from sb-ai-lab/coef_determ_validators
Show description for 184df14
alinzh
authored
184df14
View commit details
Copy full SHA for 184df14
Browse repository at this point
Merge branch 'main' into coef_determ_validators
alinzh
authored
fef19b2
View commit details
Copy full SHA for fef19b2
Browse repository at this point
Merge pull request #2 from sb-ai-lab/update-tests
Show description for 142aadf
twice-aweek
authored
142aadf
View commit details
Copy full SHA for 142aadf
Browse repository at this point
Merge branch 'main' into update-tests
twice-aweek
authored
61d394b
View commit details
Copy full SHA for 61d394b
Browse repository at this point
Add algo metrics .md
alinzh
committed
c51393e
View commit details
Copy full SHA for c51393e
Browse repository at this point
Add [0.0; 1.0] version
alinzh
committed
34bfcdd
View commit details
Copy full SHA for 34bfcdd
Browse repository at this point
who_and_when: --run selector + folder reports; add opt-in llm_confirm
Show description for 3b59ecc
barakhsin
and
claude
committed
3b59ecc
View commit details
Copy full SHA for 3b59ecc
Browse repository at this point
agentrx: migrate span_id -> idx after merging main's rename
Show description for b00085c
barakhsin
and
claude
committed
b00085c
View commit details
Copy full SHA for b00085c
Browse repository at this point
Merge remote-tracking branch 'origin/main' into validator-report-integration
barakhsin
committed
a91524d
View commit details
Copy full SHA for a91524d
Browse repository at this point
Add verifier-mode ablation and AgentRx findings pipeline
Show description for 41cd53d
barakhsin
and
claude
committed
41cd53d
View commit details
Copy full SHA for 41cd53d
Browse repository at this point
Merge pull request #1 from romandolgo/rename-span-id-to-idx
Show description for 792cf47
alinzh
authored
792cf47
View commit details
Copy full SHA for 792cf47
Browse repository at this point
Commits on Jul 6, 2026
refactor: replace span_id with idx across validators and tests
romandolgo
committed
a6740db
View commit details
Copy full SHA for a6740db
Browse repository at this point
Previous
Next
You can’t perform that action at this time.