Skip to content

DependEval: a hierarchical benchmark for evaluating LLMs on repository-level code understanding across 8 programming languages.

Notifications You must be signed in to change notification settings

ink7-sudo/DependEval

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DependEval: Benchmarking LLMs for Repository Dependency Understanding

The repository contains the data and evaluation code for ACL 2025 Findings paper "DependEval: Benchmarking LLMs for Repository Dependency Understanding"

Introduction

We introduce DependEval, a hierarchical benchmark for evaluating LLMs on repository-level code understanding, including dependency recognition, repository construction, and multi-file editing across 8 programming languages.

About

DependEval: a hierarchical benchmark for evaluating LLMs on repository-level code understanding across 8 programming languages.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published