Skip to content

whisk/leetgptsolver

Repository files navigation

leetgptsolver

Research to identify the capabilities of LLMs in solving coding interview problems.

Publications

Usage

To interact with leetcode.com, please sign up and sign in with your Leetcode account using the Firefox browser.

Dataset

The dataset used for this research is available on Hugging Face: https://huggingface.co/datasets/whiskwhite/leetcode-complete

TODO

  • Make command-line help self-explanatory
  • Make logging/output more informative, especially when downloading questions
  • Add structure to the config and options
  • Add version information
  • Add authorization check before downloading premium problems
  • Detect a question creation time
  • Implement a simple custom downloading queue
  • Add jq filtering for reporting
  • Implement locks for problem files
  • Implement a real rate limiter instead of SimpleThrottler

Misc

"2603. Collect Coins in a Tree" - probably the last from March 2023.

"2663. Lexicographically Smallest Beautiful String" - probably the first from May 2023

About

Benchmarking LLMs (large language models) on leetcode algorithmic challenges

Topics

Resources

Stars

Watchers

Forks