Skip to content

TernaryM01/rogerthat

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Wordle Solver

Background

This Wordle solver started out as a private re-do of roget by Jon Gjengset (for learning Rust and how to write optimized code), faithfully following his live-coded video on Youtube (hence the name, "roger that"). However, along the way, his implementation went wrong and it became worse and worse when he tried to optimize it, that in the end the computation of the optimal next guess doesn't make sense at all. So, this reimplementation diverges from it, and aspires to be a faithful implementation of the ideas put forward in 3blue1brown's viral video on how to make optimal guesses in Wordle by applying information theory. It retains the spirit of trying to create a Wordle solver that is optimal (both in terms of blazing fast computation and making as few guesses as possible), while it also ensures that every optimization trick is mathematically sound.

The first optimization trick is decoupling two levels of for loops into a sequence of two for loops, which means that this program achieves quadratic speedup against roget.

Though roget looks pretty quick, it is mainly because it only plays in hard mode: every guess is forced to be consistent with all the patterns received so far. Jon evidently didn't realize this throughout his live-coding; at one point somebody in chat suggested to implement hard mode, to which he replied "maybe later" [TODO: timestamp on video] but then he went ahead and implemented a hard-mode-only solver. (There was a merged PR in a late stage to implement normal mode, but by that time the program had become really unsound.) It's important to point out that 3blue1brown doesn't propose to implement a hard-mode solver; every guess is chosen to be one which gives the maximum expected information out of all the allowed words, not just the words that haven't been ruled out to be the answer [TODO: timestamp on video].

Jon went on to use memoization technique to speed up his program, but his assumptions are incorrect, which means his program no longer makes optimal guesses. Fortunately for him (or unfortunately in that it's hard to realize that something went wrong), making suboptimal guesses in hard mode doesn't hurt that much, because of the constrained nature of the set of choices. Jon did feel that something was wrong only later, when he had stacked wrong assumptions on top of one another.

(In general, even in normal mode, the difference between Wordle solvers in terms of guess optimality is very slight. One might start out with 3.7 average guesses per game, and then cheat by overfitting the parameters on the actual set of anwers, only to get down to 3.6 average guesses per game. In comparing two solvers, one should focus on the few cases where they differ in number of guesses, and try to understand why and in what situations one solver performs better than another. The overall statistics can be deceiving.)

On the solvers

Following the structure in early days of roget, this repo offers multiple solvers, each one building on top of the previous one by making it more efficient. The choice of guesses remains the same.

  1. naive.rs: This is the first one. It is almost identical to the naive solver in roget, except that this one works in normal mode (which means that there are some additional complications in how to handle the situation of few possibilities left).
  2. cached.rs: This one is like allocs.rs in roget (not cache.rs, which does unsound memoization). It modifies naive.rs by constructing the dictionary's HashMap once and then cloning it for subsequent games. There is barely any speedup.
  3. mask-buckets.rs: A quadratic speedup is introduced by decoupling the for loops iterating through candidate guesses and correctness patterns, taking advantage of the fact that every guess-answer pair corresponds to only one correctness pattern.
  4. memoized.rs: Because the first guess is always the same, the second guess corresponding to each correctness pattern received for the first guess can be recalled (if it had been encountered before) instead of being recomputed. Even on only 60 games, this shows 2x speedup compared to the previous solver. (The memoization is constructed along the way based on the patterns encountered throughout the 60 games; nothing is precomputed.) For more games, the speedup should be much higher (because of more patterns being memoized and more opportunities to recall them).

Short-term Roadmap

  1. Implement hard mode solver.
  2. Use sigmoid instead of bare frequency for modelling the probability distribution of the answer. (Because using bare frequency is so far off, the performance of using these solvers with normal mode is actually slightly worse than hard mode for the official list of Wordle answers.)
  3. (UPDATE: Interactive mode has been implemented!) Implement interactive mode, where the program works as helper for somebody playing Wordle somewhere else. It should be able to accomodate the user telling that a word is not allowed, arbitrary history of previous guesses (not just the ones that the program would choose), and displaying a list of most-recommended guesses instead of just 1.
  4. Try to memoize on arbitrarily long history of guesses, instead of just the second guess and assuming a hard-coded first guess. It should be a giant HashMap that stores the guesses made in the games that occured so far (not all possible games, which is astronomically big). Maintaining such a giant growing HashMap and looking up its elements will have performance cost, but it should be worth it. There should be an option to save it to a file.
  5. Decouple the server and the solver as separate concurrent programs, which then enables 100% efficient parallelization by simply having multiple solvers running simultaneously on different games provided by the server. (Because this is already 100% efficient, no other parallelization strategy should be sought.)
  6. Use the endgame strategy discussed by 3blue1brown by letting statistics of previous performance give estimation of expected number of guesses left. (Overfitting on only the official list of Wordle answers, however, is despised.) Give the option to choose between optimistic and prudent modes.

License

This work is licensed under the MIT License.

Acknowledgment

This work is based on roget, with dramatic twists of its own, following in the original vision but rebuilding it to make it better. The theoretical basis, based on information theory, is by 3blue1brown.

About

Wordle Solver inspired by 3blue1brown

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages