Add comprehensive tests

Before release, we should make sure to have comprehensive tests for common entrypoints. 

Once those are added, I can update the CI so we can be alerted when we make changes that break the current API, or when tests are failing.