feat: include a token estimator utility

[cyclotruc]

I think it could be interesting to have a small link in the footer that links to gitingest.com/tokencount in which you can paste text to get the token estimation for it

I'm not sure if this feature would be relevant in CLI, and in the Python package

Downside of CLI: would cause bloat in the arguments/options
Downside of python module: users can just use tiktoken at this point

Let me know what you think and if wether this would be useful to you in CLI/python

[HmbleCreator]

This seems like a small but thoughtful addition, happy to take it on. I’d implement a minimal frontend link in the footer pointing to gitingest.com/tokencount, with proper responsiveness and fallback behavior. For CLI or Python integration, I’d keep it opt-in (e.g. a lightweight --estimate-tokens flag or utility function) and avoid adding dependencies unless absolutely needed.

I’m actively working on agent prompt frameworks, so token efficiency is something I care about deeply. I’d love to make this utility cleaner and more visible for users across interfaces.

Let me know if there’s a preferred UI placement or analytics tag to include—I can get started right away.

[cyclotruc]

Hi @HmbleCreator thank you very much, you got the whole idea, you can go ahead!

I think the best first step would be to just have it in the front-end for now and not expose it to the CLI yet
If anyone ever requests it in CLI, we can always expose it later

Let me know if you have any question