Add more Prometheus metrics

[yuvipanda]

Now that #3490 has been merged, we should add more prometheus metrics to the notebook server!

Some ideas for metrics to add...

1. Number of kernels running (labeled by type)
2. Number of sessions open (not sure if this is useful?)
3. Number of terminals open
4. Mirror of the activity tracking metrics
5. Kernel start / stop latency metrics
6. 0mq metrics

Am sure there's more that I don't know of!

[yuvipanda]

Can someone with rights mark this as 'good first issue'? :)

[dhirschfeld]

I'm interested in RAM - per kernel and total. Not sure if that's already available though?

[rgbkrk]

There's some light amount of collaboration around RAM on a kernel level in jupyter/jupyter#264, though it's on a spec level (especially since the actual kernel make be several child processes deep). @ivanov would probably enjoy having a collaborator on the Python side -- I'm looking forward to the UI portion of using it. The notebook server can use it as well since it has access to the messages as it transports them from ZeroMQ to WebSocket.

[yuvipanda]

@dhirschfeld @rgbkrk we could possibly also do it from the default Kernel Manager, since it is just spawning local processes and knows how to collect metrics for them (and their children). This lets other kernel managers report their own metrics as they wish, and works across all kernels without any extra work. It would be complimentary to jupyter/jupyter#264.

[GoelJatin]

Hi @yuvipanda ,

If no one is working on this, then I would like to take it up.

I would like to start with the very first one for now.

But have a few doubts.

Do we want the number of kernels running at the time when the API is called / keep on collecting them over the complete period of time since the notebook server was started?

Please let me know accordingly.

CC @Madhu94

[GoelJatin]

Guys,

Any update on this?

[manuhortet]

Hey @GoelJatin, I'm up to work on this with you.

I'm interested in RAM - per kernel and total. Not sure if that's already available though?

As I think this will be the most useful metric to add, may I take it? :)

Will try to do it from the default Kernel Manager, as mentioned by @yuvipanda

[GoelJatin]

Hey @manuhortet , sure go ahead.

No concerns from my end. :)

[LiryChen]

Hey, I am a first-timer looking for tasks to do too. I found this issue pretty interesting. Anything I can help with?

[konnermacias]

@manuhortet Have you been able to make any progress on adding that metric? I'm a first-timer as well and would love to help out!

[manuhortet]

Hey! Sincerely I've been delaying some OS contributions in order to gain time for personal projects. I'm sorry I delayed you two too doing that! You can take this issue if you want to. In fact, feel free to ask me if you face any problems. Good luck! @konnermacias @LiryChen

[manuhortet]

For number 4, the last done thing and timestamp would be the logical thing IMO.
Don't think there's anyone working on the RAM per kernel metric, maybe @konnermacias ?

Can't really help on the explanation for number 6. Some help here @yuvipanda ?

[konnermacias]

@manuhortet I apologize, school has picked up and I was planning on working on it in a week or two when eveyrthing dies down. @Hyaxia feel free to go for it!

[Hyaxia]

Ok then, I will start working on the ram per kernel metric in a few days.

[vinaycalastry]

Hello.. This issue seems to be open and there has been no status change since October. Can we get the current status on this please ?

[santosh2702]

anything i can help with

[Hyaxia]

So I guess I'm the last one who was working on it.
When I opened the PR #4075, @minrk pointed out that it should go into the jupyter_client project.
Then I opened a PR in jupyter_client jupyter/jupyter_client#407 and you can read yourselves to the point we stopped.

TL;DR - goto jupyter/jupyter_client#407 , you should implement some kind of generic way to expose different kernel statistics.
I started to work on it in the PR, but just didn't have the time to finish it.
As the last comments there state, check how to do it using entry points.
For further information just read the comments in the PR itself, all of the information I had at that time is there.

GL.

[Franky12]

Hi can I try this? looking for some beginner-friendly issues

[sudo-k-runner]

Hey! not sure if anyone is still looking into this? I would like to work on this.

[kevin-bates]

Hi @sudo-k-runner - thank you for your interest. In light of the fact that the primary notebook server will eventually be based on the jupyter server project, you will likely find better traction on metrics gathering via the jupyter telemetry project - which the jupyter server plans on utilizing.

[dhivyasreedhar]

Hi, can I work on this? I'm new so can someone guide me?

[kevin-bates]

Hi @dhivyasreedhar - please see the previous comment. This repository is currently focused on bug fixes and security issues.