Ideally we would be able to monitor the NFS servers we rely on in the grafana isntances directly, but unless we can't do that we need at least some way to understand if the NFS servers are overloaded.

I understand it as we rely on cloud provided NFS services GCP Filestore and AWS EFS. Ideally, we should at least learn how to monitor them using the cloud console if we can't provide grafana instances access to the datasources and import pre-defined dashboards for this.

Cloud services

• GCP's Filestore service has notes on monitoring
• AWS EFS service has notes on monitoring
• Azure Files has notes on monitoring

Action points

• Explore the options to monitor NFS services performance and come up with refined action points

Related

• An idea to pay more to get a more performant EFS service: Move uwhackweeks to a faster EFS server #1236
• An idea to suggest using /tmp for anything temp as that could help reduce load on the NFS server: Move uwhackweeks to a faster EFS server #1236 (comment)
• An idea to provide a temp folder directly in the home directory to nudge users towards this: basehub: add custom.2i2c.temp_folder config for ~/temp ephemeral storage #2062