Task: Improve worker configuration generation to use system info and PCI ID data

[orlandohohmeier]

Description

Enhance the worker configuration generation to automatically populate system resource details during initialization (init). Use the sysinfo Rust crate to detect system-level information such as total memory, CPU count, disk, and kernel details. In addition, use the pci-id-parser crate to detect and include GPU details from PCI devices. If GPU or system details are unavailable, fall back to existing hardcoded defaults.

This ensures that the generated configuration reflects the actual system more closely, improving accuracy in worker scoring and resource offers.

Context

Operators run workers using the generated configurations with defaults, that do not accurately reflect the system’s actual resources. This leads to suboptimal worker scoring and resource allocation.

By programmatically generating system-aware configurations using sysinfo and pci-id-parser, we ensure that the configuration better matches the system’s true resource capacity.

This task lays the foundation for improved scheduling accuracy and system introspection.

Acceptance Criteria

• Given the worker initialization process (init) runs
  When system information is available via the sysinfo crate
  Then the generated configuration includes CPU, memory, disk
• Given the worker has GPUs
  When the pci-id-parser successfully identifies them
  Then the configuration includes the identified GPU memory
• Given system or GPU information cannot be retrieved
  When sysinfo or pci-id-parser fail
  Then default (hardcoded) configuration values are used instead.

Implementation Hints (Optional)