Open
Description
Currently only the logs from inference server are stored in the log files and logs from tt-metal and model implementations in tt-NN which are imported libraries are only shown in std out and not logged to file.
For example the device opening logs:
Device | INFO | Opening user mode device driver
Detecting chips (found 8)
2024-09-24 15:21:35.078 | INFO | SiliconDriver - Detected 4 PCI devices : [0, 1, 2, 3]
2024-09-24 15:21:35.133 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 0)
2024-09-24 15:21:35.133 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 4)
2024-09-24 15:21:35.136 | INFO | SiliconDriver - Detected 4 PCI devices : [0, 1, 2, 3]
2024-09-24 15:21:35.150 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 1)
2024-09-24 15:21:35.150 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 5)
2024-09-24 15:21:35.154 | INFO | SiliconDriver - Detected 4 PCI devices : [0, 1, 2, 3]
2024-09-24 15:21:35.169 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 2)
2024-09-24 15:21:35.169 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 6)
2024-09-24 15:21:35.171 | INFO | SiliconDriver - Detected 4 PCI devices : [0, 1, 2, 3]
2024-09-24 15:21:35.185 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 3)
2024-09-24 15:21:35.186 | INFO | SiliconDriver - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 7)
Metal | INFO | Initializing device 0. Program cache is NOT enabled
Metal | INFO | AI CLK for device 0 is: 900 MHz
Metal | INFO | Initializing device 4. Program cache is NOT enabled
Metal | INFO | AI CLK for device 4 is: 900 MHz
Metal | INFO | Initializing device 3. Program cache is NOT enabled
Metal | INFO | AI CLK for device 3 is: 900 MHz
Metal | INFO | Initializing device 7. Program cache is NOT enabled
Metal | INFO | AI CLK for device 7 is: 900 MHz
Metal | INFO | Initializing device 2. Program cache is NOT enabled
Metal | INFO | AI CLK for device 2 is: 900 MHz
Metal | INFO | Initializing device 6. Program cache is NOT enabled
Metal | INFO | AI CLK for device 6 is: 900 MHz
Metal | INFO | Initializing device 1. Program cache is NOT enabled
Metal | INFO | AI CLK for device 1 is: 900 MHz
Metal | INFO | Initializing device 5. Program cache is NOT enabled
Metal | INFO | AI CLK for device 5 is: 900 MHz
Metal | INFO | MMIO Device 0 : Tunnel 0 : Device 0
Metal | INFO | MMIO Device 0 : Tunnel 0 : Device 4
Metal | INFO | MMIO Device 1 : Tunnel 0 : Device 1
Metal | INFO | MMIO Device 1 : Tunnel 0 : Device 5
Metal | INFO | MMIO Device 2 : Tunnel 0 : Device 2
Metal | INFO | MMIO Device 2 : Tunnel 0 : Device 6
Metal | INFO | MMIO Device 3 : Tunnel 0 : Device 3
Metal | INFO | MMIO Device 3 : Tunnel 0 : Device 7
Activity