PDF report, and PDF report within .zip file, found to be different and missing sections #1252
Description
Describe the bug
The PDF report available via orange below was found to be different to that available via blue below. The differences observed are in formatting and sections missing.
To Reproduce
These are the steps that were followed.
- Have laptop running Ubuntu 24.04.2 and Testrun 2.1.1. Using Chrome web browser on the laptop itself, run a test against a device.
- Using laptop itself, view PDF report via orange link above after test completes. This is that PDF file. Note 13 pages (correct), strange icon representation (incorrect), and different font.
- From another laptop running Windows 11, web browse to laptop running Testrun and download .ZIP file via blue link above. This is that ZIP file. Note 5 pages (incorrect), proper icon representation (correct), and usual font.
Expected behavior
I know the PDF within the .zip file (blue link) is regenerated on each download thanks to #922 (and that hopefully the instant PDF download (orange link) will do same thanks to #1175 in the future), but the expected behaviour would be that any regenerated reports are not missing the TLS, DNS, NTP, Services, etc. sections.
Error logs
The Testrun output at the time of step 3 above (to grab the .zip) is available below. I also grabbed (again) the .pdf (via orange link) below, it is the same file as that included inline above.
oss@oss-Inspiron-3542:~$ sudo testrun
[sudo] password for oss:
Apr 17 10:10:45 session DEBUG Loading configuration file at /usr/local/testrun/local/system.json
Apr 17 10:10:45 session DEBUG Loading risk assessment format
Apr 17 10:10:45 session DEBUG Loading risk profiles
Apr 17 10:10:45 session DEBUG Discovered profile Smart Building.json
Apr 17 10:10:45 session DEBUG Loading certificates from local/root_certs
Apr 17 10:10:45 session DEBUG System timezone is Europe/London
Apr 17 10:10:45 testrun DEBUG Loading devices from local/devices
Apr 17 10:10:45 testrun DEBUG Loading test reports for device Tridium JACE 8000
Apr 17 10:10:46 testrun DEBUG Loaded device Tridium JACE 8000 with MAC address 94:a9:a8:dc:94:3e
Apr 17 10:10:46 testrun DEBUG Loading test reports for device EasyIO SystemView 7
Apr 17 10:10:46 testrun DEBUG Loaded device EasyIO SystemView 7 with MAC address 1c:ca:e3:8f:4c:32
Apr 17 10:10:46 testrun DEBUG Loading test reports for device iSMA iSMA-B-MIX18-IP
Apr 17 10:10:46 testrun DEBUG Loaded device iSMA iSMA-B-MIX18-IP with MAC address 00:1e:c0:fc:7d:d5
Apr 17 10:10:46 testrun DEBUG Loading test reports for device Axis M3057-PLR
Apr 17 10:10:46 testrun DEBUG Loaded device Axis M3057-PLR with MAC address bb:bb:bb:bb:bb:bb
Apr 17 10:10:46 testrun DEBUG Loading test reports for device Smart Tech SBID-6286S-V3
Apr 17 10:10:46 testrun DEBUG Loaded device Smart Tech SBID-6286S-V3 with MAC address 00:02:75:e2:25:c3
Apr 17 10:10:46 testrun DEBUG Loading test reports for device Distech Controls ECY-450
Apr 17 10:10:46 testrun DEBUG Loaded device Distech Controls ECY-450 with MAC address 90:06:f2:16:c4:b6
Apr 17 10:10:46 testrun DEBUG Loading test reports for device Crestron DM-NVX-351
Apr 17 10:10:46 testrun DEBUG Loaded device Crestron DM-NVX-351 with MAC address c4:42:68:63:93:46
Apr 17 10:10:46 testrun DEBUG Loading test reports for device Tridium JACE 9000
Apr 17 10:10:46 testrun DEBUG Loaded device Tridium JACE 9000 with MAC address 00:01:f0:96:aa:97
Apr 17 10:10:46 testrun DEBUG Loading test reports for device Crestron UC-CX100-T
Apr 17 10:10:46 testrun DEBUG Loaded device Crestron UC-CX100-T with MAC address 90:8d:6e:95:90:4f
Apr 17 10:10:46 test_orc DEBUG Starting test orchestrator
Apr 17 10:10:46 test_orc DEBUG Loading test modules from /modules/test
Apr 17 10:10:46 test_orc INFO Loaded the following test modules: protocol services conn tls dns ntp baseline
Apr 17 10:10:46 testrun INFO Stopping websockets server
Apr 17 10:10:47 testrun INFO Starting WS server
Apr 17 10:10:51 testrun INFO Stopping user interface
Apr 17 10:10:51 testrun INFO Starting UI
Apr 17 10:10:54 testrun INFO User interface is ready on http://localhost:8080
Apr 17 10:10:54 api INFO Starting API
Apr 17 10:10:54 api INFO API waiting for requests
Apr 17 10:10:59 session DEBUG Network adapters change detected: {'adapters_added': {'enp7s0': 'b8:2a:72:9b:9a:9b'}}
Apr 17 10:11:08 api DEBUG Received reports list request
Apr 17 10:11:09 api DEBUG Latest version available is 2.1.1
Apr 17 10:11:09 api DEBUG The latest version is installed
Apr 17 10:11:09 api DEBUG Received certs list request
Apr 17 10:11:09 session DEBUG Loading certificates from local/root_certs
Apr 17 10:11:09 api DEBUG Received reports list request
Apr 17 10:11:09 api DEBUG Received reports list request
Apr 17 10:11:36 api DEBUG Received reports list request
Apr 17 10:16:39 api DEBUG Received reports list request
Apr 17 10:16:44 api DEBUG Received get report request for EasyIO SystemView 7 / 2024-10-15T17:09:08
Apr 17 10:16:53 api DEBUG Received get results request for EasyIO SystemView 7 / 2024-10-15T17:09:08
Apr 17 10:16:53 test_orc DEBUG Archiving test results
Apr 17 10:16:57 test_orc INFO Archive created at /tmp/testrun/2024-10-15T17:09:08.zip
Run time of job "NetworkOrchestrator.network_adapters_checker (trigger: interval[0:00:05], next run at: 2025-04-17 10:16:59 BST)" was missed by 0:00:02.794027
Apr 17 10:22:05 api DEBUG Received reports list request
Apr 17 10:22:24 api DEBUG Received get results request for EasyIO SystemView 7 / 2024-10-17T11:17:01
Apr 17 10:22:24 test_orc DEBUG Archiving test results
Apr 17 10:22:26 test_orc INFO Archive created at /tmp/testrun/2024-10-17T11:17:01.zip
Run time of job "NetworkOrchestrator.network_adapters_checker (trigger: interval[0:00:05], next run at: 2025-04-17 10:22:29 BST)" was missed by 0:00:02.269198
Apr 17 10:23:20 api DEBUG Received device edit request
Apr 17 10:23:20 testrun DEBUG Loading test reports for device Easy IO SystemView 7
Apr 17 10:23:37 api DEBUG Received reports list request
Apr 17 10:23:43 api DEBUG Received get results request for EasyIO SystemView 7 / 2024-10-17T11:17:01
Apr 17 10:23:43 test_orc DEBUG Archiving test results
Apr 17 10:23:46 test_orc INFO Archive created at /tmp/testrun/2024-10-17T11:17:01.zip
Run time of job "NetworkOrchestrator.network_adapters_checker (trigger: interval[0:00:05], next run at: 2025-04-17 10:23:49 BST)" was missed by 0:00:01.640552
Run time of job "NetworkOrchestrator.internet_conn_checker (trigger: interval[0:00:02], next run at: 2025-04-17 10:23:46 BST)" was missed by 0:00:01.640470
Apr 17 10:24:12 api DEBUG Received device edit request
Apr 17 10:24:12 testrun DEBUG Loading test reports for device Easy IOX SystemView 7
Apr 17 10:25:16 api DEBUG Received device edit request
Apr 17 10:25:16 testrun DEBUG Loading test reports for device EasyIO SystemView 7
Apr 17 10:26:05 api DEBUG Received reports list request
Apr 17 10:26:28 api DEBUG Received get report request for Distech Controls ECY-450 / 2025-03-17T16:40:26
Apr 17 10:26:57 api DEBUG Received get results request for Distech Controls ECY-450 / 2025-03-17T16:40:26
Apr 17 10:26:57 test_orc DEBUG Archiving test results
Apr 17 10:27:01 test_orc INFO Archive created at /tmp/testrun/2025-03-17T16:40:26.zip
Run time of job "NetworkOrchestrator.network_adapters_checker (trigger: interval[0:00:05], next run at: 2025-04-17 10:27:04 BST)" was missed by 0:00:01.688770
Environment (please provide the following information about your setup):
- OS: Ubuntu 24.04.2
- Version: 2.1.1 (modifications from official 2.1.1 release are as below)
- make/DEBIAN/control (Mod version number to append "-oss.1.0")
- resources/test_packs/qualification/config.json (Set tests to excluded/recommended/informational as appropriate)
- resources/devices/device_profile.json (Add custom questions)
Additional context
More than happy to facilitate a remote session if you want to inspect anything.