-
Notifications
You must be signed in to change notification settings - Fork 33
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Hi @grafnu @spectre-storm and @henry54809.
There is a bug that has been introduced recently that prevents DAQ from starting any test.
It appears since the first time DAQ is run and it also persists in switch configuration mode (tested both on Cisco and AT switches).
See below the run time cli log.
The same error has been experienced by Forest Rock.
The error is shown as this:
...
ERROR:host:Monitoring timeout for ipaddr after 120s
ERROR:host:Target port 1 monitor error: Timeout expired
...
ERROR:runner:Target port 1 active True exception: Timeout expired
...
Could you please have a look? Thanks.
Full log below.
Activating venv
No local/system.conf found, copying defaults from misc/system_base.conf...
Loading config from local/system.conf into inst/config/system.conf
Starting Tue 31 Mar 14:12:08 BST 2020
Clearing previous state...
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Release version 1.0.1
ovsdb-server is running with pid 413
ovs-vswitchd is running with pid 480
Creating mudacl templates...
> Task :compileJava UP-TO-DATE
> Task :processResources NO-SOURCE
> Task :classes UP-TO-DATE
> Task :shadowJar UP-TO-DATE
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 690ms
2 actionable tasks: 2 up-to-date
Running mudacl regression test...
Writing output files to /home/francesco/Code/daq/pisuke/daq/mudacl/out/acl_templates
Writing output files to /home/francesco/Code/daq/pisuke/daq/mudacl/out/port_acls
Compare out/acl_templates/ with setup/acl_templates/...
Compare out/port_acls/ with setup/port_acls/...
Activating venv
Loading config from local/system.conf into inst/config/system.conf
> Task :compileJava UP-TO-DATE
> Task :processResources NO-SOURCE
> Task :classes UP-TO-DATE
> Task :shadowJar UP-TO-DATE
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 703ms
2 actionable tasks: 2 up-to-date
Executing mudacl generator on mud_files/...
Writing output files to /home/francesco/Code/daq/pisuke/daq/inst/acl_templates
inst/acl_templates:
total 40
-rw-r--r-- 1 root root 540 Mar 31 14:12 template_bacnet_acl.yaml
-rw-r--r-- 1 root root 332 Mar 31 14:12 template_bacnet_frdev_acl.yaml
-rw-r--r-- 1 root root 332 Mar 31 14:12 template_bacnet_todev_acl.yaml
-rw-r--r-- 1 root root 768 Mar 31 14:12 template_baseline_acl.yaml
-rw-r--r-- 1 root root 1966 Mar 31 14:12 template_commissioning_acl.yaml
-rw-r--r-- 1 root root 1452 Mar 31 14:12 template_controller_acl.yaml
-rw-r--r-- 1 root root 78 Mar 31 14:12 template_default_acl.yaml
-rw-r--r-- 1 root root 1442 Mar 31 14:12 template_lightbulb_acl.yaml
-rw-r--r-- 1 root root 258 Mar 31 14:12 template_raw_acl.yaml
-rw-r--r-- 1 root root 496 Mar 31 14:12 template_telnet_acl.yaml
inst/port_acls:
total 0
No external switch configured.
Sourcing misc/startup_base.cmd...
DAQ autostart cmd/faux
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Launching faux ...
Clensing old container daq-faux
DAQ autoclean docker kill daq-faux
Removing old interface faux
Adding new interface to 15229...
Done with faux device launch.
Entering virtual python environment...
Using python3 at /home/francesco/Code/daq/pisuke/daq/venv/bin/python3
Executing: python3 -u daq/daq.py /home/francesco/Code/daq/pisuke/daq/local/system.conf -s
Prepending /home/francesco/Code/daq/pisuke/daq/binhack to PATH
processing arg: /home/francesco/Code/daq/pisuke/daq/local/system.conf
Reading config from /home/francesco/Code/daq/pisuke/daq/local/system.conf
Reading config from misc/system.conf
processing arg: -s
base_conf=misc/module_config.json
dhcp_lease_time=500s
initial_dhcp_lease_time=120s
intf_names=faux
long_dhcp_response_sec=80
run_mode=local
single_shot=True
site_description="Baseline Configuration"
site_path=local/site/
startup_cmds=misc/startup_base.cmd
INFO:daq:pid is 15317
INFO:gcp:No gcp_cred credential specified in config
INFO:config:Loading config from misc/module_config.json
INFO:config:Skipping missing local/site/module_config.json
INFO:runner:Reading test definition file misc/host_tests.conf
INFO:runner:Reading test definition file subset/pentests/build.conf
INFO:runner:Configured with tests ['pass', 'fail', 'ping', 'bacnet', 'mudgee', 'nmap', 'discover']
INFO:network:Activating faucet topology...
INFO:topology:No device_specs file specified, skipping...
INFO:topology:Writing network config to inst/faucet.yaml
INFO:topology:Starting faucet...
INFO:network:Creating ovs sec with dpid/port 2/7
INFO:network:Added switch link pri-eth1 <-> sec-eth7
INFO:network:Attaching device interface faux on port 1.
INFO:network:Attaching device interface sec-2 on port 2.
INFO:network:Attaching device interface sec-3 on port 3.
INFO:network:Attaching device interface sec-4 on port 4.
INFO:network:Attaching device interface sec-5 on port 5.
INFO:network:Attaching device interface sec-6 on port 6.
INFO:network:Starting mininet...
INFO:mininet:*** Configuring hosts
INFO:mininet:*** Starting controller
INFO:mininet:controller
INFO:mininet:*** Starting 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:...
INFO:runner:Waiting for system to settle...
INFO:runner:Entering main event loop.
INFO:runner:See docs/troubleshooting.md if this blocks for more than a few minutes.
INFO:runner:System port 7 on dpid 2 is active True
INFO:runner:Port 1 dpid 2 is now active True
INFO:runner:Port 1 dpid 2 learned 9a:02:57:1e:8f:00
INFO:runner:Gateway for device group 9a02571e8f00 not found, initializing base 1...
INFO:gateway:Initializing gateway 9a02571e8f00 as gw01/10
INFO:gateway:Added networking host gw01 on port 10 at 10.20.0.1
INFO:gateway:Added dummy target dummy01 on port 11 at 10.20.0.2
INFO:gateway:Gateway 1 startup capture gw01-eth0 in container's /tmp/gateway.pcap
INFO:dhcp:DHCP monitor gw01 waiting for replies...
INFO:runner:Test ping gw01->dummy01
INFO:runner:Test ping gw01->dummy01
INFO:runner:Test ping dummy01->gw01
INFO:runner:Test ping dummy01->192.168.84.1
INFO:runner:Test ping gw01->dummy01 from 192.168.84.1
INFO:gateway:Attaching target 1 to gateway group 9a02571e8f00
WARNING:host:Creating new device dir: /home/francesco/Code/daq/pisuke/daq/local/site/mac_addrs/9a02571e8f00
WARNING:host:Skipping defaults since no device_template found
INFO:config:Skipping missing /home/francesco/Code/daq/pisuke/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Skipping missing /home/francesco/Code/daq/pisuke/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:host:Device config reloaded: True 9a:02:57:1e:8f:00
INFO:config:Writing config to /home/francesco/Code/daq/pisuke/daq/local/site/mac_addrs/9a02571e8f00/aux/module_config.json
INFO:host:Host 1 running with enabled tests ['pass', 'fail', 'ping', 'nmap']
INFO:report:Creating report as inst/reports/report_9a02571e8f00_2020-03-31T131304+0000.md
INFO:report:Creating report as inst/reports/report_9a02571e8f00_2020-03-31T131304+0000.pdf
INFO:runner:Target port 1 registered 9a:02:57:1e:8f:00
INFO:host:Target port 1 initializing...
INFO:config:Skipping missing /home/francesco/Code/daq/pisuke/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:network:Creating mirror pair mirror-1 <-> mirror-1-ext at 1001
INFO:host:Target port 1 startup pcap capture
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: True
INFO:topology:Waiting 5s for network to settle
INFO:host:Target port 1 waiting for ip as 9a:02:57:1e:8f:00
INFO:host:Target port 1 using normal DHCP mode
ERROR:host:Monitoring timeout for ipaddr after 120s
ERROR:host:Target port 1 monitor error: Timeout expired
INFO:host:Target port 1 monitor scan complete
ERROR:runner:Target port 1 active True exception: Timeout expired
INFO:gateway:Detach target 1 from gateway group 9a02571e8f00
INFO:runner:Retiring target gateway 1, 9a:02:57:1e:8f:00, 9a02571e8f00, 1
INFO:gateway:Terminating gateway 1/9a02571e8f00
INFO:runner:Target port 1 finalize: ['01:ipaddr:TimeoutError'] (Timeout expired)
INFO:runner:Target port 1 cancel 9a:02:57:1e:8f:00 (#1/0).
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: False
INFO:topology:Waiting 5s for network to settle
INFO:host:Target port 1 terminate, running unknown, trigger False: _target_set_cancel
INFO:network:Deleting mirror pair mirror-1 <-> mirror-1-ext
WARNING:runner:Suppressing future tests because test done in single shot.
INFO:runner:Remaining target sets: []
INFO:stream:Monitoring 0 fds
WARNING:runner:No active ports remaining (0 monitors), ending test run.
INFO:runner:Stopping network...
INFO:mininet:*** Stopping 1 controllers
INFO:mininet:controller
INFO:mininet:*** Stopping 1 links
INFO:mininet:.
INFO:mininet:*** Stopping 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:*** Stopping 1 hosts
INFO:mininet:gw01
INFO:mininet:*** Done
INFO:runner:Done with runner.
INFO:daq:DAQ runner returned 0
Cleanup docker kill daq-faux
daq-faux
Done with run, exit 0
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working