Scheduler Continuously running "Trying to resolve devices without name" #1251
Description
Is there an existing issue for this?
- I have searched the existing open and closed issues and I checked the docs https://jokob-sk.github.io/NetAlertX/
The issue occurs in the following browsers. Select at least 2.
- Firefox
- Chrome
- Edge
- Safari (unsupported) - PRs welcome
- N/A - This is an issue with the backend
Current Behavior
Log are showing scans for "Trying to resolve devices without name" every loop. It is happening every minute even though NSLOOKUP is configured "on_new_device".
This leave the interface sometimes unresponsive, especially if you are in settings.
09:26:14 ['[MAIN] Process: Idle']
09:26:14 ['[WF] get_new_app_events - new events count: 8']
09:26:14 ['[WF] Processing event with GUID d8df3c29-8b60-44e6-bfb0-005bcac31cb7']
09:26:14 ['[WF] Processing event with GUID 58856bce-c7ac-48bf-8307-09dc9a27ed75']
09:26:14 ['[WF] Processing event with GUID 82b5995b-b872-46fb-ad2b-fc29abbf834b']
09:26:14 ['[WF] Processing event with GUID 0eca4b5c-3803-4f9d-a166-478dcc1d4b57']
09:26:14 ['[WF] Processing event with GUID 6a797c14-6710-48d8-a680-731d3880606a']
09:26:14 ['[WF] Processing event with GUID 9ec1b305-3b4d-4742-9fcb-2e4d29b825dd']
09:26:14 ['[WF] Processing event with GUID 8af4eb12-7203-409f-b729-eee3f53e6bff']
09:26:14 ['[WF] Processing event with GUID 903724e9-7079-4761-b5ec-c4231c9a1366']
09:26:22 [Scheduler] run for SNMPDSC: NO
09:26:22 [Scheduler] run for DHCPSRVS: NO
09:26:22 [Scheduler] run for CSVBCKP: NO
09:26:22 [Scheduler] run for DBCLNP: NO
09:26:22 [Scheduler] run for MAINT: NO
09:26:22 [Scheduler] run for VNDRPDT: NO
09:26:22 [Update Device Name] Trying to resolve devices without name. Unknown devices count: 2005
09:27:20 [Update Device Name] Names Found (DiG/mDNS/NSLOOKUP/NBTSCAN): 0 (0/0/0/0)
09:27:20 [Update Device Name] Names Not Found : 2005
09:27:20 ['[Notification] Check if something to report']
09:27:20 ['[Notification] Included sections: ', ['new_devices']]
09:27:20 ['[Notification] No changes to report']
09:27:20 ['[MAIN] Process: Idle']
09:27:20 ['[WF] get_new_app_events - new events count: 0']
09:27:28 [Scheduler] run for SNMPDSC: NO
09:27:28 [Scheduler] run for DHCPSRVS: NO
09:27:28 [Scheduler] run for CSVBCKP: NO
09:27:28 [Scheduler] run for DBCLNP: NO
09:27:28 [Scheduler] run for MAINT: NO
09:27:28 [Scheduler] run for VNDRPDT: NO
09:27:28 [Update Device Name] Trying to resolve devices without name. Unknown devices count: 2005
09:28:25 [Update Device Name] Names Found (DiG/mDNS/NSLOOKUP/NBTSCAN): 0 (0/0/0/0)
09:28:25 [Update Device Name] Names Not Found : 2005
09:28:25 ['[Notification] Check if something to report']
09:28:25 ['[Notification] Included sections: ', ['new_devices']]
09:28:25 ['[Notification] No changes to report']
09:28:25 ['[MAIN] Process: Idle']
09:28:25 ['[WF] get_new_app_events - new events count: 0']
09:28:31 ['[Version check] Running the latest version.']
09:28:33 [Scheduler] run for SNMPDSC: NO
09:28:33 [Scheduler] run for DHCPSRVS: NO
09:28:33 [Scheduler] run for CSVBCKP: NO
09:28:33 [Scheduler] run for DBCLNP: NO
09:28:33 [Scheduler] run for MAINT: NO
09:28:33 [Scheduler] run for VNDRPDT: NO
09:28:33 [Update Device Name] Trying to resolve devices without name. Unknown devices count: 2005
09:29:17 [Update Device Name] Names Found (DiG/mDNS/NSLOOKUP/NBTSCAN): 0 (0/0/0/0)
09:29:17 [Update Device Name] Names Not Found : 2005
09:29:17 ['[Notification] Check if something to report']
09:29:17 ['[Notification] Included sections: ', ['new_devices']]
09:29:17 ['[Notification] No changes to report']
09:29:17 ['[MAIN] Process: Idle']
Expected Behavior
Run only after new devices found
Steps To Reproduce
- Configure to only run SNMB plugin and NSLOOKUP.
- Set NSLOOKUP to on_new_device
- Have thousands of devices in a scan.
app.conf
# General
#---------------------------
LOADED_PLUGINS=['ARPSCAN','AVAHISCAN','CSVBCKP','DBCLNP','DIGSCAN','INTRNT','MAINT','NEWDEV','NBTSCAN','NSLOOKUP','NTFPRCS','SETPWD','SMTP','SYNC','VNDRPDT','WORKFLOWS','UI','CUSTPROP','DHCPSRVS','SNMPDSC','ICMP','WEBHOOK']
DISCOVER_PLUGINS=False
SCAN_SUBNETS=['--localnet']
LOG_LEVEL='minimal'
TIMEZONE='America/Los_Angeles'
PLUGINS_KEEP_HIST=250
REPORT_DASHBOARD_URL='http://netalertx-dov4.domain.net'
DAYS_TO_KEEP_EVENTS=90
HRS_TO_KEEP_NEWDEV=0
HRS_TO_KEEP_OFFDEV=0
CLEAR_NEW_FLAG=0
REFRESH_FQDN=False
API_CUSTOM_SQL='SELECT * FROM Devices WHERE devPresentLastScan = 0'
VERSION='1761666775'
NETWORK_DEVICE_TYPES=['AP','Access Point','Gateway','Firewall','Hypervisor','Powerline','Switch','WLAN','PLC','Router','USB LAN Adapter','USB WIFI Adapter','Internet']
GRAPHQL_PORT=20212
API_TOKEN='t_asdfasdfasdfasdfasdf'
# UI
#---------------------------
UI_LANG='English'
UI_NOT_RANDOM_MAC=[]
UI_ICONS=['PGkgY2xhc3M9ImZhIGZhLWNvbXB1dGVyIj48L2k+','PGkgY2xhc3M9ImZhIGZhLWV0aGVybmV0Ij48L2k+','PGkgY2xhc3M9ImZhIGZhLWdsb2JlIj48L2k+','PGkgY2xhc3M9ImZhIGZhLWxhcHRvcCI+PC9pPg==','PGkgY2xhc3M9ImZhIGZhLWxpZ2h0YnVsYiI+PC9pPg==','PGkgY2xhc3M9ImZhIGZhLXNoaWVsZCI+PC9pPg==','PGkgY2xhc3M9ImZhIGZhLXdpZmkiPjwvaT4=','PGkgY2xhc3M9ImZhIGZhLWdhbWVwYWQiPjwvaT4=','PGkgY2xhc3M9ImZhIGZhLWdhbWVwYWQiPjwvaT4=']
UI_REFRESH=0
UI_DEV_SECTIONS=[]
UI_PRESENCE=['online','down','offline','archived']
UI_MY_DEVICES=['online','offline','archived','new','down']
UI_device_columns=['Device_TableHead_Icon','Device_TableHead_Name','Device_TableHead_Type','Device_TableHead_LastIP','Device_TableHead_Status','Device_TableHead_MAC_full','Device_TableHead_SourcePlugin','Device_TableHead_CustomProps']
UI_columns_filters=['Device_TableHead_Type','Device_TableHead_SyncHubNodeName','Device_TableHead_SourcePlugin']
UI_shown_cards=['my_devices','connected','favorites','new','down','archived']
UI_hide_rel_types=['nic','virtual']
UI_hide_empty=True
UI_theme=['Dark']
UI_TOPOLOGY_ORDER=['Name']
# SNMPDSC
#---------------------------
SNMPDSC_RUN='schedule'
SNMPDSC_CMD='python3 /app/front/plugins/snmp_discovery/script.py routers={s-quote}{routers}{s-quote}'
SNMPDSC_routers=['snmpwalk -c Password -OXsq -v 2c 10.1.1.1 .1.3.6.1.2.1.4.22.1.2']
SNMPDSC_RUN_SCHD='*/20 * * * *'
SNMPDSC_RUN_TIMEOUT=180
SNMPDSC_WATCH=['Watched_Value1']
SNMPDSC_REPORT_ON=['new','watched-changed']
# ARPSCAN
#---------------------------
ARPSCAN_RUN='disabled'
ARPSCAN_CMD='python3 /app/front/plugins/arp_scan/script.py userSubnets={subnets}'
ARPSCAN_RUN_TIMEOUT=900
ARPSCAN_RUN_SCHD='0 */12 * * *'
ARPSCAN_WATCH=['Watched_Value1','Watched_Value2']
ARPSCAN_REPORT_ON=['new']
ARPSCAN_ARGS='sudo arp-scan --ignoredups --retry=6'
# AVAHISCAN
#---------------------------
AVAHISCAN_RUN='disabled'
AVAHISCAN_CMD='python3 /app/front/plugins/avahi_scan/avahi_scan.py'
AVAHISCAN_RUN_SCHD='*/30 * * * *'
AVAHISCAN_RUN_TIMEOUT=10
# DHCPSRVS
#---------------------------
DHCPSRVS_RUN='schedule'
DHCPSRVS_CMD='python3 /app/front/plugins/dhcp_servers/script.py'
DHCPSRVS_RUN_SCHD='* */8 * * *'
DHCPSRVS_RUN_TIMEOUT=20
DHCPSRVS_WATCH=['Watched_Value1']
DHCPSRVS_REPORT_ON=['new','watched-changed']
# INTRNT
#---------------------------
INTRNT_RUN='disabled'
INTRNT_CMD='python3 /app/front/plugins/internet_ip/script.py prev_ip={prev_ip} INTRNT_DIG_GET_IP_ARG={INTRNT_DIG_GET_IP_ARG}'
INTRNT_DIG_GET_IP_ARG='-4 myip.opendns.com @resolver1.opendns.com'
INTRNT_RUN_SCHD='*/5 * * * *'
INTRNT_RUN_TIMEOUT=30
INTRNT_RETRIES=3
INTRNT_WATCH=['Watched_Value1']
INTRNT_REPORT_ON=['new','watched-changed']
# NBTSCAN
#---------------------------
NBTSCAN_RUN='disabled'
NBTSCAN_CMD='python3 /app/front/plugins/nbtscan_scan/nbtscan.py'
NBTSCAN_RUN_SCHD='*/30 * * * *'
NBTSCAN_RUN_TIMEOUT=10
# ICMP
#---------------------------
ICMP_RUN='disabled'
ICMP_CMD='python3 /app/front/plugins/icmp_scan/icmp.py'
ICMP_ARGS='-i 0.5 -c 3 -W 4 -w 5'
ICMP_IN_REGEX='.*'
ICMP_RUN_SCHD='* */12 * * *'
ICMP_RUN_TIMEOUT=10
# NSLOOKUP
#---------------------------
NSLOOKUP_RUN='before_name_updates'
NSLOOKUP_CMD='python3 /app/front/plugins/nslookup_scan/nslookup.py'
NSLOOKUP_RUN_SCHD='* */12 * * *'
NSLOOKUP_RUN_TIMEOUT=10
# DIGSCAN
#---------------------------
DIGSCAN_RUN='disabled'
DIGSCAN_CMD='python3 /app/front/plugins/dig_scan/digscan.py'
DIGSCAN_RUN_SCHD='*/30 * * * *'
DIGSCAN_RUN_TIMEOUT=5
# SMTP
#---------------------------
SMTP_RUN='disabled'
SMTP_CMD='python3 /app/front/plugins/_publisher_email/email_smtp.py'
SMTP_RUN_TIMEOUT=20
SMTP_SERVER='smtp.gmail.com'
SMTP_PORT=587
SMTP_SKIP_LOGIN=False
SMTP_USER='user@gmail.com'
SMTP_PASS='password'
SMTP_SKIP_TLS=False
SMTP_FORCE_SSL=False
SMTP_REPORT_TO='user@gmail.com'
SMTP_REPORT_FROM='NetAlertX <user@gmail.com>'
SMTP_SUBJECT='NetAlertX Report'
# WEBHOOK
#---------------------------
WEBHOOK_RUN='on_notification'
WEBHOOK_CMD='python3 /app/front/plugins/_publisher_webhook/webhook.py'
WEBHOOK_RUN_TIMEOUT=10
WEBHOOK_URL='asdf'
WEBHOOK_PAYLOAD='text'
WEBHOOK_REQUEST_METHOD='POST'
WEBHOOK_SIZE=4000
WEBHOOK_SECRET=''
# CSVBCKP
#---------------------------
CSVBCKP_RUN='schedule'
CSVBCKP_CMD='python3 /app/front/plugins/csv_backup/script.py overwrite={overwrite} location={location}'
CSVBCKP_RUN_SCHD='0 2 * * *'
CSVBCKP_RUN_TIMEOUT=30
CSVBCKP_overwrite=True
CSVBCKP_location='/app/config'
# CUSTPROP
#---------------------------
CUSTPROP_icon=['PGkgY2xhc3M9ImZhcyBmYS10cmFzaC1hbHQiPjwvaT4=','PGkgY2xhc3M9ImZhcyBmYS1leHRlcm5hbC1saW5rLWFsdCI+PC9pPg==','PGkgY2xhc3M9ImZhcyBmYS1hcnJvdy1yaWdodCI+PC9pPg==','PGkgY2xhc3M9ImZhcyBmYS1zZWFyY2giPjwvaT4=','PGkgY2xhc3M9ImZhcyBmYS1jb2dzIj48L2k+','PGkgY2xhc3M9ImZhcyBmYS1leWUiPjwvaT4=','PGkgY2xhc3M9ImZhcyBmYS1kYXRhYmFzZSI+PC9pPg==']
CUSTPROP_type=['none','data','link','link_new_tab','show_notes','delete_dev','run_plugin']
CUSTPROP_args=''
CUSTPROP_name=''
CUSTPROP_notes=''
CUSTPROP_show=True
CUSTPROP_actions=''
# DBCLNP
#---------------------------
DBCLNP_RUN='schedule'
DBCLNP_CMD='python3 /app/front/plugins/db_cleanup/script.py'
DBCLNP_RUN_SCHD='*/30 * * * *'
DBCLNP_RUN_TIMEOUT=300
DBCLNP_NOTIFI_HIST=100
# MAINT
#---------------------------
MAINT_RUN='schedule'
MAINT_CMD='python3 /app/front/plugins/maintenance/maintenance.py'
MAINT_RUN_SCHD='0 2 * * *'
MAINT_RUN_TIMEOUT=300
MAINT_LOG_LENGTH=250000
MAINT_NOTI_LENGTH=0
# NEWDEV
#---------------------------
NEWDEV_ignored_MACs=[]
NEWDEV_ignored_IPs=['10.212.%','10.227.%','10.225.%']
NEWDEV_NAME_CLEANUP_REGEX=['XC5fYWlycGxheQ==','XC5fdGNw','XC5sb2NhbGRvbWFpbg==','XC5sb2NhbA==','XC5fZXNwaG9tZWxpYg==','XC5fZ29vZ2xlY2FzdA==','XC5sYW4=','XC5ob21l','LVthLWZBLUYwLTldezMyfQ==','Iy4q','XC5cYg==']
NEWDEV_replace_preset_icon=False
NEWDEV_devMac=''
NEWDEV_devLastIP=''
NEWDEV_devName='(unknown)'
NEWDEV_devIcon='PGkgY2xhc3M9ImZhIGZhLWNvbXB1dGVyIj48L2k+'
NEWDEV_devOwner=''
NEWDEV_devType=''
NEWDEV_devVendor=''
NEWDEV_devFavorite=0
NEWDEV_devGroup=''
NEWDEV_devLocation=''
NEWDEV_devComments=''
NEWDEV_devFirstConnection=''
NEWDEV_devLastConnection=''
NEWDEV_devStaticIP=1
NEWDEV_devScan=1
NEWDEV_devLogEvents=1
NEWDEV_devAlertEvents=1
NEWDEV_devAlertDown=0
NEWDEV_devSkipRepeated='1'
NEWDEV_devLastNotification=''
NEWDEV_devPresentLastScan=1
NEWDEV_devIsNew=1
NEWDEV_devIsArchived=0
NEWDEV_devParentMAC='00:08:32:AE:64:4B'
NEWDEV_devParentRelType=[]
NEWDEV_devParentPort='0'
NEWDEV_devChildrenDynamic=[]
NEWDEV_devSSID=''
NEWDEV_devSite=''
NEWDEV_devSyncHubNode=''
NEWDEV_devCustomProps='W1t7IkNVU1RQUk9QX2ljb24iOiJQR2tnWTJ4aGMzTTlJbVpoY3lCbVlTMTBjbUZ6YUMxaGJIUWlQand2YVQ0PSJ9LHsiQ1VTVFBST1BfdHlwZSI6ImRlbGV0ZV9kZXYifSx7IkNVU1RQUk9QX25hbWUiOiIifSx7IkNVU1RQUk9QX2FyZ3MiOiJEZWxldGUgZGV2aWNlIn0seyJDVVNUUFJPUF9ub3RlcyI6IiJ9LHsiQ1VTVFBST1Bfc2hvdyI6dHJ1ZX1dXQ=='
NEWDEV_devFQDN=''
NEWDEV_devReqNicsOnline=0
NEWDEV_devChildrenNicsDynamic=[]
# NTFPRCS
#---------------------------
NTFPRCS_INCLUDED_SECTIONS=['new_devices']
NTFPRCS_alert_down_time=120
NTFPRCS_new_dev_condition='AND devLastIP NOT LIKE {s-quote}10.212.%{s-quote}'
NTFPRCS_event_condition=''
# SETPWD
#---------------------------
SETPWD_enable_password=True
SETPWD_password='hunter2'
# SYNC
#---------------------------
SYNC_RUN='unused'
SYNC_RUN_SCHD='*/5 * * * *'
SYNC_encryption_key=''
SYNC_nodes=[]
SYNC_hub_url=''
SYNC_node_name=''
SYNC_devices=False
SYNC_plugins=[]
SYNC_CMD='python3 /app/front/plugins/sync/sync.py'
SYNC_RUN_TIMEOUT=30
# VNDRPDT
#---------------------------
VNDRPDT_RUN='schedule'
VNDRPDT_CMD='python3 /app/front/plugins/vendor_update/script.py'
VNDRPDT_RUN_SCHD='0 4 * * 3'
VNDRPDT_RUN_TIMEOUT=600
VNDRPDT_WATCH=['Watched_Value1']
VNDRPDT_REPORT_ON=['new','watched-changed']
# WORKFLOWS
#---------------------------
WORKFLOWS_AppEvents_hist=100docker-compose.yml
services:
netalertx-dov4:
container_name: netalertx-dov4
hostname: netalertx-dov4
# use the below line if you want to test the latest dev image
# image: "ghcr.io/jokob-sk/netalertx-dev:latest"
image: "ghcr.io/jokob-sk/netalertx:latest"
networks:
10.1.1.1_net:
ipv4_address: 10.1.3.102
restart: unless-stopped
volumes:
- ./netalertx-dv1/config:/app/config
- ./netalertx-dv1/db:/app/db
# (optional) useful for debugging if you have issues setting up the container
- ./netalertx-dv1/logs:/app/log
# (API: OPTION 1) use for performance
- type: tmpfs
target: /app/api
# (API: OPTION 2) use when debugging issues
# - local_path/api:/app/api
environment:
- TZ=America/Los_Angeles
- PORT=80
networks:
10.1.1.1_net:
external: true
name: 10.1.1.1_netWhat installation are you running?
Production (netalertx)
app.log
No response
Debug enabled
- I have read and followed the steps in the wiki link above and provided the required debug logs and the log section covers the time when the issue occurs.