Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Issue with the API function flowdevices/stats.lua #8824

Open
earendilfr opened this issue Nov 20, 2024 · 0 comments
Open

Issue with the API function flowdevices/stats.lua #8824

earendilfr opened this issue Nov 20, 2024 · 0 comments

Comments

@earendilfr
Copy link

Environment:

  • OS name: RHEL/Docker
  • OS version: 8.9/24.0.7
  • Architecture: amd64
  • ntopng version/revision: ntopng Enterprise L v.6.2.241025 rev.24629

What happened:
When I try to use the API call /lua/pro/rest/v2/get/flowdevices/stats.lua, I didn't receive anything now (I remember it's working prior upgrade to version 6.0).

The output is:

$  curl -v -k -H 'authorization: Token xxxxx' -H 'content-type: application/json' https://server/lua/pro/rest/v2/get/flowdevices/stats.lua
*   Trying <ip>...
* TCP_NODELAY set
[...]
> GET /lua/pro/rest/v2/get/flowdevices/stats.lua HTTP/2
> Host: server
> User-Agent: curl/7.61.1
> Accept: */*
> authorization: Token xxxxx
> content-type: application/json
>
* TLSv1.3 (IN), TLS handshake, [no content] (0):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.3 (IN), TLS handshake, [no content] (0):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.3 (IN), TLS app data, [no content] (0):
* Connection state changed (MAX_CONCURRENT_STREAMS == 128)!
* TLSv1.3 (OUT), TLS app data, [no content] (0):
* TLSv1.3 (IN), TLS app data, [no content] (0):
< HTTP/2 302
< server: nginx/1.14.1
< date: Wed, 20 Nov 2024 16:31:44 GMT
< set-cookie: session=; HttpOnly; path=/; HttpOnly; SameSite=lax
< location: /lua/http_status_code.lua?message=not_found&referer=server%2Flua%2Fpro%2Frest%2Fv2%2Fget%2Fflowdevices%2Fstats.lua&error_message=
<

* Connection #0 to host server left intact

Debug Information:

Paste debug information below:

  • Copy the service log from "systemctl status ntopng" or "journalctl -u ntopng".
docker logs ntopng
Starting redis-server: redis-server.
20/Nov/2024 16:19:22 [Prefs.cpp:1667] ntopng will use redis localhost@0
20/Nov/2024 16:19:22 [Redis.cpp:166] Successfully connected to redis localhost:6379@0
20/Nov/2024 16:19:22 [Redis.cpp:166] Successfully connected to redis localhost:6379@0
20/Nov/2024 16:19:22 [NtopPro.cpp:348] [LICENSE] Reading license from /etc/ntopng.license
20/Nov/2024 16:19:22 [NtopPro.cpp:506] [LICENSE] /etc/ntopng.license: found valid Enterprise L license
20/Nov/2024 16:19:24 [Ntop.cpp:2839] Registered interface 'tcp://127.0.0.1:5556c' [id: 33]
20/Nov/2024 16:19:24 [main.cpp:373] PID stored in file /var/run/ntopng.pid
20/Nov/2024 16:19:24 [Geolocation.cpp:172] Loaded database dbip-asn-lite.mmdb [/usr/share/ntopng/httpdocs/geoip//dbip-asn-lite.mmdb][ip_version: 6]
20/Nov/2024 16:19:24 [Geolocation.cpp:172] Loaded database dbip-city-lite.mmdb [/usr/share/ntopng/httpdocs/geoip//dbip-city-lite.mmdb][ip_version: 6]
20/Nov/2024 16:19:24 [Geolocation.cpp:111] Using geolocation provided by DB-IP (https://db-ip.com)
20/Nov/2024 16:19:24 [Utils.cpp:3941] WARNING: Capabilities cap_set_proc error: Operation not permitted
20/Nov/2024 16:19:24 [Utils.cpp:811] WARNING: Unable to retain privileges for privileged file writing
20/Nov/2024 16:19:24 [Utils.cpp:857] User changed to ntopng
20/Nov/2024 16:19:24 [HTTPserver.cpp:1652] Found TLS certificate /usr/share/ntopng/httpdocs/ssl/ntopng-cert.pem
20/Nov/2024 16:19:24 [Utils.cpp:3997] WARNING: Capabilities cap_set_proc error: Operation not permitted [enable: 1]
20/Nov/2024 16:19:24 [HTTPserver.cpp:1899] ERROR: Unable to enable capabilities
20/Nov/2024 16:19:24 [HTTPserver.cpp:1954] Web server dirs [/usr/share/ntopng/httpdocs][/usr/share/ntopng/scripts]
20/Nov/2024 16:19:24 [HTTPserver.cpp:1959] HTTP server listening on 3000
20/Nov/2024 16:19:24 [NetworkInterface.cpp:3689] Started flow dump loop on interface tcp://127.0.0.1:5556c [id: 33]...
20/Nov/2024 16:19:24 [MySQLDB.cpp:949] Successfully connected to ClickHouse [[email protected]:9004][dbname: <no db>] for interface tcp://127.0.0.1:5556c
20/Nov/2024 16:19:24 [ClickHouseFlowDB.cpp:74] [ClickHouse] Creating ClickHouse Flow DB
20/Nov/2024 16:19:24 [ClickHouseFlowDB.cpp:145] [ClickHouse] Database created
20/Nov/2024 16:19:24 [ClickHouseFlowDB.cpp:43] ClickHouse will dump into /var/lib/ntopng/tmp/clickhouse
20/Nov/2024 16:19:24 [NetworkInterface.cpp:3568] Started flow user script hooks loop on interface 'tcp://127.0.0.1:5556c' [id: 33]...
20/Nov/2024 16:19:24 [main.cpp:463] Working directory: /var/lib/ntopng
20/Nov/2024 16:19:24 [NetworkInterface.cpp:3627] Started host user script hooks loop on interface 'tcp://127.0.0.1:5556c' [id: 33]...
20/Nov/2024 16:19:24 [main.cpp:465] Scripts/HTML pages directory: /usr/share/ntopng
20/Nov/2024 16:19:24 [Ntop.cpp:553] Welcome to ntopng x86_64 v.6.2.241025 (6.2-stable:7ac2e318cdc24b70124c9fb1c32e0d7bfd1ee41b:20241025)
20/Nov/2024 16:19:24 [Ntop.cpp:562] Built on Ubuntu 24.04.1 LTS
20/Nov/2024 16:19:24 [Ntop.cpp:564] (C) 1998-24 ntop
20/Nov/2024 16:19:24 [NtopPro.cpp:933] [LICENSE] System Id:     yyyyyyyyyyyy
20/Nov/2024 16:19:24 [NtopPro.cpp:935] [LICENSE] Edition:       Enterprise L
20/Nov/2024 16:19:24 [NtopPro.cpp:937] [LICENSE] Lic. Type:     Permanent License
20/Nov/2024 16:19:24 [NtopPro.cpp:954] [LICENSE] License:       zzzzzz
20/Nov/2024 16:19:24 [NtopPro.cpp:975] [LICENSE] Mainten.:      Until Mon Jun  8 17:41:01 2026 [565 days left]
20/Nov/2024 16:19:24 [MySQLDB.cpp:949] Successfully connected to ClickHouse [[email protected]:9004][dbname: <no db>] for interface __system__
20/Nov/2024 16:19:25 [PeriodicActivities.cpp:122] Started periodic activities loop...
20/Nov/2024 16:19:25 [startup.lua:37] Processing startup.lua: please hold on...
20/Nov/2024 16:19:25 [startup.lua:41] [startup.lua:27] Started Top Sites aggregation
20/Nov/2024 16:19:25 [startup.lua:41] [startup.lua:30] Top Sites aggregation done
20/Nov/2024 16:19:25 [startup.lua:41] [clickhouse_retention.lua:69] Performing Clickhouse cleanup
20/Nov/2024 16:19:25 [startup.lua:41] [clickhouse_retention.lua:96] Clickhouse cleanup completed
20/Nov/2024 16:19:25 [startup.lua:41] [asset_inventory.lua:49] [Asset Inventory] Initalization...
20/Nov/2024 16:19:25 [startup.lua:41] [asset_inventory_db.lua:23] [Asset Inventory DB] Initialization completed
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:803] Refreshing category lists...                                                                                                                                         [251/1891]Unable to open file /etc/ntopng/protos [Permission denied]
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded Abuse.ch URLhaus: 255 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded Emerging Threats: 1401 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded IPsum Threat Intelligence Feed: 23801 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded NoCoin Filter List: 409 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded SSLBL Botnet C2 IP Blacklist: 41 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded Stratosphere Lab: 12407 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded ThreatFox: 10651 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:594] Loaded dshield 7 days: 29 rules
20/Nov/2024 16:19:26 [startup.lua:123] [lists_utils.lua:700] Loaded Category Lists (11315 hosts, 37679 IPs) loaded in 0 sec
20/Nov/2024 16:19:26 [startup.lua:127] Initializing device polices...
20/Nov/2024 16:19:26 [startup.lua:143] Initializing alerts...
20/Nov/2024 16:19:26 [startup.lua:152] Initializing timeseries...
20/Nov/2024 16:19:26 [startup.lua:210] Importing ClickHouse dumps...
20/Nov/2024 16:19:26 [startup.lua:253] Completed startup.lua
20/Nov/2024 16:19:26 [FlowChecksLoader.cpp:297] WARNING: Unable to find flow check 'remote_to_local_insecure_proto': skipping it
20/Nov/2024 16:19:26 [NetworkInterface.cpp:3804] Started packet polling on interface 'tcp://127.0.0.1:5556c' [id: 33]...
20/Nov/2024 16:19:27 [ZMQCollectorInterface.cpp:261] Collecting flows on tcp://127.0.0.1:5556c
snmp_sess_send: Timeout
20/Nov/2024 16:20:07 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:14 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:20 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:27 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:37 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:43 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:49 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:20:55 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:25:08 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:25:14 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:25:20 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:25:26 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:25:36 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:25:42 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:25:48 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 16:25:54 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:30:07 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:30:13 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:30:20 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:30:20 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:30:30 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 16:30:37 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:30:43 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:30:49 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:30:55 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 16:35:07 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:35:13 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:35:19 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:35:27 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 16:35:36 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:35:42 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 16:35:48 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:35:54 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:40:06 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:40:13 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:40:20 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 16:40:28 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:40:36 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:40:42 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:40:48 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 16:40:54 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:45:06 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:45:13 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:45:19 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:45:27 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:45:35 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 16:45:41 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
[...]
20/Nov/2024 17:25:43 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:25:49 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:25:55 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:30:06 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:30:13 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 17:30:19 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:30:27 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:30:35 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 17:30:41 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:30:48 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:30:54 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 17:35:06 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 17:35:14 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:35:20 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:35:28 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:35:36 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:35:42 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:35:48 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:35:54 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:40:07 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:40:13 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:40:19 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:40:27 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:40:35 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
20/Nov/2024 17:40:41 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
20/Nov/2024 17:40:47 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
snmp_sess_send: Timeout
snmp_sess_send: Timeout
20/Nov/2024 17:40:53 [SNMP.cpp:567] WARNING: SNMP send error [rc: 0]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@earendilfr