Unable to get data from RuuviCollector to InfluxDB on Ubuntu

After I successfully managed to get RuuviCollector service running, this is all it says. Same stuff as it said before running as service (originally it ran in terminal)

This is from syslog

Dec 27 12:01:02 Jarno-Linux systemd[1]: Started Ruuvi Collector service[Service].
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.263 DEBUG [Config] Tag names: /home/eireannanl/Ruuvi/ruuvi-names.properties
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.265 DEBUG [Config] Config: /home/eireannanl/Ruuvi/ruuvi-collector.properties
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.283 DEBUG [Main] Starting scan with: [hcitool, lescan, --duplicates, --passive]
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 DEBUG [Main] Starting dump with: [hcidump, --raw]
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 INFO  [Main] BLE listener started successfully, waiting for data...
Dec 27 12:01:02 Jarno-Linux java[21221]:  If you don't get any data, check that you are able to run 'hcitool lescan' and 'hcidump --raw' without issues
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.668 INFO  [Main] Successfully reading data from hcidump

and this is from terminal with status command

 ruuvi-collector.service - Ruuvi Collector service[Service]
     Loaded: loaded (/etc/systemd/system/ruuvi-collector.service; static; vendor preset: enabled)
     Active: active (running) since Sun 2020-12-27 12:01:02 EET; 8min ago
   Main PID: 21221 (java)
      Tasks: 24 (limit: 18776)
     Memory: 55.5M
     CGroup: /system.slice/ruuvi-collector.service
             ├─21221 /usr/bin/java -jar /home/eireannanl/Ruuvi/ruuvi-collector-0.2.jar
             └─21266 hcidump --raw

joulu 27 12:01:02 Jarno-Linux systemd[1]: ruuvi-collector.service: Succeeded.
joulu 27 12:01:02 Jarno-Linux systemd[1]: Stopped Ruuvi Collector service[Service].
joulu 27 12:01:02 Jarno-Linux systemd[1]: Started Ruuvi Collector service[Service].
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.263 DEBUG [Config] Tag names: /home/eireannanl/Ruuvi/ruuvi-names.properties
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.265 DEBUG [Config] Config: /home/eireannanl/Ruuvi/ruuvi-collector.properties
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.283 DEBUG [Main] Starting scan with: [hcitool, lescan, --duplicates, --passive]
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 DEBUG [Main] Starting dump with: [hcidump, --raw]
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 INFO  [Main] BLE listener started successfully, waiting for data...
joulu 27 12:01:02 Jarno-Linux java[21221]:  If you don't get any data, check that you are able to run 'hcitool lescan' and 'hcidump --raw' without issues
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.668 INFO  [Main] Successfully reading data from hcidump

Anyway, I created that hcitool file (with “touch hcitool) and copied it to /usr/bin/ (backed up original one). It seems that there’s no change. Does it matter that files has different icons because of different filetype? “hcitool” is plain text document” while “hcitool.original” is shared library.image

Ps. I know that InfluxDB works as I get data from Telegraf (From both local and client)

I tried “storage.method=dummy” in “ruuvi-collector.properties” but I have no clue where that dummy log would go. At least in “/var/log/” doesn’t have any log which would point to that.

sudo systemctl stop ruuvicollector.service
sudo systemctl status ruuvicollector.service
sudo mv /usr/bin/hcitool /usr/bin/hcitool.dummy # put dummy aside
sudo mv /usr/bin/hcitool.original /usr/bin/hcitool # restore original
What output do you get when running
sudo hcitool lescan --duplicates

While hcitool is running ( or bluetoothctl and scan on) in another terminal window what do you get when running

hcidump --raw

What log messages do you get from system.log about influx?

sudo grep influx system.log|tail -n 20

hcitool isn't available for me as I have bluetooth 5.0 (as far as I know and what my friend told me)
eireannanl@Jarno-Linux:~/Ruuvi$ sudo hcitool lescan --duplicates
Set scan parameters failed: Input/output error
Here's hcidump
eireannanl@Jarno-Linux:~/Ruuvi$ hcidump --raw
HCI sniffer - Bluetooth packet analyzer ver 5.53
device: hci0 snap_len: 1500 filter: 0xffffffffffffffff
< 01 42 20 06 00 00 00 00 00 00 
> 04 01 01 00 
> 04 0E 04 02 42 20 00 
< 01 05 20 06 11 CA 2A 59 59 29 
> 04 0E 04 01 05 20 00 
< 01 41 20 08 01 00 01 01 24 00 12 00 
> 04 0E 04 01 41 20 00 
< 01 42 20 06 01 01 00 00 00 00 
> 04 0E 04 02 42 20 00 
< 01 01 04 05 33 8B 9E 08 00 
> 04 0F 04 00 02 01 04 
> 04 3E 2C 0D 01 13 00 01 42 4B 1E 82 6B C4 01 00 FF 7F A2 00 
  00 00 00 00 00 00 00 00 12 02 01 1E 0A FF 75 00 01 00 02 00 
  01 03 02 03 19 C0 00 
> 04 3E 2D 0D 01 1B 00 01 42 4B 1E 82 6B C4 01 00 FF 7F A3 00 
  00 00 00 00 00 00 00 00 13 12 09 47 65 61 72 20 53 33 20 28 
  38 35 32 31 29 20 4C 45 
> 04 3E 39 0D 01 10 00 01 37 C7 DD ED D8 32 01 00 FF 7F A8 00 
  00 00 00 00 00 00 00 00 1F 02 01 1A 03 03 6F FD 17 16 6F FD 
  63 55 34 C4 F7 9C 0C 90 78 E5 8C 88 AF B7 8E 59 5D 6D 93 3B 
> 04 22 0F 01 57 B2 52 B2 1E 00 01 00 00 04 3C B1 19 AB 
> 04 3E 34 0D 01 13 00 01 C3 32 7F AF AF 5A 01 00 FF 7F A4 00 
  00 00 00 00 00 00 00 00 1A 02 01 1A 09 FF C4 00 03 33 02 13 
  15 80 03 03 B9 FE 08 1B 00 E1 8B B4 BD 3D 20 
> 04 3E 33 0D 01 1B 00 01 C3 32 7F AF AF 5A 01 00 FF 7F A2 00 
  00 00 00 00 00 00 00 00 19 18 09 5B 4C 47 5D 20 77 65 62 4F 
  53 20 54 56 20 4C 4B 36 31 30 30 50 4C 42
Pretty much nothing else than telegraf related stuff
eireannanl@Jarno-Linux:~/Ruuvi$ sudo grep influx /var/log/syslog|tail -n 20
Dec 27 00:19:43 Jarno-Linux telegraf[9234]: 2020-12-26T22:19:43Z I! Loaded outputs: influxdb
Dec 27 15:19:48 Jarno-Linux telegraf[24017]: 2020-12-27T13:19:48Z I! Loaded outputs: influxdb
Dec 27 15:24:39 Jarno-Linux telegraf[24128]: 2020-12-27T13:24:39Z I! Loaded outputs: influxdb
Dec 27 15:56:41 Jarno-Linux telegraf[24553]: 2020-12-27T13:56:41Z I! Loaded outputs: influxdb
Dec 27 17:09:09 Jarno-Linux telegraf[25377]: 2020-12-27T15:09:09Z I! Loaded outputs: influxdb
Here's what bluetoothctl scan on gives me

[CHG] Device C4:6B:82:1E:4B:42 RSSI: -94
[NEW] Device 79:C5:70:F9:05:11 79-C5-70-F9-05-11
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 06 c4 fe 00 14 ff e8 03 fc b5 36 58 …#…6X
e9 2b d1 9d 98 5b 50 dd .+…[P.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 10 c4 ff 00 10 ff e8 03 f0 b5 36 58 …#…6X
e9 36 d1 9d 98 5b 50 dd .6…[P.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 0b c5 00 00 14 ff ec 03 f4 b5 36 58 …#…6X
e9 41 d1 9d 98 5b 50 dd .A…[P.
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Key: 0x0499
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Value:
05 fc 12 84 0d c4 cb 00 34 00 14 04 2c 92 b6 55 …4…,…U
5e ba c3 a8 f4 fc 3a 2f ^…:confused:
[CHG] Device DF:64:E3:55:6A:D3 ManufacturerData Key: 0x0499
[CHG] Device DF:64:E3:55:6A:D3 ManufacturerData Value:
05 10 d0 22 a8 c4 98 ff fc ff d0 03 f4 b8 f6 68 …"…h
6e 23 df 64 e3 55 6a d3 n#.d.Uj.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 fa 23 02 c5 02 00 0c ff ec 03 f4 b5 f6 58 …#…X
e9 60 d1 9d 98 5b 50 dd .`…[P.
[CHG] Device C3:A8:F4:FC:3A:2F RSSI: -85
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Key: 0x0499
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Value:
05 fc 12 84 16 c4 cc 00 34 00 14 04 28 91 f6 55 …4…(…U
5e bf c3 a8 f4 fc 3a 2f ^…:confused:
[CHG] Device E3:C9:88:59:4D:8D ManufacturerData Key: 0x0499
[CHG] Device E3:C9:88:59:4D:8D ManufacturerData Value:
05 0f e0 23 29 c4 5d ff e4 ff ec 03 f0 bc b6 9c …#).]…
6e 61 e3 c9 88 59 4d 8d na…YM.

I do recognize most mac addresses I see in bluetoothctl scan on

hcitool error “Set scan parameters failed: Input/output error” is somewhat ambiguous. For example it is output if you don’t have permissions (forgot sudo) as well as if there is an instance of hcitool already running (like invoked by ruuvicollector)

In any case it seems that you are correct in that the important thing is hcidump is outputting packet dumps.

post output from:

grep --invert-match ‘^#’ ruuvi-collector.properties | grep --invert-match ‘^.$’

also

systemctl status influxd

influx
show databases #not including ruuvi is bad

Here's terminal output for greps

[quote=“dgerman, post:10, topic:4569, full:true”]
hcitool error “Set scan parameters failed: Input/output error” is somewhat ambiguous. For example it is output if you don’t have permissions (forgot sudo) as well as if there is an instance of hcitool already running (like invoked by ruuvicollector)

In any case it seems that you are correct in that the important thing is hcidump is outputting packet dumps.

post output from:

> grep --invert-match ‘^#’ ruuvi-collector.properties | grep --invert-match ‘^.$’
[/quote]

eireannanl@Jarno-Linux:~/Desktop$ grep --invert-match '^#' /home/eireannanl/Ruuvi/ruuvi-collector.properties|grep --invert-match '^.$'

influxUrl=http://jarno-linux.localhost:8086/

influxDatabase=ruuvi

influxMeasurement=ruuvi_measurements





filter.mode=none


storage.method=dummy

storage.values=extended
systemctl status influxd
 influxdb.service - InfluxDB is an open-source, distributed, time series databa>
     Loaded: loaded (/lib/systemd/system/influxdb.service; enabled; vendor prese>
     Active: active (running) since Sun 2020-12-27 18:44:46 EET; 11min ago
       Docs: https://docs.influxdata.com/influxdb/
   Main PID: 5885 (influxd)
      Tasks: 15 (limit: 18776)
     Memory: 29.4M
     CGroup: /system.slice/influxdb.service
             └─5885 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

joulu 27 18:54:51 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:54:52 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:54:55 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:02 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:12 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:20 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:22 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:25 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:32 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:43 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
~
~
~

Database has ruuvi as I have created it with “create database ruuvi”. As far as I know (which is very little), it doesn’t have any effect whether it is there or not.

show databases
eireannanl@Jarno-Linux:~$ influx
Connected to http://localhost:8086 version 1.8.3
InfluxDB shell version: 1.8.3
> show databases
name: databases
name
----
telegraf
_internal
ruuvi
> 

Restore (or comment out

storage.method=dummy
Logs the measurements to the log rather than sending them anywhere, feasible for testing and development

Increase the width (number of columns) for your terminal and issue

systemctl status influxd --lines=50 --no-pager

systemctl IMHO is rude and stops outputting at the edge of the terminal window!

we are looking for many

Dec 27 16:43:22 pi93graf influxd[4866]: [httpd] 127.0.0.1 - ruuvi [27/Dec/2020:16:43:20 -0500] “POST /write?db=ruuvi&rp=autogen&precision=n&consistency=one HTTP/1.1” 204 0 “-” “okhttp/3.11.0” 897bf962-488c-11eb-b7c8-b827eb1c5b93 2490110

At least up through the okhttp/3.11.0

Here's InfluxDB stuff you requested

[quote=“dgerman, post:13, topic:4569”]
Increase the width (number of columns) for your terminal and issue

eireannanl@Jarno-Linux:~$ systemctl status influxd --lines=50 --no-pager -l
● influxdb.service - InfluxDB is an open-source, distributed, time series database
     Loaded: loaded (/lib/systemd/system/influxdb.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2020-12-28 05:25:15 EET; 5min ago
       Docs: https://docs.influxdata.com/influxdb/
   Main PID: 1052 (influxd)
      Tasks: 14 (limit: 18776)
     Memory: 133.0M
     CGroup: /system.slice/influxdb.service
             └─1052 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

joulu 28 05:28:43 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:28:43 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" c949fee4-48bc-11eb-8043-f07959609fdf 34472
joulu 28 05:28:53 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:28:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" cf2318ae-48bc-11eb-8044-f07959609fdf 236363
joulu 28 05:28:53 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:28:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" cf3fed90-48bc-11eb-8045-f07959609fdf 272263
joulu 28 05:29:03 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:03 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" d535ce04-48bc-11eb-8046-f07959609fdf 480759
joulu 28 05:29:12 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:11 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" da61955b-48bc-11eb-8047-f07959609fdf 47598
joulu 28 05:29:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:13 +0200] "GET /ping HTTP/1.1" 204 0 "-" "InfluxDBShell/1.8.3" db06b775-48bc-11eb-8048-f07959609fdf 42
joulu 28 05:29:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:13 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" db2bbb98-48bc-11eb-8049-f07959609fdf 47338
joulu 28 05:29:16 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:16.364916Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW DATABASES"
joulu 28 05:29:16 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:16 +0200] "POST /query?chunked=true&db=&epoch=ns&q=show+databases HTTP/1.1" 200 123 "-" "InfluxDBShell/1.8.3" dcfe71f5-48bc-11eb-804a-f07959609fdf 723
joulu 28 05:29:19 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:19.765402Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW DATABASES"
joulu 28 05:29:19 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:19 +0200] "POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1" 200 123 "-" "InfluxDBShell/1.8.3" df055349-48bc-11eb-804b-f07959609fdf 666
joulu 28 05:29:23 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:23 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e121a49d-48bc-11eb-804c-f07959609fdf 354327
joulu 28 05:29:23 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:23.728791Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW MEASUREMENTS ON ruuvi"
joulu 28 05:29:23 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:23 +0200] "POST /query?chunked=true&db=ruuvi&epoch=ns&q=show+measurements HTTP/1.1" 200 57 "-" "InfluxDBShell/1.8.3" e1621699-48bc-11eb-804d-f07959609fdf 516
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.543656Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT usage_user, usage_system FROM telegraf.autogen.\"Server CPU\" WHERE (cpu = 'cpu-total') AND time >= now() - 12h"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.545106Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.546488Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(used) / (1024 * 1024 * 1024), mean(free) / (1024 * 1024 * 1024) FROM telegraf.autogen.\"Server Memory\" WHERE (host = 'Jarno-Linux') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.547003Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'GPU Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%28linear%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27GPU+Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%28linear%29 HTTP/1.1" 200 11891 "-" "Grafana/7.3.6" e1de91eb-48bc-11eb-804f-f07959609fdf 9540
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.554588Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'CPU Total') AND time >= now() - 12h GROUP BY time(1m) fill(none)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.555549Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (hardware = 'NVIDIA GeForce GTX 970') AND time >= now() - 12h GROUP BY time(1m) fill(none)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22used%22%29++%2F+%281024%2A1024%2A1024%29%2C+mean%28%22free%22%29++%2F+%281024%2A1024%2A1024%29+FROM+%22Server+Memory%22+WHERE+%28%22host%22+%3D+%27Jarno-Linux%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29 HTTP/1.1" 200 12255 "-" "Grafana/7.3.6" e1ded8f0-48bc-11eb-8050-f07959609fdf 10102
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27CPU+Total%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28none%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28none%29 HTTP/1.1" 200 4571 "-" "Grafana/7.3.6" e1e0169a-48bc-11eb-8051-f07959609fdf 4554
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.562516Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'CPU Total') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.563534Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (hardware = 'NVIDIA GeForce GTX 970') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+%22usage_user%22%2C+%22usage_system%22+FROM+%22Server+CPU%22+WHERE+%28%22cpu%22+%3D+%27cpu-total%27%29+AND+time+%3E%3D+now%28%29+-+12h HTTP/1.1" 200 47293 "-" "Grafana/7.3.6" e1de5f0c-48bc-11eb-804e-f07959609fdf 22895
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27CPU+Total%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29 HTTP/1.1" 200 6171 "-" "Grafana/7.3.6" e1e1500b-48bc-11eb-8052-f07959609fdf 5901
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.569872Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'GPU Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.571193Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27GPU+Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%280%29 HTTP/1.1" 200 5801 "-" "Grafana/7.3.6" e1e26dc3-48bc-11eb-8053-f07959609fdf 4570
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.588507Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Temperature WHERE (hardware = 'AMD Ryzen 5 5600X' AND sensor = 'Core (Tctl/Tdie)') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.590386Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Temperature WHERE (hardware = 'NVIDIA GeForce GTX 970' AND sensor = 'GPU Core') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Temperature%22+WHERE+%28%22hardware%22+%3D+%27AMD+Ryzen+5+5600X%27+AND+%22sensor%22+%3D+%27Core+%28Tctl%2FTdie%29%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Temperature%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27+AND+%22sensor%22+%3D+%27GPU+Core%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 3917 "-" "Grafana/7.3.6" e1e5433d-48bc-11eb-8054-f07959609fdf 7009
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.698069Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Power WHERE (hardware = 'AMD Ryzen 5 5600X' AND sensor = 'Package Power') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.699236Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Throughput WHERE (sensor = 'Upload Speed' AND hardware = 'Ethernet') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.702383Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Power WHERE (hardware = 'NVIDIA GeForce GTX 970' AND sensor = 'GPU Package') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.702852Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Throughput WHERE (sensor = 'Download Speed' AND hardware = 'Ethernet') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Power%22+WHERE+%28%22hardware%22+%3D+%27AMD+Ryzen+5+5600X%27+AND+%22sensor%22+%3D+%27Package+Power%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Power%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27+AND+%22sensor%22+%3D+%27GPU+Package%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 5369 "-" "Grafana/7.3.6" e1f5eefd-48bc-11eb-8056-f07959609fdf 10345
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Throughput%22+WHERE+%28%22sensor%22+%3D+%27Upload+Speed%27+AND+%22hardware%22+%3D+%27Ethernet%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Throughput%22+WHERE+%28%22sensor%22+%3D+%27Download+Speed%27+AND+%22hardware%22+%3D+%27Ethernet%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 6178 "-" "Grafana/7.3.6" e1f5eeaa-48bc-11eb-8055-f07959609fdf 10670
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.729413Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(used) / (1024 * 1024 * 1024) FROM telegraf.autogen.\"Server Disk\" WHERE (device = 'sda5') AND time >= now() - 12h GROUP BY time(1m) fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22used%22%29++%2F+%281024%2A1024%2A1024%29+FROM+%22Server+Disk%22+WHERE+%28%22device%22+%3D+%27sda5%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28linear%29 HTTP/1.1" 200 6849 "-" "Grafana/7.3.6" e1fac44e-48bc-11eb-8057-f07959609fdf 7964
joulu 28 05:29:33 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:33 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e6f2338c-48bc-11eb-8058-f07959609fdf 36033
joulu 28 05:29:33 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:33 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e7178cf1-48bc-11eb-8059-f07959609fdf 41118
joulu 28 05:29:41 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:41 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" ec10251a-48bc-11eb-805a-f07959609fdf 46448
joulu 28 05:29:43 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:43 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" ed0d752e-48bc-11eb-805b-f07959609fdf 43952
joulu 28 05:29:54 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f2e76fc4-48bc-11eb-805c-f07959609fdf 901086
joulu 28 05:29:54 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f30359b5-48bc-11eb-805d-f07959609fdf 751316
joulu 28 05:30:03 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:30:03 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f8f93e7b-48bc-11eb-805e-f07959609fdf 37905
joulu 28 05:30:11 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:30:11 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" fded8ac1-48bc-11eb-805f-f07959609fdf 39138
joulu 28 05:30:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:30:13 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" feef1d45-48bc-11eb-8060-f07959609fdf 33749

I had dummy on as I was testing if I would see some log where ruuvi-collector would write those but couldn’t find one.

Oh, and bluez didn’t like me, gave me bluetooth failed to set mode failed (0x03) in logs and org.bluez.error.notready when I tried to use bluetoothctl scan on

RuuviCollector uses HCIDump internally, so your case might need some reworking of the program to support bluetoothctl.

I’m not sure what the data on your hcidump is, but it’s not from RuuviTags.

Where else could that data come from since those Mac addresses are my tags’ addresses.

D1:9D:98:5B:50:DD is tag’s address which I’m currently holding. I have 6 tags total.

Reworking sounds like awfully many hours googling stuff :sweat_smile:. Especially when I’m doing that.

bluetoothctl scan is from RuuviTags,

is something else.

https://github.com/Scrin/RuuviCollector/blob/3970d5b8520f6e4005d4f23e0c8d225ff886a255/src/main/java/fi/tkgwf/ruuvi/Main.java#L40 looks like the place that would need to be reworked to support bluetoothctl, or possibly the run() could pick the correct implementation somehow.

@scrin FYI

I see. Well, I’m able to do something with my Linux day after tomorrow so if I’m lucky, Scrin might have solution by then.

I haven’t compared bluetoothctl scan and hcidump --raw but I’m sure you know what you are talking about.

As Otso said, the hcidump you posted does not include any packets
that have Ruuvi ID x’0499’ which appear as 99 at the end of the hcidump line and the 04 is on the next line.
Example

hcidump --raw |grep --after-context=2 ‘FF 99 $’

04 3E 2B 02 01 03 01 1A 1E 4A 74 FA F7 1F 02 01 06 1B FF 99
04 05 11 94 34 CD C5 4C 00 0C FF DC 04 00 97 F6 9C 39 77 F7
FA 74 4A 1E 1A B9

04 3E 2B 02 01 00 01 0F EC 72 78 51 D3 1F 02 01 04 1B FF 99
04 05 0A CE 65 02 C5 21 00 D4 00 0C 03 CC A2 F6 00 BF C4 D3
51 78 72 EC 0F 9E

Which explains why you do not see any log entries from

systemctl status ruuvicollector

which include

…ruuvi [27/Dec/2020:16:43:20 -0500] “POST /write?db=ruuvi…

There’s actually a way to set the “scan command” in the configuration, which by default is hcitool lescan --duplicates --passive. This would need to be changed to the bluetoothctl equivalent to start the BT LE scanning (as the broadcast packets from RuuviTags are not visible in BT Classic scanning). I’m not too familiar with bluetoothctl (yet) so I’m not sure on this one.

Any mechanism that starts the process of receiving the LE packets from the (physical) bluetooth controller to the OS is sufficient, as RuuviCollector grabs the raw packets from the bluez stack using hcidump. This can even be some crazy script that does some very low level poking to the controller directly, or any command of more “high level” tools to get the same result.

1 Like

So, if I haven’t totally misunderstood, that’s something I’m able to do myself (maybe). Well, gonna fiddle aroud with my ubuntu anyway so might as well fiddle with bluetooth.

I don’t know what kind format is correct format for tag’s information but noticed this one in sudo btmon

HCI Event: LE Meta Event (0x3e) plen 57 #26 [hci0] 26.814749
LE Extended Advertising Report (0x0d)
Num reports: 1
Entry 0
Event type: 0x0010
Props: 0x0010
Use legacy advertising PDUs
Data status: Complete
Legacy PDU Type: ADV_NONCONN_IND (0x0010)
Address type: Random (0x01)
Address: D1:9D:98:5B:50:DD (Static)
Primary PHY: LE 1M
Secondary PHY: No packets
SID: no ADI field (0xff)
TX power: 127 dBm
RSSI: -68 dBm (0xbc)
Periodic advertising invteral: 0.00 msec (0x0000)
Direct address type: Public (0x00)
Direct address: 00:00:00:00:00:00 (OUI 00-00-00)
Data length: 0x1f
02 01 06 1b ff 99 04 05 11 da 22 5d c3 3c 00 00 …"].<…
ff f0 03 fc b2 f6 15 24 73 d1 9d 98 5b 50 dd …$s…[P.

At least it looks like it’s reasonable

And after that I found that same plen number from hcidump -X

HCI Event: LE Meta Event (0x3e) plen 57
Disconn Complete
0000: 01 10 00 01 d3 6a 55 e3 64 df 01 00 ff 7f d2 00 …jU.d…
0010: 00 00 00 00 00 00 00 00 1f 02 01 06 1b ff 99 04 …
0020: 05 10 34 21 28 c2 cf ff fc ff d0 03 f0 b8 36 69 …4!(…6i
0030: 13 17 df 64 e3 55 6a d3 …d.Uj.

Just quick note before heading to bed after fiddling around with bluetooth long enough. Very first time I tried to do something with Ruuvi tags I tried Bluewalker, I had no knowledge what-so-ever.

Anyway, just started ruuvi-collector service and started bluewalker to run in terminal and… I get data out from Ruuvi tags.

My friend was certain that Ubuntu 20.04 and bluetooth 5.0 wasn’t good combination but apparently I managed to do something for once.

Ps. happy new year pals.

2 Likes

Update after 6 months: something broke suddenly after shutdown and starting again my server.

Bluewalker is able to scan Ruuvi tags as it should be. Ruuvi Collector runs without problem.
Problem here, as far as I know, seems to be that hcidump doesn’t see data which Bluewalker sees.

If I stop Bluewalker and execute bluetoothctl and after that scan on and check hcidump, it shows data ( but won’t send it to InfluxDB ).

Permissions may get broken on update, this thread had similar problem and a solution: Bluetooth connectivity issues.

Let me know if it fixes your issue

1 Like

It seems that it was just those capabilities was missing. I executed for hcidump and hcitools, after reverting some of my own fidlings, it started to work. If only I would have asked that earlier.

Anyway, thanks for the info, otso!