Unable to get data from RuuviCollector to InfluxDB on Ubuntu

dgerman · December 27, 2020, 3:03pm

sudo systemctl stop ruuvicollector.service
sudo systemctl status ruuvicollector.service
sudo mv /usr/bin/hcitool /usr/bin/hcitool.dummy # put dummy aside
sudo mv /usr/bin/hcitool.original /usr/bin/hcitool # restore original
What output do you get when running
sudo hcitool lescan --duplicates

While hcitool is running ( or bluetoothctl and scan on) in another terminal window what do you get when running

hcidump --raw

What log messages do you get from system.log about influx?

sudo grep influx system.log|tail -n 20

Eireannanl · December 27, 2020, 3:23pm

hcitool isn't available for me as I have bluetooth 5.0 (as far as I know and what my friend told me)

eireannanl@Jarno-Linux:~/Ruuvi$ sudo hcitool lescan --duplicates
Set scan parameters failed: Input/output error

Here's hcidump

eireannanl@Jarno-Linux:~/Ruuvi$ hcidump --raw
HCI sniffer - Bluetooth packet analyzer ver 5.53
device: hci0 snap_len: 1500 filter: 0xffffffffffffffff
< 01 42 20 06 00 00 00 00 00 00 
> 04 01 01 00 
> 04 0E 04 02 42 20 00 
< 01 05 20 06 11 CA 2A 59 59 29 
> 04 0E 04 01 05 20 00 
< 01 41 20 08 01 00 01 01 24 00 12 00 
> 04 0E 04 01 41 20 00 
< 01 42 20 06 01 01 00 00 00 00 
> 04 0E 04 02 42 20 00 
< 01 01 04 05 33 8B 9E 08 00 
> 04 0F 04 00 02 01 04 
> 04 3E 2C 0D 01 13 00 01 42 4B 1E 82 6B C4 01 00 FF 7F A2 00 
  00 00 00 00 00 00 00 00 12 02 01 1E 0A FF 75 00 01 00 02 00 
  01 03 02 03 19 C0 00 
> 04 3E 2D 0D 01 1B 00 01 42 4B 1E 82 6B C4 01 00 FF 7F A3 00 
  00 00 00 00 00 00 00 00 13 12 09 47 65 61 72 20 53 33 20 28 
  38 35 32 31 29 20 4C 45 
> 04 3E 39 0D 01 10 00 01 37 C7 DD ED D8 32 01 00 FF 7F A8 00 
  00 00 00 00 00 00 00 00 1F 02 01 1A 03 03 6F FD 17 16 6F FD 
  63 55 34 C4 F7 9C 0C 90 78 E5 8C 88 AF B7 8E 59 5D 6D 93 3B 
> 04 22 0F 01 57 B2 52 B2 1E 00 01 00 00 04 3C B1 19 AB 
> 04 3E 34 0D 01 13 00 01 C3 32 7F AF AF 5A 01 00 FF 7F A4 00 
  00 00 00 00 00 00 00 00 1A 02 01 1A 09 FF C4 00 03 33 02 13 
  15 80 03 03 B9 FE 08 1B 00 E1 8B B4 BD 3D 20 
> 04 3E 33 0D 01 1B 00 01 C3 32 7F AF AF 5A 01 00 FF 7F A2 00 
  00 00 00 00 00 00 00 00 19 18 09 5B 4C 47 5D 20 77 65 62 4F 
  53 20 54 56 20 4C 4B 36 31 30 30 50 4C 42

Pretty much nothing else than telegraf related stuff

eireannanl@Jarno-Linux:~/Ruuvi$ sudo grep influx /var/log/syslog|tail -n 20
Dec 27 00:19:43 Jarno-Linux telegraf[9234]: 2020-12-26T22:19:43Z I! Loaded outputs: influxdb
Dec 27 15:19:48 Jarno-Linux telegraf[24017]: 2020-12-27T13:19:48Z I! Loaded outputs: influxdb
Dec 27 15:24:39 Jarno-Linux telegraf[24128]: 2020-12-27T13:24:39Z I! Loaded outputs: influxdb
Dec 27 15:56:41 Jarno-Linux telegraf[24553]: 2020-12-27T13:56:41Z I! Loaded outputs: influxdb
Dec 27 17:09:09 Jarno-Linux telegraf[25377]: 2020-12-27T15:09:09Z I! Loaded outputs: influxdb

Here's what bluetoothctl scan on gives me

[CHG] Device C4:6B:82:1E:4B:42 RSSI: -94
[NEW] Device 79:C5:70:F9:05:11 79-C5-70-F9-05-11
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 06 c4 fe 00 14 ff e8 03 fc b5 36 58 …#…6X
e9 2b d1 9d 98 5b 50 dd .+…[P.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 10 c4 ff 00 10 ff e8 03 f0 b5 36 58 …#…6X
e9 36 d1 9d 98 5b 50 dd .6…[P.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 0b c5 00 00 14 ff ec 03 f4 b5 36 58 …#…6X
e9 41 d1 9d 98 5b 50 dd .A…[P.
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Key: 0x0499
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Value:
05 fc 12 84 0d c4 cb 00 34 00 14 04 2c 92 b6 55 …4…,…U
5e ba c3 a8 f4 fc 3a 2f ^…
[CHG] Device DF:64:E3:55:6A:D3 ManufacturerData Key: 0x0499
[CHG] Device DF:64:E3:55:6A:D3 ManufacturerData Value:
05 10 d0 22 a8 c4 98 ff fc ff d0 03 f4 b8 f6 68 …"…h
6e 23 df 64 e3 55 6a d3 n#.d.Uj.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 fa 23 02 c5 02 00 0c ff ec 03 f4 b5 f6 58 …#…X
e9 60 d1 9d 98 5b 50 dd .`…[P.
[CHG] Device C3:A8:F4:FC:3A:2F RSSI: -85
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Key: 0x0499
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Value:
05 fc 12 84 16 c4 cc 00 34 00 14 04 28 91 f6 55 …4…(…U
5e bf c3 a8 f4 fc 3a 2f ^…
[CHG] Device E3:C9:88:59:4D:8D ManufacturerData Key: 0x0499
[CHG] Device E3:C9:88:59:4D:8D ManufacturerData Value:
05 0f e0 23 29 c4 5d ff e4 ff ec 03 f0 bc b6 9c …#).]…
6e 61 e3 c9 88 59 4d 8d na…YM.

I do recognize most mac addresses I see in bluetoothctl scan on

dgerman · December 27, 2020, 4:25pm

hcitool error “Set scan parameters failed: Input/output error” is somewhat ambiguous. For example it is output if you don’t have permissions (forgot sudo) as well as if there is an instance of hcitool already running (like invoked by ruuvicollector)

In any case it seems that you are correct in that the important thing is hcidump is outputting packet dumps.

post output from:

grep --invert-match ‘^#’ ruuvi-collector.properties | grep --invert-match ‘^.$’

dgerman · December 27, 2020, 4:37pm

also

systemctl status influxd

influx
show databases #not including ruuvi is bad

Eireannanl · December 27, 2020, 4:59pm

Here's terminal output for greps

[quote=“dgerman, post:10, topic:4569, full:true”]
hcitool error “Set scan parameters failed: Input/output error” is somewhat ambiguous. For example it is output if you don’t have permissions (forgot sudo) as well as if there is an instance of hcitool already running (like invoked by ruuvicollector)

In any case it seems that you are correct in that the important thing is hcidump is outputting packet dumps.

post output from:

> grep --invert-match ‘^#’ ruuvi-collector.properties | grep --invert-match ‘^.$’
[/quote]

eireannanl@Jarno-Linux:~/Desktop$ grep --invert-match '^#' /home/eireannanl/Ruuvi/ruuvi-collector.properties|grep --invert-match '^.$'

influxUrl=http://jarno-linux.localhost:8086/

influxDatabase=ruuvi

influxMeasurement=ruuvi_measurements





filter.mode=none


storage.method=dummy

storage.values=extended

systemctl status influxd

 influxdb.service - InfluxDB is an open-source, distributed, time series databa>
     Loaded: loaded (/lib/systemd/system/influxdb.service; enabled; vendor prese>
     Active: active (running) since Sun 2020-12-27 18:44:46 EET; 11min ago
       Docs: https://docs.influxdata.com/influxdb/
   Main PID: 5885 (influxd)
      Tasks: 15 (limit: 18776)
     Memory: 29.4M
     CGroup: /system.slice/influxdb.service
             └─5885 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

joulu 27 18:54:51 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:54:52 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:54:55 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:02 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:12 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:20 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:22 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:25 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:32 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:43 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
~
~
~

Database has ruuvi as I have created it with “create database ruuvi”. As far as I know (which is very little), it doesn’t have any effect whether it is there or not.

show databases

eireannanl@Jarno-Linux:~$ influx
Connected to http://localhost:8086 version 1.8.3
InfluxDB shell version: 1.8.3
> show databases
name: databases
name
----
telegraf
_internal
ruuvi
>

dgerman · December 27, 2020, 9:48pm

Restore (or comment out

storage.method=dummy
Logs the measurements to the log rather than sending them anywhere, feasible for testing and development

Increase the width (number of columns) for your terminal and issue

systemctl status influxd --lines=50 --no-pager

systemctl IMHO is rude and stops outputting at the edge of the terminal window!

we are looking for many

Dec 27 16:43:22 pi93graf influxd[4866]: [httpd] 127.0.0.1 - ruuvi [27/Dec/2020:16:43:20 -0500] “POST /write?db=ruuvi&rp=autogen&precision=n&consistency=one HTTP/1.1” 204 0 “-” “okhttp/3.11.0” 897bf962-488c-11eb-b7c8-b827eb1c5b93 2490110

At least up through the okhttp/3.11.0

Eireannanl · December 28, 2020, 3:32am

Here's InfluxDB stuff you requested

[quote=“dgerman, post:13, topic:4569”]
Increase the width (number of columns) for your terminal and issue

eireannanl@Jarno-Linux:~$ systemctl status influxd --lines=50 --no-pager -l
● influxdb.service - InfluxDB is an open-source, distributed, time series database
     Loaded: loaded (/lib/systemd/system/influxdb.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2020-12-28 05:25:15 EET; 5min ago
       Docs: https://docs.influxdata.com/influxdb/
   Main PID: 1052 (influxd)
      Tasks: 14 (limit: 18776)
     Memory: 133.0M
     CGroup: /system.slice/influxdb.service
             └─1052 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

joulu 28 05:28:43 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:28:43 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" c949fee4-48bc-11eb-8043-f07959609fdf 34472
joulu 28 05:28:53 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:28:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" cf2318ae-48bc-11eb-8044-f07959609fdf 236363
joulu 28 05:28:53 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:28:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" cf3fed90-48bc-11eb-8045-f07959609fdf 272263
joulu 28 05:29:03 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:03 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" d535ce04-48bc-11eb-8046-f07959609fdf 480759
joulu 28 05:29:12 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:11 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" da61955b-48bc-11eb-8047-f07959609fdf 47598
joulu 28 05:29:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:13 +0200] "GET /ping HTTP/1.1" 204 0 "-" "InfluxDBShell/1.8.3" db06b775-48bc-11eb-8048-f07959609fdf 42
joulu 28 05:29:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:13 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" db2bbb98-48bc-11eb-8049-f07959609fdf 47338
joulu 28 05:29:16 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:16.364916Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW DATABASES"
joulu 28 05:29:16 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:16 +0200] "POST /query?chunked=true&db=&epoch=ns&q=show+databases HTTP/1.1" 200 123 "-" "InfluxDBShell/1.8.3" dcfe71f5-48bc-11eb-804a-f07959609fdf 723
joulu 28 05:29:19 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:19.765402Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW DATABASES"
joulu 28 05:29:19 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:19 +0200] "POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1" 200 123 "-" "InfluxDBShell/1.8.3" df055349-48bc-11eb-804b-f07959609fdf 666
joulu 28 05:29:23 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:23 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e121a49d-48bc-11eb-804c-f07959609fdf 354327
joulu 28 05:29:23 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:23.728791Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW MEASUREMENTS ON ruuvi"
joulu 28 05:29:23 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:23 +0200] "POST /query?chunked=true&db=ruuvi&epoch=ns&q=show+measurements HTTP/1.1" 200 57 "-" "InfluxDBShell/1.8.3" e1621699-48bc-11eb-804d-f07959609fdf 516
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.543656Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT usage_user, usage_system FROM telegraf.autogen.\"Server CPU\" WHERE (cpu = 'cpu-total') AND time >= now() - 12h"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.545106Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.546488Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(used) / (1024 * 1024 * 1024), mean(free) / (1024 * 1024 * 1024) FROM telegraf.autogen.\"Server Memory\" WHERE (host = 'Jarno-Linux') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.547003Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'GPU Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%28linear%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27GPU+Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%28linear%29 HTTP/1.1" 200 11891 "-" "Grafana/7.3.6" e1de91eb-48bc-11eb-804f-f07959609fdf 9540
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.554588Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'CPU Total') AND time >= now() - 12h GROUP BY time(1m) fill(none)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.555549Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (hardware = 'NVIDIA GeForce GTX 970') AND time >= now() - 12h GROUP BY time(1m) fill(none)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22used%22%29++%2F+%281024%2A1024%2A1024%29%2C+mean%28%22free%22%29++%2F+%281024%2A1024%2A1024%29+FROM+%22Server+Memory%22+WHERE+%28%22host%22+%3D+%27Jarno-Linux%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29 HTTP/1.1" 200 12255 "-" "Grafana/7.3.6" e1ded8f0-48bc-11eb-8050-f07959609fdf 10102
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27CPU+Total%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28none%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28none%29 HTTP/1.1" 200 4571 "-" "Grafana/7.3.6" e1e0169a-48bc-11eb-8051-f07959609fdf 4554
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.562516Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'CPU Total') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.563534Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (hardware = 'NVIDIA GeForce GTX 970') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+%22usage_user%22%2C+%22usage_system%22+FROM+%22Server+CPU%22+WHERE+%28%22cpu%22+%3D+%27cpu-total%27%29+AND+time+%3E%3D+now%28%29+-+12h HTTP/1.1" 200 47293 "-" "Grafana/7.3.6" e1de5f0c-48bc-11eb-804e-f07959609fdf 22895
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27CPU+Total%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29 HTTP/1.1" 200 6171 "-" "Grafana/7.3.6" e1e1500b-48bc-11eb-8052-f07959609fdf 5901
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.569872Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'GPU Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.571193Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27GPU+Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%280%29 HTTP/1.1" 200 5801 "-" "Grafana/7.3.6" e1e26dc3-48bc-11eb-8053-f07959609fdf 4570
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.588507Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Temperature WHERE (hardware = 'AMD Ryzen 5 5600X' AND sensor = 'Core (Tctl/Tdie)') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.590386Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Temperature WHERE (hardware = 'NVIDIA GeForce GTX 970' AND sensor = 'GPU Core') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Temperature%22+WHERE+%28%22hardware%22+%3D+%27AMD+Ryzen+5+5600X%27+AND+%22sensor%22+%3D+%27Core+%28Tctl%2FTdie%29%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Temperature%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27+AND+%22sensor%22+%3D+%27GPU+Core%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 3917 "-" "Grafana/7.3.6" e1e5433d-48bc-11eb-8054-f07959609fdf 7009
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.698069Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Power WHERE (hardware = 'AMD Ryzen 5 5600X' AND sensor = 'Package Power') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.699236Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Throughput WHERE (sensor = 'Upload Speed' AND hardware = 'Ethernet') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.702383Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Power WHERE (hardware = 'NVIDIA GeForce GTX 970' AND sensor = 'GPU Package') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.702852Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Throughput WHERE (sensor = 'Download Speed' AND hardware = 'Ethernet') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Power%22+WHERE+%28%22hardware%22+%3D+%27AMD+Ryzen+5+5600X%27+AND+%22sensor%22+%3D+%27Package+Power%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Power%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27+AND+%22sensor%22+%3D+%27GPU+Package%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 5369 "-" "Grafana/7.3.6" e1f5eefd-48bc-11eb-8056-f07959609fdf 10345
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Throughput%22+WHERE+%28%22sensor%22+%3D+%27Upload+Speed%27+AND+%22hardware%22+%3D+%27Ethernet%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Throughput%22+WHERE+%28%22sensor%22+%3D+%27Download+Speed%27+AND+%22hardware%22+%3D+%27Ethernet%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 6178 "-" "Grafana/7.3.6" e1f5eeaa-48bc-11eb-8055-f07959609fdf 10670
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.729413Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(used) / (1024 * 1024 * 1024) FROM telegraf.autogen.\"Server Disk\" WHERE (device = 'sda5') AND time >= now() - 12h GROUP BY time(1m) fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22used%22%29++%2F+%281024%2A1024%2A1024%29+FROM+%22Server+Disk%22+WHERE+%28%22device%22+%3D+%27sda5%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28linear%29 HTTP/1.1" 200 6849 "-" "Grafana/7.3.6" e1fac44e-48bc-11eb-8057-f07959609fdf 7964
joulu 28 05:29:33 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:33 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e6f2338c-48bc-11eb-8058-f07959609fdf 36033
joulu 28 05:29:33 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:33 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e7178cf1-48bc-11eb-8059-f07959609fdf 41118
joulu 28 05:29:41 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:41 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" ec10251a-48bc-11eb-805a-f07959609fdf 46448
joulu 28 05:29:43 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:43 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" ed0d752e-48bc-11eb-805b-f07959609fdf 43952
joulu 28 05:29:54 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f2e76fc4-48bc-11eb-805c-f07959609fdf 901086
joulu 28 05:29:54 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f30359b5-48bc-11eb-805d-f07959609fdf 751316
joulu 28 05:30:03 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:30:03 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f8f93e7b-48bc-11eb-805e-f07959609fdf 37905
joulu 28 05:30:11 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:30:11 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" fded8ac1-48bc-11eb-805f-f07959609fdf 39138
joulu 28 05:30:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:30:13 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" feef1d45-48bc-11eb-8060-f07959609fdf 33749

I had dummy on as I was testing if I would see some log where ruuvi-collector would write those but couldn’t find one.

Oh, and bluez didn’t like me, gave me bluetooth failed to set mode failed (0x03) in logs and org.bluez.error.notready when I tried to use bluetoothctl scan on

otso · December 28, 2020, 8:52am

RuuviCollector uses HCIDump internally, so your case might need some reworking of the program to support bluetoothctl.

I’m not sure what the data on your hcidump is, but it’s not from RuuviTags.

Eireannanl · December 28, 2020, 9:55am

Where else could that data come from since those Mac addresses are my tags’ addresses.

D1:9D:98:5B:50:DD is tag’s address which I’m currently holding. I have 6 tags total.

Reworking sounds like awfully many hours googling stuff . Especially when I’m doing that.

otso · December 28, 2020, 11:28am

bluetoothctl scan is from RuuviTags,

is something else.

RuuviCollector/src/main/java/fi/tkgwf/ruuvi/Main.java at 3970d5b8520f6e4005d4f23e0c8d225ff886a255 · Scrin/RuuviCollector · GitHub looks like the place that would need to be reworked to support bluetoothctl, or possibly the run() could pick the correct implementation somehow.

@scrin FYI

Eireannanl · December 28, 2020, 11:49am

I see. Well, I’m able to do something with my Linux day after tomorrow so if I’m lucky, Scrin might have solution by then.

I haven’t compared bluetoothctl scan and hcidump --raw but I’m sure you know what you are talking about.

dgerman · December 28, 2020, 3:07pm

As Otso said, the hcidump you posted does not include any packets
that have Ruuvi ID x’0499’ which appear as 99 at the end of the hcidump line and the 04 is on the next line.
Example

hcidump --raw |grep --after-context=2 ‘FF 99 $’

04 3E 2B 02 01 03 01 1A 1E 4A 74 FA F7 1F 02 01 06 1B FF 99
04 05 11 94 34 CD C5 4C 00 0C FF DC 04 00 97 F6 9C 39 77 F7
FA 74 4A 1E 1A B9
–
04 3E 2B 02 01 00 01 0F EC 72 78 51 D3 1F 02 01 04 1B FF 99
04 05 0A CE 65 02 C5 21 00 D4 00 0C 03 CC A2 F6 00 BF C4 D3
51 78 72 EC 0F 9E

Which explains why you do not see any log entries from

systemctl status ruuvicollector

which include

…ruuvi [27/Dec/2020:16:43:20 -0500] “POST /write?db=ruuvi…

Scrin · December 29, 2020, 6:07pm

There’s actually a way to set the “scan command” in the configuration, which by default is hcitool lescan --duplicates --passive. This would need to be changed to the bluetoothctl equivalent to start the BT LE scanning (as the broadcast packets from RuuviTags are not visible in BT Classic scanning). I’m not too familiar with bluetoothctl (yet) so I’m not sure on this one.

Any mechanism that starts the process of receiving the LE packets from the (physical) bluetooth controller to the OS is sufficient, as RuuviCollector grabs the raw packets from the bluez stack using hcidump. This can even be some crazy script that does some very low level poking to the controller directly, or any command of more “high level” tools to get the same result.

Eireannanl · December 29, 2020, 7:17pm

So, if I haven’t totally misunderstood, that’s something I’m able to do myself (maybe). Well, gonna fiddle aroud with my ubuntu anyway so might as well fiddle with bluetooth.

Eireannanl · December 30, 2020, 6:39pm

I don’t know what kind format is correct format for tag’s information but noticed this one in sudo btmon

HCI Event: LE Meta Event (0x3e) plen 57 #26 [hci0] 26.814749
LE Extended Advertising Report (0x0d)
Num reports: 1
Entry 0
Event type: 0x0010
Props: 0x0010
Use legacy advertising PDUs
Data status: Complete
Legacy PDU Type: ADV_NONCONN_IND (0x0010)
Address type: Random (0x01)
Address: D1:9D:98:5B:50:DD (Static)
Primary PHY: LE 1M
Secondary PHY: No packets
SID: no ADI field (0xff)
TX power: 127 dBm
RSSI: -68 dBm (0xbc)
Periodic advertising invteral: 0.00 msec (0x0000)
Direct address type: Public (0x00)
Direct address: 00:00:00:00:00:00 (OUI 00-00-00)
Data length: 0x1f
02 01 06 1b ff 99 04 05 11 da 22 5d c3 3c 00 00 …"].<…
ff f0 03 fc b2 f6 15 24 73 d1 9d 98 5b 50 dd …$s…[P.

At least it looks like it’s reasonable

And after that I found that same plen number from hcidump -X

HCI Event: LE Meta Event (0x3e) plen 57
Disconn Complete
0000: 01 10 00 01 d3 6a 55 e3 64 df 01 00 ff 7f d2 00 …jU.d…
0010: 00 00 00 00 00 00 00 00 1f 02 01 06 1b ff 99 04 …
0020: 05 10 34 21 28 c2 cf ff fc ff d0 03 f0 b8 36 69 …4!(…6i
0030: 13 17 df 64 e3 55 6a d3 …d.Uj.

Eireannanl · December 31, 2020, 12:24am

Just quick note before heading to bed after fiddling around with bluetooth long enough. Very first time I tried to do something with Ruuvi tags I tried Bluewalker, I had no knowledge what-so-ever.

Anyway, just started ruuvi-collector service and started bluewalker to run in terminal and… I get data out from Ruuvi tags.

My friend was certain that Ubuntu 20.04 and bluetooth 5.0 wasn’t good combination but apparently I managed to do something for once.

Ps. happy new year pals.

Eireannanl · June 5, 2021, 9:19am

Update after 6 months: something broke suddenly after shutdown and starting again my server.

Bluewalker is able to scan Ruuvi tags as it should be. Ruuvi Collector runs without problem.
Problem here, as far as I know, seems to be that hcidump doesn’t see data which Bluewalker sees.

If I stop Bluewalker and execute bluetoothctl and after that scan on and check hcidump, it shows data ( but won’t send it to InfluxDB ).

otso · June 6, 2021, 9:13am

Permissions may get broken on update, this thread had similar problem and a solution: Bluetooth connectivity issues.

Let me know if it fixes your issue

Eireannanl · June 6, 2021, 10:42am

It seems that it was just those capabilities was missing. I executed for hcidump and hcitools, after reverting some of my own fidlings, it started to work. If only I would have asked that earlier.

Anyway, thanks for the info, otso!

Kuivuri · August 24, 2023, 6:07pm

Old threat… same problem.

I have new installation Rpi… I got data from RuuviCollector first few boots after setting up the system → Ruuvicollector → InfluxBD → Grafana. Then started problems.

At the moment I get warning Failed to start lescan.service: Transaction order is cyclic. See system logs for details. See system logs and 'systemctl status lescan.service' for details.

systemctl status lescan.service
● lescan.service - BLE Scanning Service
     Loaded: loaded (/etc/systemd/system/lescan.service; enabled; vendor preset: enabled)
     Active: inactive (dead)

elo 24 18:45:52 raspberrypi systemd[1]: multi-user.target: Found ordering cycle on lescan.service/start
elo 24 18:45:52 raspberrypi systemd[1]: multi-user.target: Found dependency on graphical.target/start
elo 24 18:45:52 raspberrypi systemd[1]: multi-user.target: Found dependency on multi-user.target/start
elo 24 18:45:52 raspberrypi systemd[1]: multi-user.target: Unable to break cycle starting with multi-user.target/start
elo 24 20:54:33 raspberrypi systemd[1]: lescan.service: Found ordering cycle on graphical.target/start
elo 24 20:54:33 raspberrypi systemd[1]: lescan.service: Found dependency on multi-user.target/start
elo 24 20:54:33 raspberrypi systemd[1]: lescan.service: Found dependency on lescan.service/start
elo 24 20:54:33 raspberrypi systemd[1]: lescan.service: Unable to break cycle starting with lescan.service/start

hcitool lescan gives BT devices MAC adresses nearby.

hcidump --raw gives only:

HCI sniffer - Bluetooth packet analyzer ver 5.55
device: hci0 snap_len: 1500 filter: 0xffffffff

What I should do?