Unable to get data from RuuviCollector to InfluxDB on Ubuntu

Eireannanl · December 26, 2020, 8:59pm

I’m having problems while setting up InfluxDB with Grafana.

I have followed every guide I can find. I’m using Bluetooth 5.0 PCI card and because of this I have to use bluetoothctl instead of hcitool lescan.

When I type “bluetoothctl” and after that “scan on”, I do get entries from my tags. I have RuuviCollector up and running and it also says that it does receive data from hcidump.

I cannot see “ruuvi” database in InfluxDB when I type “influx” -> “show databases”. Also when I start RuuviCollector, I don’t see any activity in InfluxDB terminal except those I cause myself with “show databases”. I suspect that my RuuviCollector doesn’t want to connect to InfluxDB.

dgerman · December 26, 2020, 9:55pm

RuuviCollection talks to syslog configured in /etc/syslog usually going to /var/log/xxx.log

See if there is anything there.

dgerman · December 26, 2020, 10:11pm

You should see
DEBUG [Config] Config: /home/pi/RuuviCollector/ruuvi-collector.properties
RuuviCollector[x]:ttt DEBUG [Main] Starting scan with: [hcitool, lescan, --duplicates, --passive]
RuuviCollector[x]: ttt DEBUG [Main] Starting dump with: [hcidump, --raw]
RuuviCollector[x]:ttt INFO [Main] BLE listener started successfully, waiting for data…
RuuviCollector[x]: If you don’t get any data, check that you are able to run ‘hcitool lescan’ and ‘hcidump --raw’ without issues
RuuviCollector[x]: ttt INFO [Main] Successfully reading data from hcidump
~

A sample query for influx command line is

SELECT mac, 32 + last(temperature) * 9 / 5, humidity FROM ruuvi.autogen.ruuvi_measurements GROUP BY mac ORDER BY time ASC TZ(‘America/New_York’)

dgerman · December 26, 2020, 10:06pm

You may need to make a dummy script for hcitool because RuuviCollector trys to start that.

Eireannanl · December 26, 2020, 10:14pm

How can I make dummy script, I’m not too familiar with script’n’stuff, especially with Linux.

dgerman · December 27, 2020, 1:16am

Did you find anything in the logs?

I would create a file name hcitool containing

logger --priority daemon.notice. "++ dummy hcitool called with args: $* "

so a message would appear in the /var/log file when it gets run.

You would need to copy it to /usr/bin/hcitool using (note a hash introduces a comment)

sudo mv /usr/bin/hcitool /usr/bin/hcitool.original. # move the original to a safe place
sudo cp hcitool /usr/bin/hcitool # copy the dummy where the original was
sudo chmod a+x /usr/bin/hcitool. # have allusers be able to eXecute it

Then use

sudo systemctl start ruuvicollector.service # restart the ruuvi collector wait 2 minutes then
sudo systemctl status ruuvicollector.service

Eireannanl · December 27, 2020, 11:02am

After I successfully managed to get RuuviCollector service running, this is all it says. Same stuff as it said before running as service (originally it ran in terminal)

This is from syslog

Dec 27 12:01:02 Jarno-Linux systemd[1]: Started Ruuvi Collector service[Service].
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.263 DEBUG [Config] Tag names: /home/eireannanl/Ruuvi/ruuvi-names.properties
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.265 DEBUG [Config] Config: /home/eireannanl/Ruuvi/ruuvi-collector.properties
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.283 DEBUG [Main] Starting scan with: [hcitool, lescan, --duplicates, --passive]
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 DEBUG [Main] Starting dump with: [hcidump, --raw]
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 INFO  [Main] BLE listener started successfully, waiting for data...
Dec 27 12:01:02 Jarno-Linux java[21221]:  If you don't get any data, check that you are able to run 'hcitool lescan' and 'hcidump --raw' without issues
Dec 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.668 INFO  [Main] Successfully reading data from hcidump

and this is from terminal with status command

 ruuvi-collector.service - Ruuvi Collector service[Service]
     Loaded: loaded (/etc/systemd/system/ruuvi-collector.service; static; vendor preset: enabled)
     Active: active (running) since Sun 2020-12-27 12:01:02 EET; 8min ago
   Main PID: 21221 (java)
      Tasks: 24 (limit: 18776)
     Memory: 55.5M
     CGroup: /system.slice/ruuvi-collector.service
             ├─21221 /usr/bin/java -jar /home/eireannanl/Ruuvi/ruuvi-collector-0.2.jar
             └─21266 hcidump --raw

joulu 27 12:01:02 Jarno-Linux systemd[1]: ruuvi-collector.service: Succeeded.
joulu 27 12:01:02 Jarno-Linux systemd[1]: Stopped Ruuvi Collector service[Service].
joulu 27 12:01:02 Jarno-Linux systemd[1]: Started Ruuvi Collector service[Service].
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.263 DEBUG [Config] Tag names: /home/eireannanl/Ruuvi/ruuvi-names.properties
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.265 DEBUG [Config] Config: /home/eireannanl/Ruuvi/ruuvi-collector.properties
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.283 DEBUG [Main] Starting scan with: [hcitool, lescan, --duplicates, --passive]
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 DEBUG [Main] Starting dump with: [hcidump, --raw]
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.284 INFO  [Main] BLE listener started successfully, waiting for data...
joulu 27 12:01:02 Jarno-Linux java[21221]:  If you don't get any data, check that you are able to run 'hcitool lescan' and 'hcidump --raw' without issues
joulu 27 12:01:02 Jarno-Linux java[21221]: 2020-12-27 12:01:02.668 INFO  [Main] Successfully reading data from hcidump

Anyway, I created that hcitool file (with “touch hcitool) and copied it to /usr/bin/ (backed up original one). It seems that there’s no change. Does it matter that files has different icons because of different filetype? “hcitool” is plain text document” while “hcitool.original” is shared library.

Ps. I know that InfluxDB works as I get data from Telegraf (From both local and client)

I tried “storage.method=dummy” in “ruuvi-collector.properties” but I have no clue where that dummy log would go. At least in “/var/log/” doesn’t have any log which would point to that.

dgerman · December 27, 2020, 3:04pm

sudo systemctl stop ruuvicollector.service
sudo systemctl status ruuvicollector.service
sudo mv /usr/bin/hcitool /usr/bin/hcitool.dummy # put dummy aside
sudo mv /usr/bin/hcitool.original /usr/bin/hcitool # restore original
What output do you get when running
sudo hcitool lescan --duplicates

While hcitool is running ( or bluetoothctl and scan on) in another terminal window what do you get when running

hcidump --raw

What log messages do you get from system.log about influx?

sudo grep influx system.log|tail -n 20

Eireannanl · December 27, 2020, 3:23pm

hcitool isn't available for me as I have bluetooth 5.0 (as far as I know and what my friend told me)

eireannanl@Jarno-Linux:~/Ruuvi$ sudo hcitool lescan --duplicates
Set scan parameters failed: Input/output error

Here's hcidump

eireannanl@Jarno-Linux:~/Ruuvi$ hcidump --raw
HCI sniffer - Bluetooth packet analyzer ver 5.53
device: hci0 snap_len: 1500 filter: 0xffffffffffffffff
< 01 42 20 06 00 00 00 00 00 00 
> 04 01 01 00 
> 04 0E 04 02 42 20 00 
< 01 05 20 06 11 CA 2A 59 59 29 
> 04 0E 04 01 05 20 00 
< 01 41 20 08 01 00 01 01 24 00 12 00 
> 04 0E 04 01 41 20 00 
< 01 42 20 06 01 01 00 00 00 00 
> 04 0E 04 02 42 20 00 
< 01 01 04 05 33 8B 9E 08 00 
> 04 0F 04 00 02 01 04 
> 04 3E 2C 0D 01 13 00 01 42 4B 1E 82 6B C4 01 00 FF 7F A2 00 
  00 00 00 00 00 00 00 00 12 02 01 1E 0A FF 75 00 01 00 02 00 
  01 03 02 03 19 C0 00 
> 04 3E 2D 0D 01 1B 00 01 42 4B 1E 82 6B C4 01 00 FF 7F A3 00 
  00 00 00 00 00 00 00 00 13 12 09 47 65 61 72 20 53 33 20 28 
  38 35 32 31 29 20 4C 45 
> 04 3E 39 0D 01 10 00 01 37 C7 DD ED D8 32 01 00 FF 7F A8 00 
  00 00 00 00 00 00 00 00 1F 02 01 1A 03 03 6F FD 17 16 6F FD 
  63 55 34 C4 F7 9C 0C 90 78 E5 8C 88 AF B7 8E 59 5D 6D 93 3B 
> 04 22 0F 01 57 B2 52 B2 1E 00 01 00 00 04 3C B1 19 AB 
> 04 3E 34 0D 01 13 00 01 C3 32 7F AF AF 5A 01 00 FF 7F A4 00 
  00 00 00 00 00 00 00 00 1A 02 01 1A 09 FF C4 00 03 33 02 13 
  15 80 03 03 B9 FE 08 1B 00 E1 8B B4 BD 3D 20 
> 04 3E 33 0D 01 1B 00 01 C3 32 7F AF AF 5A 01 00 FF 7F A2 00 
  00 00 00 00 00 00 00 00 19 18 09 5B 4C 47 5D 20 77 65 62 4F 
  53 20 54 56 20 4C 4B 36 31 30 30 50 4C 42

Pretty much nothing else than telegraf related stuff

eireannanl@Jarno-Linux:~/Ruuvi$ sudo grep influx /var/log/syslog|tail -n 20
Dec 27 00:19:43 Jarno-Linux telegraf[9234]: 2020-12-26T22:19:43Z I! Loaded outputs: influxdb
Dec 27 15:19:48 Jarno-Linux telegraf[24017]: 2020-12-27T13:19:48Z I! Loaded outputs: influxdb
Dec 27 15:24:39 Jarno-Linux telegraf[24128]: 2020-12-27T13:24:39Z I! Loaded outputs: influxdb
Dec 27 15:56:41 Jarno-Linux telegraf[24553]: 2020-12-27T13:56:41Z I! Loaded outputs: influxdb
Dec 27 17:09:09 Jarno-Linux telegraf[25377]: 2020-12-27T15:09:09Z I! Loaded outputs: influxdb

Here's what bluetoothctl scan on gives me

[CHG] Device C4:6B:82:1E:4B:42 RSSI: -94
[NEW] Device 79:C5:70:F9:05:11 79-C5-70-F9-05-11
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 06 c4 fe 00 14 ff e8 03 fc b5 36 58 …#…6X
e9 2b d1 9d 98 5b 50 dd .+…[P.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 10 c4 ff 00 10 ff e8 03 f0 b5 36 58 …#…6X
e9 36 d1 9d 98 5b 50 dd .6…[P.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 f8 23 0b c5 00 00 14 ff ec 03 f4 b5 36 58 …#…6X
e9 41 d1 9d 98 5b 50 dd .A…[P.
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Key: 0x0499
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Value:
05 fc 12 84 0d c4 cb 00 34 00 14 04 2c 92 b6 55 …4…,…U
5e ba c3 a8 f4 fc 3a 2f ^…
[CHG] Device DF:64:E3:55:6A:D3 ManufacturerData Key: 0x0499
[CHG] Device DF:64:E3:55:6A:D3 ManufacturerData Value:
05 10 d0 22 a8 c4 98 ff fc ff d0 03 f4 b8 f6 68 …"…h
6e 23 df 64 e3 55 6a d3 n#.d.Uj.
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Key: 0x0499
[CHG] Device D1:9D:98:5B:50:DD ManufacturerData Value:
05 10 fa 23 02 c5 02 00 0c ff ec 03 f4 b5 f6 58 …#…X
e9 60 d1 9d 98 5b 50 dd .`…[P.
[CHG] Device C3:A8:F4:FC:3A:2F RSSI: -85
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Key: 0x0499
[CHG] Device C3:A8:F4:FC:3A:2F ManufacturerData Value:
05 fc 12 84 16 c4 cc 00 34 00 14 04 28 91 f6 55 …4…(…U
5e bf c3 a8 f4 fc 3a 2f ^…
[CHG] Device E3:C9:88:59:4D:8D ManufacturerData Key: 0x0499
[CHG] Device E3:C9:88:59:4D:8D ManufacturerData Value:
05 0f e0 23 29 c4 5d ff e4 ff ec 03 f0 bc b6 9c …#).]…
6e 61 e3 c9 88 59 4d 8d na…YM.

I do recognize most mac addresses I see in bluetoothctl scan on

dgerman · December 27, 2020, 4:25pm

hcitool error “Set scan parameters failed: Input/output error” is somewhat ambiguous. For example it is output if you don’t have permissions (forgot sudo) as well as if there is an instance of hcitool already running (like invoked by ruuvicollector)

In any case it seems that you are correct in that the important thing is hcidump is outputting packet dumps.

post output from:

grep --invert-match ‘^#’ ruuvi-collector.properties | grep --invert-match ‘^.$’

dgerman · December 27, 2020, 4:55pm

also

systemctl status influxd

influx
show databases #not including ruuvi is bad

Eireannanl · December 27, 2020, 4:59pm

Here's terminal output for greps

[quote=“dgerman, post:10, topic:4569, full:true”]
hcitool error “Set scan parameters failed: Input/output error” is somewhat ambiguous. For example it is output if you don’t have permissions (forgot sudo) as well as if there is an instance of hcitool already running (like invoked by ruuvicollector)

In any case it seems that you are correct in that the important thing is hcidump is outputting packet dumps.

post output from:

> grep --invert-match ‘^#’ ruuvi-collector.properties | grep --invert-match ‘^.$’
[/quote]

eireannanl@Jarno-Linux:~/Desktop$ grep --invert-match '^#' /home/eireannanl/Ruuvi/ruuvi-collector.properties|grep --invert-match '^.$'

influxUrl=http://jarno-linux.localhost:8086/

influxDatabase=ruuvi

influxMeasurement=ruuvi_measurements





filter.mode=none


storage.method=dummy

storage.values=extended

systemctl status influxd

 influxdb.service - InfluxDB is an open-source, distributed, time series databa>
     Loaded: loaded (/lib/systemd/system/influxdb.service; enabled; vendor prese>
     Active: active (running) since Sun 2020-12-27 18:44:46 EET; 11min ago
       Docs: https://docs.influxdata.com/influxdb/
   Main PID: 5885 (influxd)
      Tasks: 15 (limit: 18776)
     Memory: 29.4M
     CGroup: /system.slice/influxdb.service
             └─5885 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

joulu 27 18:54:51 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:54:52 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:54:55 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:02 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:12 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:20 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:22 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:25 Jarno-Linux influxd[5885]: [httpd] fe80::cb8:fef5:276:4de7%wlp>
joulu 27 18:55:32 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
joulu 27 18:55:43 Jarno-Linux influxd[5885]: [httpd] 127.0.0.1 - - [27/Dec/2020:>
~
~
~

Database has ruuvi as I have created it with “create database ruuvi”. As far as I know (which is very little), it doesn’t have any effect whether it is there or not.

show databases

eireannanl@Jarno-Linux:~$ influx
Connected to http://localhost:8086 version 1.8.3
InfluxDB shell version: 1.8.3
> show databases
name: databases
name
----
telegraf
_internal
ruuvi
>

dgerman · December 27, 2020, 10:05pm

Restore (or comment out

storage.method=dummy
Logs the measurements to the log rather than sending them anywhere, feasible for testing and development

Increase the width (number of columns) for your terminal and issue

systemctl status influxd --lines=50 --no-pager

systemctl IMHO is rude and stops outputting at the edge of the terminal window!

we are looking for many

Dec 27 16:43:22 pi93graf influxd[4866]: [httpd] 127.0.0.1 - ruuvi [27/Dec/2020:16:43:20 -0500] “POST /write?db=ruuvi&rp=autogen&precision=n&consistency=one HTTP/1.1” 204 0 “-” “okhttp/3.11.0” 897bf962-488c-11eb-b7c8-b827eb1c5b93 2490110

At least up through the okhttp/3.11.0

Eireannanl · December 28, 2020, 3:35am

Here's InfluxDB stuff you requested

[quote=“dgerman, post:13, topic:4569”]
Increase the width (number of columns) for your terminal and issue

eireannanl@Jarno-Linux:~$ systemctl status influxd --lines=50 --no-pager -l
● influxdb.service - InfluxDB is an open-source, distributed, time series database
     Loaded: loaded (/lib/systemd/system/influxdb.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2020-12-28 05:25:15 EET; 5min ago
       Docs: https://docs.influxdata.com/influxdb/
   Main PID: 1052 (influxd)
      Tasks: 14 (limit: 18776)
     Memory: 133.0M
     CGroup: /system.slice/influxdb.service
             └─1052 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

joulu 28 05:28:43 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:28:43 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" c949fee4-48bc-11eb-8043-f07959609fdf 34472
joulu 28 05:28:53 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:28:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" cf2318ae-48bc-11eb-8044-f07959609fdf 236363
joulu 28 05:28:53 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:28:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" cf3fed90-48bc-11eb-8045-f07959609fdf 272263
joulu 28 05:29:03 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:03 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" d535ce04-48bc-11eb-8046-f07959609fdf 480759
joulu 28 05:29:12 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:11 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" da61955b-48bc-11eb-8047-f07959609fdf 47598
joulu 28 05:29:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:13 +0200] "GET /ping HTTP/1.1" 204 0 "-" "InfluxDBShell/1.8.3" db06b775-48bc-11eb-8048-f07959609fdf 42
joulu 28 05:29:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:13 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" db2bbb98-48bc-11eb-8049-f07959609fdf 47338
joulu 28 05:29:16 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:16.364916Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW DATABASES"
joulu 28 05:29:16 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:16 +0200] "POST /query?chunked=true&db=&epoch=ns&q=show+databases HTTP/1.1" 200 123 "-" "InfluxDBShell/1.8.3" dcfe71f5-48bc-11eb-804a-f07959609fdf 723
joulu 28 05:29:19 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:19.765402Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW DATABASES"
joulu 28 05:29:19 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:19 +0200] "POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1" 200 123 "-" "InfluxDBShell/1.8.3" df055349-48bc-11eb-804b-f07959609fdf 666
joulu 28 05:29:23 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:23 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e121a49d-48bc-11eb-804c-f07959609fdf 354327
joulu 28 05:29:23 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:23.728791Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SHOW MEASUREMENTS ON ruuvi"
joulu 28 05:29:23 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:23 +0200] "POST /query?chunked=true&db=ruuvi&epoch=ns&q=show+measurements HTTP/1.1" 200 57 "-" "InfluxDBShell/1.8.3" e1621699-48bc-11eb-804d-f07959609fdf 516
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.543656Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT usage_user, usage_system FROM telegraf.autogen.\"Server CPU\" WHERE (cpu = 'cpu-total') AND time >= now() - 12h"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.545106Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.546488Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(used) / (1024 * 1024 * 1024), mean(free) / (1024 * 1024 * 1024) FROM telegraf.autogen.\"Server Memory\" WHERE (host = 'Jarno-Linux') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.547003Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'GPU Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%28linear%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27GPU+Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%28linear%29 HTTP/1.1" 200 11891 "-" "Grafana/7.3.6" e1de91eb-48bc-11eb-804f-f07959609fdf 9540
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.554588Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'CPU Total') AND time >= now() - 12h GROUP BY time(1m) fill(none)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.555549Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (hardware = 'NVIDIA GeForce GTX 970') AND time >= now() - 12h GROUP BY time(1m) fill(none)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22used%22%29++%2F+%281024%2A1024%2A1024%29%2C+mean%28%22free%22%29++%2F+%281024%2A1024%2A1024%29+FROM+%22Server+Memory%22+WHERE+%28%22host%22+%3D+%27Jarno-Linux%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29 HTTP/1.1" 200 12255 "-" "Grafana/7.3.6" e1ded8f0-48bc-11eb-8050-f07959609fdf 10102
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27CPU+Total%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28none%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28none%29 HTTP/1.1" 200 4571 "-" "Grafana/7.3.6" e1e0169a-48bc-11eb-8051-f07959609fdf 4554
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.562516Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'CPU Total') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.563534Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (hardware = 'NVIDIA GeForce GTX 970') AND time >= now() - 12h GROUP BY time(1m)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+%22usage_user%22%2C+%22usage_system%22+FROM+%22Server+CPU%22+WHERE+%28%22cpu%22+%3D+%27cpu-total%27%29+AND+time+%3E%3D+now%28%29+-+12h HTTP/1.1" 200 47293 "-" "Grafana/7.3.6" e1de5f0c-48bc-11eb-804e-f07959609fdf 22895
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27CPU+Total%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28null%29 HTTP/1.1" 200 6171 "-" "Grafana/7.3.6" e1e1500b-48bc-11eb-8052-f07959609fdf 5901
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.569872Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'GPU Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.571193Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Load WHERE (sensor = 'Memory') AND time >= now() - 12h GROUP BY time(1m), hardware fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27GPU+Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Load%22+WHERE+%28%22sensor%22+%3D+%27Memory%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29%2C+%22hardware%22+fill%280%29 HTTP/1.1" 200 5801 "-" "Grafana/7.3.6" e1e26dc3-48bc-11eb-8053-f07959609fdf 4570
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.588507Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Temperature WHERE (hardware = 'AMD Ryzen 5 5600X' AND sensor = 'Core (Tctl/Tdie)') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.590386Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Temperature WHERE (hardware = 'NVIDIA GeForce GTX 970' AND sensor = 'GPU Core') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Temperature%22+WHERE+%28%22hardware%22+%3D+%27AMD+Ryzen+5+5600X%27+AND+%22sensor%22+%3D+%27Core+%28Tctl%2FTdie%29%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Temperature%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27+AND+%22sensor%22+%3D+%27GPU+Core%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 3917 "-" "Grafana/7.3.6" e1e5433d-48bc-11eb-8054-f07959609fdf 7009
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.698069Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Power WHERE (hardware = 'AMD Ryzen 5 5600X' AND sensor = 'Package Power') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.699236Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Throughput WHERE (sensor = 'Upload Speed' AND hardware = 'Ethernet') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.702383Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Power WHERE (hardware = 'NVIDIA GeForce GTX 970' AND sensor = 'GPU Package') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.702852Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(value) FROM telegraf.autogen.Throughput WHERE (sensor = 'Download Speed' AND hardware = 'Ethernet') AND time >= now() - 12h GROUP BY time(1m) fill(0)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Power%22+WHERE+%28%22hardware%22+%3D+%27AMD+Ryzen+5+5600X%27+AND+%22sensor%22+%3D+%27Package+Power%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Power%22+WHERE+%28%22hardware%22+%3D+%27NVIDIA+GeForce+GTX+970%27+AND+%22sensor%22+%3D+%27GPU+Package%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 5369 "-" "Grafana/7.3.6" e1f5eefd-48bc-11eb-8056-f07959609fdf 10345
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22value%22%29+FROM+%22Throughput%22+WHERE+%28%22sensor%22+%3D+%27Upload+Speed%27+AND+%22hardware%22+%3D+%27Ethernet%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29%3BSELECT+mean%28%22value%22%29+FROM+%22Throughput%22+WHERE+%28%22sensor%22+%3D+%27Download+Speed%27+AND+%22hardware%22+%3D+%27Ethernet%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%280%29 HTTP/1.1" 200 6178 "-" "Grafana/7.3.6" e1f5eeaa-48bc-11eb-8055-f07959609fdf 10670
joulu 28 05:29:24 Jarno-Linux influxd[1052]: ts=2020-12-28T03:29:24.729413Z lvl=info msg="Executing query" log_id=0RLquNXW000 service=query query="SELECT mean(used) / (1024 * 1024 * 1024) FROM telegraf.autogen.\"Server Disk\" WHERE (device = 'sda5') AND time >= now() - 12h GROUP BY time(1m) fill(linear)"
joulu 28 05:29:24 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0, fe80::cb8:fef5:276:4de7%wlp5s0,127.0.0.1 - admin [28/Dec/2020:05:29:24 +0200] "GET /query?db=telegraf&epoch=ms&q=SELECT+mean%28%22used%22%29++%2F+%281024%2A1024%2A1024%29+FROM+%22Server+Disk%22+WHERE+%28%22device%22+%3D+%27sda5%27%29+AND+time+%3E%3D+now%28%29+-+12h+GROUP+BY+time%281m%29+fill%28linear%29 HTTP/1.1" 200 6849 "-" "Grafana/7.3.6" e1fac44e-48bc-11eb-8057-f07959609fdf 7964
joulu 28 05:29:33 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:33 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e6f2338c-48bc-11eb-8058-f07959609fdf 36033
joulu 28 05:29:33 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:33 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" e7178cf1-48bc-11eb-8059-f07959609fdf 41118
joulu 28 05:29:41 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:41 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" ec10251a-48bc-11eb-805a-f07959609fdf 46448
joulu 28 05:29:43 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:43 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" ed0d752e-48bc-11eb-805b-f07959609fdf 43952
joulu 28 05:29:54 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:29:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f2e76fc4-48bc-11eb-805c-f07959609fdf 901086
joulu 28 05:29:54 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:29:53 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f30359b5-48bc-11eb-805d-f07959609fdf 751316
joulu 28 05:30:03 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:30:03 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" f8f93e7b-48bc-11eb-805e-f07959609fdf 37905
joulu 28 05:30:11 Jarno-Linux influxd[1052]: [httpd] fe80::cb8:fef5:276:4de7%wlp5s0 - - [28/Dec/2020:05:30:11 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "-" fded8ac1-48bc-11eb-805f-f07959609fdf 39138
joulu 28 05:30:13 Jarno-Linux influxd[1052]: [httpd] 127.0.0.1 - - [28/Dec/2020:05:30:13 +0200] "POST /write?db=telegraf HTTP/1.1" 204 0 "-" "Telegraf/1.17.0 Go/1.15.5" feef1d45-48bc-11eb-8060-f07959609fdf 33749

I had dummy on as I was testing if I would see some log where ruuvi-collector would write those but couldn’t find one.

Oh, and bluez didn’t like me, gave me bluetooth failed to set mode failed (0x03) in logs and org.bluez.error.notready when I tried to use bluetoothctl scan on

otso · December 28, 2020, 8:52am

RuuviCollector uses HCIDump internally, so your case might need some reworking of the program to support bluetoothctl.

I’m not sure what the data on your hcidump is, but it’s not from RuuviTags.

Eireannanl · December 28, 2020, 9:55am

Where else could that data come from since those Mac addresses are my tags’ addresses.

D1:9D:98:5B:50:DD is tag’s address which I’m currently holding. I have 6 tags total.

Reworking sounds like awfully many hours googling stuff . Especially when I’m doing that.

otso · December 28, 2020, 11:28am

bluetoothctl scan is from RuuviTags,

is something else.

https://github.com/Scrin/RuuviCollector/blob/3970d5b8520f6e4005d4f23e0c8d225ff886a255/src/main/java/fi/tkgwf/ruuvi/Main.java#L40 looks like the place that would need to be reworked to support bluetoothctl, or possibly the run() could pick the correct implementation somehow.

@scrin FYI

Eireannanl · December 28, 2020, 11:49am

I see. Well, I’m able to do something with my Linux day after tomorrow so if I’m lucky, Scrin might have solution by then.

I haven’t compared bluetoothctl scan and hcidump --raw but I’m sure you know what you are talking about.

dgerman · December 28, 2020, 3:11pm

As Otso said, the hcidump you posted does not include any packets
that have Ruuvi ID x’0499’ which appear as 99 at the end of the hcidump line and the 04 is on the next line.
Example

hcidump --raw |grep --after-context=2 ‘FF 99 $’

04 3E 2B 02 01 03 01 1A 1E 4A 74 FA F7 1F 02 01 06 1B FF 99
04 05 11 94 34 CD C5 4C 00 0C FF DC 04 00 97 F6 9C 39 77 F7
FA 74 4A 1E 1A B9
–
04 3E 2B 02 01 00 01 0F EC 72 78 51 D3 1F 02 01 04 1B FF 99
04 05 0A CE 65 02 C5 21 00 D4 00 0C 03 CC A2 F6 00 BF C4 D3
51 78 72 EC 0F 9E

Which explains why you do not see any log entries from

systemctl status ruuvicollector

which include

…ruuvi [27/Dec/2020:16:43:20 -0500] “POST /write?db=ruuvi…

Scrin · December 29, 2020, 6:07pm

There’s actually a way to set the “scan command” in the configuration, which by default is hcitool lescan --duplicates --passive. This would need to be changed to the bluetoothctl equivalent to start the BT LE scanning (as the broadcast packets from RuuviTags are not visible in BT Classic scanning). I’m not too familiar with bluetoothctl (yet) so I’m not sure on this one.

Any mechanism that starts the process of receiving the LE packets from the (physical) bluetooth controller to the OS is sufficient, as RuuviCollector grabs the raw packets from the bluez stack using hcidump. This can even be some crazy script that does some very low level poking to the controller directly, or any command of more “high level” tools to get the same result.