influxdb

[sx3]

Thanks admin, that worked fine!
However, the script pushes a hell load of data to influx that is not really necessary.
I could use the "range" tip from above, but using "tags" would be easier and more flexible for future changes.
I tried my best, but I don't think I understand event.getvalue to be honest.

This particular GA have 2 tags, one of them is "influxdb"

BTW, any suggestion on the timestamp manipulation?

Code:

123456789101112

function knx_callback(event)   local id = event.dstraw   local tagname = event.getvalue(tag)   if tagname == "influxdb" then     local addr = event.dst     local value, dt = get_value(addr, event.datahex)     if value ~= nil then     send_metric('rawdata', dt.name, addr, value)     end   end end

[admin]

Try this rewritten version:

Code:

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960

local http = require('socket.http') http.TIMEOUT = 5 local url = 'http://192.168.1.200:8086/api/v2/write?bucket=XXX&org=XXX' local token = 'XXXXX' local influxtable = 'rawdata' local tagobjs = grp.tag('influxdb') local function escape(value)   return tostring(value):gsub('[\\ ,=]', '\\%1') end local objects = {} for _, obj in ipairs(tagobjs) do   objects[ obj.id ] = {     name = escape(obj.name),     datatype = obj.datatype,   } end local function send(name, addr, value)   local body   if type(value) == 'boolean' then     body = string.format('%s,name=%s,addr=%s state=%s', influxtable, name, addr, value)   else     body = string.format('%s,name=%s,addr=%s value=%s', influxtable, name, addr, escape(value))   end   local res, code = http.request({     url = url,     method = 'POST',     body = body,     headers = {       Authorization = 'Token ' .. token     }   })   if code ~= 204 then     log('error sending to influx', res, code, body)   end end local busclient = require('localbus').new(60) busclient:sethandler('groupwrite', function(event)   local obj = objects[ event.dstraw ]   if obj then     local value = busdatatype.decode(event.datahex, obj.datatype)     if value ~= nil then       send(obj.name, event.dst, value)     end   end end) while true do   busclient:loop(60) end

[tigi]

Hi admin,

Above script is working perfectly however is there a way I can use this as a scheduled script?
I see it's now kept resident and sends data according what is generated by the objects and that can be alot making one object hijacking the stream.

I tried changing the busclient and while loop part but without any success, it only sends one objects data and then stops.
Is there any info on the localbus and how to use it?

Thanks!

[admin]

You don't need localbus for this as the current object value is already stored in the database.

Code:

1234567891011121314151617181920212223242526272829303132333435363738

local http = require('socket.http') http.TIMEOUT = 5 local url = 'http://192.168.1.200:8086/api/v2/write?bucket=XXX&org=XXX' local token = 'XXXXX' local influxtable = 'rawdata' local tagobjs = grp.tag('influxdb') local function escape(value)   return tostring(value):gsub('[\\ ,=]', '\\%1') end local function send(name, addr, value)   local body   if type(value) == 'boolean' then     body = string.format('%s,name=%s,addr=%s state=%s', influxtable, name, addr, value)   else     body = string.format('%s,name=%s,addr=%s value=%s', influxtable, name, addr, escape(value))   end   local res, code = http.request({     url = url,     method = 'POST',     body = body,     headers = {       Authorization = 'Token ' .. token     }   })   if code ~= 204 then     log('error sending to influx', res, code, body)   end end for _, obj in ipairs(tagobjs) do   send(escape(obj.name), obj.address, obj.value) end

[tigi]

Hi Admin,

Thank you very much for clearing that out and for the solution.

Greetings

[sx3]

I have noted that influxDB somehow doesn't like the BOOL values sent to it. When trying to show the values I get the error "unsupported input type for mean aggregate: boolean"
If I set aggregate function to last in influxDB, it just give me an infinite line. Doesn't show the actual state of True/false.

Should the BOOL values also be "escape(value)" as the strings?

[admin]

A possible solution is to send 1/0 instead of true/false. Then you can use aggregate functions.

Code:

12345

  if type(value) == 'boolean' then     value = value and 1 or 0   end   body = string.format('%s,name=%s,addr=%s value=%s', influxtable, name, addr, escape(value))

[DGrandes]

Hi!

I have a problem sending strings to influxdb

How can I send 250bytes or 14bytes strings?

I've tried with

Code:

1234567891011

local function escape(value)   return tostring(value):gsub('[\\ ,=]', '\\%1') end if type(value) == 'string' then     body = string.format('%s,name=%s,addr=%s string=%s', influxtable, name, addr, escape(value)) end if type(value) == 'string' then     body = string.format('%s,name=%s,addr=%s string=%s', influxtable, name, addr, value) end

but doesn´t work. This is the error:

Code:

1

  * string: {"code":"invalid","message":"unable to parse 'DatosLM,name=PruebaString,addr=32/1/4 value=Probando\\ String': invalid boolean"}

[admin]

You need to use a different field name for each data type (boolean, number, string). See how it's done here: https://kb.logicmachine.net/integration/influxdb/

It looks like you've already written a boolean value into "string" field so it won't accept string data into this field anymore. Either choose a different field name and modify the script accordingly. Or delete the bucket and create it again.

[DGrandes]

Thanks! It works

I don´t know whiy doesn´t work because I try with diferent "field" names. But now it works.

[DGrandes]

Hi!

I have a question about Grafana representacion of influxdb data. I know that is grafana question but anyone says nothing, this forum is not active... Mayby somebody made.
I send data from LM to influxdb when they change, no in scheduled script.

If I put time filter I can't see the first value (the value before the change). And if there are no changes in the data in the filter, it says "No data". Is there a way to represent the last value in the database if there are no changes?

[admin]

You can setup a scheduled script that periodically sends the current value. I don't see any other solution.

[DGrandes]

You can setup a scheduled script that periodically sends the current value. I don't see any other solution.

Ok thanks! that's what I had thought.
I was wondering if there was another way to save the data in real time.

Thanks!

[admin]

You can use both resident and scheduled scripts for influxdb in parallel.

[sck]

Hi,
I am trying to export all the data from the bus to influxdb but I am afraid I am not sure whether is working or not since I am not very familiar with influxdb. 
I have tagged all the objects with the proper label and set the script to resident following the indications. I also have configured the proper URL and the token which I have checked works since in Grafana I use the same data. What I don´t see is from the server any bytes received or sent to the influxdb so I suspect is not working well.
I have mainly two questions, One is to know why I am getting so many errors in the error log that I have attached.
The other is to know within my new ´ets´ bucket, what will be the data model so I know how to query the data since I don´t see any familiar fields. If you have any example query to see all the KNX bus data I could try that one.
Thanks!

[admin]

What is influxtable variable set to in your script? It must be a string but it looks like you have a Lua table there.

[sck]

What is influxtable variable set to in your script? It must be a string but it looks like you have a Lua table there.

Hi, I left it as it was in the original script:
local influxtable = 'rawdata'

[admin]

Post your script.

[sck]

Post your script.

Code:

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465

local http = require('socket.http') http.TIMEOUT = 5 local url = 'http://192.168.100.20:8086/api/v2/write?bucket=ets&org=Matrix' local token = 'deleted' local influxtable = 'rawdata' local tagobjs = grp.tag('influxdb') local function escape(value)   return tostring(value):gsub('[\\ ,=]', '\\%1') end local objects = {} for _, obj in ipairs(tagobjs) do   objects[ obj.id ] = {     name = escape(obj.name),     datatype = obj.datatype,   } end local function send(name, addr, value)   local body   if type(value) == 'boolean' then     body = string.format('%s,name=%s,addr=%s state=%s', table, name, addr, value)   elseif type(value) == 'number' then     body = string.format('%s,name=%s,addr=%s value=%s', table, name, addr, value)   elseif type(value) == 'string' then     body = string.format('%s,name=%s,addr=%s string=%q', table, name, addr, value)   else     log('invalid data type', addr, type(value))     return   end   local res, code = http.request({     url = url,     method = 'POST',     body = body,     headers = {       Authorization = 'Token ' .. token     }   })   if code ~= 204 then     log('error sending to influx', res, code, body)   end end local busclient = require('localbus').new(60) busclient:sethandler('groupwrite', function(event)   local obj = objects[ event.dstraw ]   if obj then     local value = busdatatype.decode(event.datahex, obj.datatype)     if value ~= nil then       send(obj.name, event.dst, value)     end   end end) while true do   busclient:loop(60) end

[admin]

Turns out the script is not fully correct. To fix this replace table with influxtable on line 26, 28 and 30.