Filter unwanted values / spikes from data

Moderators: grovkillen, Stuntteam, TD-er

Post Reply
Message
Author
Prutsium
Normal user
Posts: 39
Joined: 29 Mar 2018, 15:39
Location: Germany / Netherlands

Filter unwanted values / spikes from data

#1 Post by Prutsium » 08 Oct 2018, 10:50

Hi all,

I am running here on my heater system an additional ESP to calculate the Delta-T from the water in / out so that i would be able to keep this at an optimal level so condensation (gas heater) is optimal.
This all works great by reading the in / out temperature and substracting them and dump the result into a dummy sensor.

But from time to time i get some nasty spikes and since all is stored into a DB to create visualisation with Grafana it looks not so nice :)

My idea is to filter these spikes out somehow with a potential rule within the ESP but i could not find anything specific then just do an action if value = > XX Level

The setup:
ESP: (See the black marked area's)
Image

Grafana: (See the red marked area these are the spikes i want to get rid of)
Image

The current rule to fill the Dummy sensor:
On Living_Radiator_In#Temp_3 do
TaskValueSet 7,1,[Living_Radiator_In#Temp_3]-[Living_Radiator_Out#Temp_4]
endon

Question is: How to filter these sudden drops ....

Thanks!
Jerome

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: Filter unwanted values / spikes from data

#2 Post by grovkillen » 08 Oct 2018, 12:27

If it's always a one point that is extremely off then you can use one of the left over dummy values. Add the data point to that one and compare the new data point with that dummy. If the value differs more than a set threshold you just skip to publish it to the database.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

Post Reply

Who is online

Users browsing this forum: Google [Bot] and 25 guests