Mimic statistics-graph, add min/max/mean aggregation

[r-jean-pierre]

Dear all,

I discovered recently this custom:plotly-graph. I would like to "replicate" what statistics-graph is able to do by displaying min/mean/max of a sensor. As the final result is quite beautiful, there is no way to really tweak statistics-graph or to have an hand on how statistics are computed.

Here is where I am:

Obviously I used the trick
line: shape: spline
to smooth a bit the original raw data on the bottom plotly graph, but how to really control an aggregation such as min/mean/max over 8H without too much pain :-) as in the top graph?

I already saw a piece of code to average over M minutes, but it seems tricky (or probably not sustainable) and doesn't compute well for first & last valuers of the time series (well, maybe for that part it's just because I'm not good in coding/maths :-) )
Anyhow, it will required to code min & max and add to any sensor and handle may degenerate cases

Any magic command to do it without an headache and a 10MB yaml file?

Thanks!

[FrnchFrgg]

I just filed #77 to have long-term statistics support, because the vanilla statistics graph card does not compute nor aggregate this data but relies on the backend statistics.

[dbuezas]

Yeah, I guess I'll have to sooner or later bite the bullet and implement both pre-made filters and long term statistics support.
I think the latter is not that easy, so I need to first motivate myself to do it. In that regard, what is it that you use the long statistics so much for? If I miss it myself, I'm more likely to get to it :)

[FrnchFrgg]

See https://community-assets.home-assistant.io/original/4X/7/4/5/745adea2c86b8020e1d8458a0231952474f8e20c.png for a look of my air temp history with local extrema (yes, apexcharts smoothing is horrendous because it creates horizontal tangents at every point so I even disabled it and live with straight-line interpolation now)

[r-jean-pierre]

Your last graph is already great as besides my question about "aggregation", I also wanted to display a text on min/max value on the line itself. It even seems that you were able to display local extremum on your green line, how did you do that?

[FrnchFrgg]

This is not lovelace-plotly-graph-card but apexcharts-card. If lovelace-plotly-graph-card is able to display individual points with values for series, then it is a matter of correctly decimating the list of points to only keep local extrema in the lambda transform. I'll post a show and tell or a pull request for the readme once I have investigated further (I am totally new to this card, hoping to transition from apexcharts to plotly). Note that this will probably mean a somewhat big lambda and thus a big YAML definition (not more than the derivative or Riemann examples but probably as big).

[r-jean-pierre]

Okay nice, I started to be jealous to not be able to replicate it.
I also played with apexcharts-card, it has also cool stuff, and aggregates easily, but at some point, I could find "one line ticks" in other cards that are also missing in apex. I'm still looking for the holy grail with one unique component to do everything I want :)
Besides, I played with plotly directly in python, then I have to recognize that if the coder do the statistical job and store computations and intermediate results in a dataframe, then the magic of plotly appears :). If you do the maths yourself, it's as fancy as seaborn or other similar libs. Unfortunately I doubt it could be transposed as easily as in a flat yaml file in HA...

[FrnchFrgg]

apexcharts-card is the first (and only, as far as I know, until my PR is merged) third-party graph card supporting long term statistics. That is why I used it. But it is sometimes overly complex to do simple stuff (like adding a vertical grid), and its filtering system equivalent to lambda is not able to "see" the set of points as a whole.

[FrnchFrgg]

@r-jean-pierre plotly now can fetch long-term statistics for you to play with.

[r-jean-pierre]

This is wonderful, I'm gonna test!

[dbuezas]

It is! And @FrnchFrgg made that possible!

[FrnchFrgg]

I only wrote a proof of concept and most of the real work was done by @dbuezas including the much better way to configure attributes.

[r-jean-pierre]

So I played with it and it's exactly what I expected!
Great job!

Here is where I am:

On the left the new statistic of plotly-graph (min-mean-max), and on right the statistics-graph component
Although I need to put some efforts on tiny cosmetic, I think the look&feel and the functionalities of plotly-graph are more suitable for me. I will also see if I can drop some apex-charts and other graph components i used in order to focus only on plotly-graph

Again: a huge "thank you!"

[r-jean-pierre]

Thanks for your help, but in my specific case, it fails.
But on a tinier example:

  - type: custom:plotly-graph  # Fridge
    entities:
    - entity: sensor.ths_fridge_humidity
      statistic: max
    - entity: sensor.ths_fridge_humidity
      statistic: min
      fill: tonexty
    defaults:
      entity:
        statistic: mean
        line:
          shape: spline
          width: 2
    hours_to_show: 10`

I think I need to start from this state and reconstruct line after line what I wanted to see and understand when it breaks

I'll keep you informed

[dbuezas]

oh damnit. i think I know what's going on. please confirm that removing show_value fixes it @r-jean-pierre

[dbuezas]

created #87

[dbuezas]

fixed in latest version, you were very right. Thanks for reporting!

[r-jean-pierre]

Yes, definitely yes:

It works exactly as expected, even the fillcolor

[FrnchFrgg]

BTW, next release of HA will add a "week" period for statistics, and it seems things are moving toward the ability to import data into statistics from other sources (say your electricity bills from 10 years ago).