Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Theta Sketch Aggregation Enhancements #12042

Merged
merged 14 commits into from
Dec 5, 2023

Commits on Nov 22, 2023

  1. Theta Sketch Aggregation Enhancements

    Introduces additional parameters to the DistinctCountThetaSketch aggregation function that
    give the end-user more control over how sketches are merged.  The defaults are selected
    to ensure that the behaviour remains unchanged over the current implementation.
    
    Furthermore, an accumulator custom object is added to ensure that pairwise union
    operations are avoided as much as possible.  Instead, sketches can be aggregated
    and merged when a threshold is met.
    davecromberge committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    97826ed View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4fd6650 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6e45abc View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Decrease default constant value

    This better aligns to the default nominal values parameter
    that is used in the query aggregation function.
    davecromberge committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    44db64e View commit details
    Browse the repository at this point in the history
  2. Attempt 2: Simplify implementation

    Removes intermediate array list to buffer/accumulate sketch
    elements.  Instead, inputs are fed directly to the underlying
    union.  This ensures that the memory usage of the merge is
    kept under control.
    davecromberge committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    2ed38f3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3a9e21a View commit details
    Browse the repository at this point in the history
  4. Minor code improvements

    davecromberge committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    0ffffaa View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. Merge branch 'master' of https://github.com/davecromberge/pinot into …

    …theta-sketch-accumulator
    davecromberge committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    d177213 View commit details
    Browse the repository at this point in the history
  2. Revert "Attempt 2: Simplify implementation"

    This reverts commit 2ed38f3.
    davecromberge committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    4e78fc6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    595c170 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. Merge branch 'master' of https://github.com/davecromberge/pinot into …

    …theta-sketch-accumulator
    davecromberge committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    582ded3 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. Merge branch 'master' of https://github.com/davecromberge/pinot into …

    …theta-sketch-accumulator
    davecromberge committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    90cde3a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    90d4562 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2023

  1. Configuration menu
    Copy the full SHA
    bebf993 View commit details
    Browse the repository at this point in the history