Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[filebeat][awss3] - Added support for parquet decoding and decoder config #35578

Merged
merged 56 commits into from
Jun 20, 2023
Merged

[filebeat][awss3] - Added support for parquet decoding and decoder config #35578

merged 56 commits into from
Jun 20, 2023

Commits on Apr 24, 2023

  1. initial commit for s3 parquet support

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    ffe109d View commit details
    Browse the repository at this point in the history

  2. updated changelog

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    5295efd View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    0f5b475 View commit details
    Browse the repository at this point in the history

  4. added license updates

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    b41aa40 View commit details
    Browse the repository at this point in the history

  5. updated notice and go mod/sum

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    83598fa View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into awss3/parquet

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    1ad3fe9 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    f7c5498 View commit details
    Browse the repository at this point in the history

  8. removed libgering panic

    @ShourieG
    ShourieG committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    ec642f5 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. added parquet benchmark tests

    @ShourieG
    ShourieG committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    1664648 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    8f56a5e View commit details
    Browse the repository at this point in the history

  3. updated osquery package due to update in dependant thrift package

    @ShourieG
    ShourieG committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    4d090a3 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. added parquet reader with benchmark tests and implemented that reader… 

    … in awss3 package
    @ShourieG
    ShourieG committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    b370093 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    e8e45af View commit details
    Browse the repository at this point in the history

  3. addressed linting errors

    @ShourieG
    ShourieG committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    2ff7b38 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. refactored parquet reader, added tests and benchmarks and addressed p… 

    …r comments
    @ShourieG
    ShourieG committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    2d8321b View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    cbf864c View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. addressed pr comments

    @ShourieG
    ShourieG committed May 2, 2023
    Configuration menu
    Copy the full SHA
    42b7d06 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed May 2, 2023
    Configuration menu
    Copy the full SHA
    8119a06 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2023

  1. resolved merged conflicts

    @ShourieG
    ShourieG committed May 8, 2023
    Configuration menu
    Copy the full SHA
    6e6687d View commit details
    Browse the repository at this point in the history

  2. resolved merged conflicts

    @ShourieG
    ShourieG committed May 8, 2023
    Configuration menu
    Copy the full SHA
    2c9d32a View commit details
    Browse the repository at this point in the history

  3. updated notice

    @ShourieG
    ShourieG committed May 8, 2023
    Configuration menu
    Copy the full SHA
    8c536a4 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. added more parquet file tests with json comparisons, addressed pr com… 

    …ments
    @ShourieG
    ShourieG committed May 9, 2023
    Configuration menu
    Copy the full SHA
    9b2e330 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into awss3/parquet

    @ShourieG
    ShourieG committed May 9, 2023
    Configuration menu
    Copy the full SHA
    35df388 View commit details
    Browse the repository at this point in the history

  3. removed commented codeS

    @ShourieG
    ShourieG committed May 9, 2023
    Configuration menu
    Copy the full SHA
    fc9c0c6 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. removed bad imports & cleaned up tests

    @ShourieG
    ShourieG committed May 12, 2023
    Configuration menu
    Copy the full SHA
    ed6edca View commit details
    Browse the repository at this point in the history

  2. updated notice

    @ShourieG
    ShourieG committed May 12, 2023
    Configuration menu
    Copy the full SHA
    6384a11 View commit details
    Browse the repository at this point in the history

  3. added graceful closures with err checks in test

    @ShourieG
    ShourieG committed May 12, 2023
    Configuration menu
    Copy the full SHA
    47c61a1 View commit details
    Browse the repository at this point in the history

  4. added graceful closures with err checks in test

    @ShourieG
    ShourieG committed May 12, 2023
    Configuration menu
    Copy the full SHA
    3049ee5 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. merged with upstream and resolved conflicts

    @ShourieG
    ShourieG committed May 23, 2023
    Configuration menu
    Copy the full SHA
    7330873 View commit details
    Browse the repository at this point in the history

  2. updated go sum

    @ShourieG
    ShourieG committed May 23, 2023
    Configuration menu
    Copy the full SHA
    7aca5fa View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. added support for parquet decoding in awss3 input

    @ShourieG
    ShourieG committed May 25, 2023
    Configuration menu
    Copy the full SHA
    4e60653 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed May 25, 2023
    Configuration menu
    Copy the full SHA
    3c31cf5 View commit details
    Browse the repository at this point in the history

  3. updated changelog

    @ShourieG
    ShourieG committed May 25, 2023
    Configuration menu
    Copy the full SHA
    12c93ce View commit details
    Browse the repository at this point in the history

  4. updated NOTICE

    @ShourieG
    ShourieG committed May 25, 2023
    Configuration menu
    Copy the full SHA
    807e0b5 View commit details
    Browse the repository at this point in the history

  5. updated NOTICE

    @ShourieG
    ShourieG committed May 25, 2023
    Configuration menu
    Copy the full SHA
    78ca3af View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed May 26, 2023
    Configuration menu
    Copy the full SHA
    a7f35b0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 's3/parquet' of github.com:ShourieG/beats into s3/parquet

    @ShourieG
    ShourieG committed May 26, 2023
    Configuration menu
    Copy the full SHA
    e8582d7 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed May 27, 2023
    Configuration menu
    Copy the full SHA
    7611baf View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed May 30, 2023
    Configuration menu
    Copy the full SHA
    fa6367d View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed May 31, 2023
    Configuration menu
    Copy the full SHA
    7df4854 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    1b8bff5 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    0b8a71a View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    41f9885 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    ba7927a View commit details
    Browse the repository at this point in the history

  2. refactored the decoder interface

    @ShourieG
    ShourieG committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    a0fb21f View commit details
    Browse the repository at this point in the history

  3. updated docs

    @ShourieG
    ShourieG committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    5005542 View commit details
    Browse the repository at this point in the history

  4. updated changelog

    @ShourieG
    ShourieG committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    3f627e7 View commit details
    Browse the repository at this point in the history

  5. updated the tests to read prettified json

    @ShourieG
    ShourieG committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    392e89e View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    c92bf31 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    4b458e0 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. updated offset tracking logic

    @ShourieG
    ShourieG committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    f296baf View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    414bd70 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    24dafcf View commit details
    Browse the repository at this point in the history

  2. updated docs

    @ShourieG
    ShourieG committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    bf214a7 View commit details
    Browse the repository at this point in the history

  3. added event offset logic

    @ShourieG
    ShourieG committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    e536a51 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into s3/parquet

    @ShourieG
    ShourieG committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    f9d2859 View commit details
    Browse the repository at this point in the history