v1.6.1-community

What's Changed

Breaking changes 🛠

• Add new filters allowing FLP-based dedup by @jotak in #640

Non-breaking changes

• NETOBSERV-1522 Add otel to pipeline builder by @jpinsonneau in #672
• NETOBSERV-1707: move to go 1.22 by @jotak in #675
• Add .ci-operator.yaml by @jotak in #680

Dependencies

• Bump github.com/prometheus/client_golang from 1.19.0 to 1.19.1 by @dependabot in #665
• Bump google.golang.org/protobuf from 1.33.0 to 1.34.1 by @dependabot in #670
• Bump github.com/spf13/viper from 1.18.2 to 1.19.0 by @dependabot in #673

Full Changelog: v1.6.0-community...v1.6.1-community

v1.6.0-community

What's Changed

Breaking changes 🛠

• NETOBSERV-1425: enhance metrics filters by @jotak in #602
• API cleanup: remove deprecated metric.filter by @jotak in #613
• NETOBSERV-1500 : Refactoring of transform network API by @OlivierCazade in #580
• NETOBSERV-1466 Update eBPF dependency for FLP by @jpinsonneau in #601
• Enum replacement in API by @jotak in #614
• NETOBSERV-1426: subnet labelling enhancements by @jotak in #586

Non-breaking changes

• Fix yaml unmarshaling of inlined config by @jotak in #596
• Add test on IPFIX writer by @jotak in #606
• Refactor metrics by @KalmanMeth in #590
• Add new field to ipfix exporter for flowRtt by @bhale in #603
• (trivial) Report error when Kafka connection is broken by @jotak in #615
• Add test covering use of viper with unmarshaller by @jotak in #623
• NETOBSERV-1471 add gRPC write stage by @jpinsonneau in #621
• NETOBSERV-1514: drop go1.20 support by @jotak in #629
• Provide k8s templates to just deploy an ipfix collector by @jotak in #633
• NETOBSERV-1566: ipfix: make RTT optional by @jotak in #630
• Fix inconsistent maps by @jotak in #634
• update examples, minor changes by @jotak in #635
• NETOBSERV-1471 update eBPF dep by @jpinsonneau in #642
• Add go mod vendor check in CI by @jotak in #644
• codecov v4 by @jpinsonneau in #650
• Codecov add env token from secret by @jpinsonneau in #652
• Otel fix deprecated function by @OlivierCazade in #653
• NETOBSERV-1427: Added config watcher and supporting metrics reloading by @OlivierCazade in #607
• NETOBSERV-1597: skip RecordKeyMissing error by @jpinsonneau in #660
• Codecov: remove token, turn off CI failure by @jotak in #667

Dependencies

• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 0.45.0 to 1.23.1 by @dependabot in #594
• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 0.44.0 to 1.23.1 by @dependabot in #592
• Bump github.com/vmware/go-ipfix from 0.8.2 to 0.9.0 by @dependabot in #597
• Bump k8s.io/apimachinery from 0.29.1 to 0.29.2 by @dependabot in #600
• Bump k8s.io/client-go from 0.29.1 to 0.29.2 by @dependabot in #598
• Bump google.golang.org/grpc from 1.61.0 to 1.62.0 by @dependabot in #609
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.23.1 to 1.24.0 by @dependabot in #611
• Bump go.opentelemetry.io/otel/sdk/metric from 1.23.1 to 1.24.0 by @dependabot in #610
• Bump github.com/netobserv/netobserv-ebpf-agent from 0.3.3-0.20240117144239-03bb6a38b3f0 to 0.3.3 by @dependabot in #599
• Bump github.com/prometheus/client_golang from 1.18.0 to 1.19.0 by @dependabot in #616
• Bump github.com/minio/minio-go/v7 from 7.0.67 to 7.0.68 by @dependabot in #617
• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 1.23.1 to 1.24.0 by @dependabot in #618
• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.23.1 to 1.24.0 by @dependabot in #619
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.23.1 to 1.24.0 by @dependabot in #620
• Bump golang.org/x/net from 0.21.0 to 0.22.0 by @dependabot in #624
• Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 by @dependabot in #625
• Bump github.com/minio/minio-go/v7 from 7.0.68 to 7.0.69 by @dependabot in #627
• Bump google.golang.org/grpc from 1.62.0 to 1.62.1 by @dependabot in #628
• Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 by @dependabot in #631
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.24.0 to 1.25.0 by @dependabot in #646
• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 1.24.0 to 1.25.0 by @dependabot in #647
• Bump golang.org/x/net from 0.23.0 to 0.24.0 by @dependabot in #655
• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.24.0 to 1.26.0 by @dependabot in #659
• Bump github.com/agoda-com/opentelemetry-logs-go from 0.4.3 to 0.5.0 by @dependabot in #658
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.25.0 to 1.26.0 by @dependabot in #662
• Bump ubi9.4 by @jotak in #668

New Contributors

• @bhale made their first contribution in #603

Full Changelog: v0.1.11...v1.6.0-community

v0.1.11

What's Changed

Breaking changes 🛠

• NETOBSERV-1231: Improve promencode API: scaling & filters by @jotak in #513
• Opentelemetry exporter by @KalmanMeth in #531

Non-breaking changes

• initial support for labels by @KalmanMeth in #447
• NETOBSERV-1222: create PR template by @jotak in #490
• Bump minio-go by @jotak in #489
• Fixes a couple of minor weaknesses by @jotak in #491
• Bump github.com/spf13/cobra from 1.3.0 to 1.7.0 by @dependabot in #492
• Bump google.golang.org/grpc from 1.53.0 to 1.58.1 by @dependabot in #493
• Bump dependencies (kube client, prom model...) by @jotak in #497
• Bump dependencies (kube client, prom model...) by @jotak in #500
• NETOBSERV-1151: move flp decode grpc pipe to netobserv agent by @msherif1234 in #466
• Bump github.com/netsampler/goflow2 from 1.1.1-0.20220509155230-5300494e4785 to 1.3.6 by @dependabot in #498
• Bump github.com/minio/minio-go/v7 from 7.0.44 to 7.0.63 by @dependabot in #506
• Bump github.com/google/go-jsonnet from 0.19.1 to 0.20.0 by @dependabot in #507
• Add ingest_stdin by @ronensc in #488
• Bump github.com/spf13/viper from 1.10.1 to 1.16.0 by @dependabot in #505
• NETOBSERV-1352 enhance prom filters for RTT metrics by @jpinsonneau in #478
• Bump github.com/ip2location/ip2location-go/v9 from 9.2.0 to 9.6.0 by @dependabot in #510
• Bump google.golang.org/grpc from 1.58.1 to 1.58.2 by @dependabot in #509
• Bump github.com/benbjohnson/clock from 1.3.0 to 1.3.5 by @dependabot in #504
• Bump github.com/vmware/go-ipfix from 0.5.13 to 0.8.0 by @dependabot in #512
• Bump github.com/go-kit/kit from 0.12.0 to 0.13.0 by @dependabot in #511
• Bump github.com/prometheus/client_golang from 1.16.0 to 1.17.0 by @dependabot in #514
• Bump golang.org/x/net from 0.14.0 to 0.16.0 by @dependabot in #516
• Bump github.com/spf13/viper from 1.16.0 to 1.17.0 by @dependabot in #517
• Bump github.com/segmentio/kafka-go from 0.4.38 to 0.4.43 by @dependabot in #515
• NETOBSERV-1336: update netobserv agent to get DSCP support by @msherif1234 in #518
• Bump golang.org/x/net from 0.16.0 to 0.17.0 by @dependabot in #520
• Workflow: build images from release branches by @jotak in #524
• Bump google.golang.org/grpc from 1.58.2 to 1.58.3 by @dependabot in #522
• Bump github.com/segmentio/kafka-go from 0.4.43 to 0.4.44 by @dependabot in #523
• Bump k8s.io/apimachinery from 0.28.2 to 0.28.3 by @dependabot in #528
• Move Mountain View 2 kilometers south by @jotak in #534
• NETOBSERV-1379: enhance DNS debugging to dbg DNS over TCP by @msherif1234 in #533
• NETOBSERV-1247: using Meta informer for replicaSets by @msherif1234 in #474
• Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 by @dependabot in #535
• Allow multiple prometheus stages with different URLs by @KalmanMeth in #532
• Fix crash when metrics settings are unset by @jotak in #537
• Allow to start FLP directly from the flow logs producer by @jotak in #538
• NETOBSERV-1102: fine-tuning http server settings by @jotak in #545
• Bump github.com/ip2location/ip2location-go/v9 from 9.6.0 to 9.6.1 by @dependabot in #543
• Bump k8s.io/apimachinery from 0.28.3 to 0.28.4 by @dependabot in #540
• Bump k8s.io/api from 0.28.3 to 0.28.4 by @dependabot in #542
• Bump github.com/segmentio/kafka-go from 0.4.44 to 0.4.46 by @dependabot in #547
• Bump golang.org/x/net from 0.17.0 to 0.19.0 by @dependabot in #548
• Bump github.com/spf13/viper from 1.17.0 to 1.18.1 by @dependabot in #549
• Bump k8s.io/client-go from 0.28.3 to 0.29.0 by @dependabot in #555
• Bump github.com/minio/minio-go/v7 from 7.0.63 to 7.0.66 by @dependabot in #556
• Bump github.com/vmware/go-ipfix from 0.8.0 to 0.8.1 by @dependabot in #550
• Bump golang.org/x/crypto from 0.16.0 to 0.17.0 by @dependabot in #557
• Bump google.golang.org/protobuf from 1.31.0 to 1.32.0 by @dependabot in #559
• Bump github.com/spf13/viper from 1.18.1 to 1.18.2 by @dependabot in #560
• Bump github.com/vmware/go-ipfix from 0.8.1 to 0.8.2 by @dependabot in #558
• Bump google.golang.org/grpc from 1.59.0 to 1.60.1 by @dependabot in #561
• Bump github.com/prometheus/client_golang from 1.17.0 to 1.18.0 by @dependabot in #562
• Bump github.com/segmentio/kafka-go from 0.4.46 to 0.4.47 by @dependabot in #563
• Bump github.com/netsampler/goflow2 from 1.3.6 to 1.3.7 by @dependabot in #552
• NETOBSERV-1451: Bump ubi 9.3 / go 1.21 by @jotak in #564
• Bump github.com/ip2location/ip2location-go/v9 from 9.6.1 to 9.7.0 by @dependabot in #565
• NETOBSERV-1298: update netobserv agent package to pick duplist changes by @msherif1234 in #546
• Bump github.com/prometheus/common from 0.45.0 to 0.46.0 by @dependabot in #566
• NETOBSERV-1244: Add Kubernetes Infra transform rule by @OlivierCazade in #554
• Update prometheus common to v0.46.0-netobserv by @OlivierCazade in #574
• NETOBSERV-1203: Added option to add zones in k8s transform rule by @OlivierCazade in #575
• Adding k8s unit tests and some refactoring by @jotak in #578
• NETOBSERV-1308: fix minor vulnerabilities with location db by @jotak in #576
• Update docs and demo for opentelemetry by @KalmanMeth in #577
• Bump k8s.io/apimachinery from 0.29.0 to 0.29.1 by @dependabot in #571
• Bump go.opentelemetry.io/otel/metric from 1.21.0 to 1.22.0 by @dependabot in #570
• Bump k8s.io/client-go from 0.29.0 to 0.29.1 by @dependabot in #569
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace from 1.21.0 to 1.22.0 by @dependabot in #572
• Bump google.golang.org/grpc from 1.60.1 to 1.61.0 by @dependabot in #584
• Bump go.opentelemetry.io/otel/sdk/metric from 1.21.0 to 1.22.0 by @dependabot in #585
• Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 0.44.0 to 0.45.0 by @dependabot in #582
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.21.0 to 1.23.1 by @dependabot in #588
• Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.21.0 to 1.23.1 by @dependabot in #589
• Bump golang.org/x/net from 0.20.0 to 0.21.0 by @dependabot in htt...

v0.1.10

What's Changed

Breaking changes 🛠

• NETOBSERV-1063: Add TCP drop & DNS tracking to flowlogs-pipeline by @msherif1234 in #429
• NETOBSERV-1111: Add support for RoundTripTime in FLP. by @dushyantbehl in #446
• NETOBSERV-1017 extract timebased indexKeys by @jpinsonneau in #450
• move add_if and add_regex_if to transform_filter from transform_network by @KalmanMeth in #453

Non-breaking changes

• NETOBSERV-915 skip reinterpret direction for conversations by @jpinsonneau in #430
• Add encode s3 to pipeline builder by @jpinsonneau in #442
• Fix makefile imgae-build with podman by @jotak in #444
• fixed generation of flow logs for more connections by @KalmanMeth in #432
• Add IBM Z (s390x) by @jotak in #445
• NETOBSERV-1131: need to allow setting multiple filters by @jotak in #448
• Bump google.golang.org/grpc from 1.45.0 to 1.53.0 by @dependabot in #449
• changed error to warning by @KalmanMeth in #443
• NETOBSERV-1186: extract DNS flags rcode field and stringify it by @msherif1234 in #451
• Add msherif1234 by @jotak in #454
• NETOBSERV-1190: update DNS tracking to report latency instead of TS by @msherif1234 in #455
• Upgrade linter - fix found issues - use go1.20 by @jotak in #452
• fix ppc64le and s390x targets build by @msherif1234 in #458
• NETOBSERV-1197: Generalize TCPDrop to support more protocols by @msherif1234 in #457
• github ok-to-test: add more info in comment by @jotak in #456
• NETOBSERV-1111 Change RTT output to ns by @dushyantbehl in #468
• Add test for missing labels by @jotak in #463
• NETOBSERV-1208 & NETOBSERV-1233 Aggregators skip missing fields by @jpinsonneau in #470
• NETOBSERV-1135: add ovs subsystem drop causes by @msherif1234 in #472
• NETOBSERV-1233: Remove L3 fields for ARP ethtype packets and update unit-test by @msherif1234 in #471
• Update README and config by @ronensc in #475
• Fix loki writer config in README.md by @ronensc in #479
• NETOBSERV-1275: Introduce new "INNER" direction for inner-node traffic by @jotak in #483

New Contributors

• @dushyantbehl made their first contribution in #446

Full Changelog: v0.1.9...v0.1.10

v0.1.10-rc1

What's Changed

Non-breaking changes

• NETOBSERV-1111 Change RTT output to ns by @dushyantbehl in #468
• Add test for missing labels by @jotak in #463
• NETOBSERV-1208 & NETOBSERV-1233 Aggregators skip missing fields by @jpinsonneau in #470

Full Changelog: v0.1.10-rc0...v0.1.10-rc1

v0.1.10-rc0

What's Changed

Breaking changes 🛠

• NETOBSERV-1063: Add TCP drop & DNS tracking to flowlogs-pipeline by @msherif1234 in #429
• NETOBSERV-1111: Add support for RoundTripTime in FLP. by @dushyantbehl in #446

Non-breaking changes

• NETOBSERV-915 skip reinterpret direction for conversations by @jpinsonneau in #430
• Add encode s3 to pipeline builder by @jpinsonneau in #442
• Fix makefile imgae-build with podman by @jotak in #444
• fixed generation of flow logs for more connections by @KalmanMeth in #432
• Add IBM Z (s390x) by @jotak in #445
• NETOBSERV-1131: need to allow setting multiple filters by @jotak in #448
• Bump google.golang.org/grpc from 1.45.0 to 1.53.0 by @dependabot in #449
• changed error to warning by @KalmanMeth in #443
• NETOBSERV-1186: extract DNS flags rcode field and stringify it by @msherif1234 in #451
• Add msherif1234 by @jotak in #454
• NETOBSERV-1190: update DNS tracking to report latency instead of TS by @msherif1234 in #455
• Upgrade linter - fix found issues - use go1.20 by @jotak in #452
• fix ppc64le and s390x targets build by @msherif1234 in #458
• NETOBSERV-1197: Generalize TCPDrop to support more protocols by @msherif1234 in #457
• github ok-to-test: add more info in comment by @jotak in #456
• NETOBSERV-1017 extract timebased indexKeys by @jpinsonneau in #450

New Contributors

• @dushyantbehl made their first contribution in #446

Full Changelog: v0.1.9...v0.1.10-rc0

v0.1.9

What's Changed

Breaking changes 🛠

• Move prometheus server to main by @KalmanMeth in #399
• make expiryTime in encode_prom into a Duration by @KalmanMeth in #411
• shorten default timeout for aggregate; allow configuration of timeout for aggregates by @KalmanMeth in #418

Non-breaking changes

• NETOBSERV-838 Group ingress+egress flows in same connection by @jpinsonneau in #387
• bump golang.org/x/net from 0.5.0 to 0.7.0 by @dependabot in #393
• Avoid searching new connections in the multi-ordered-map by @ronensc in #397
• conntrack: handle TCP flags by @ronensc in #391
• fix e2e test by @KalmanMeth in #402
• add config parameter to suppress go metrics by @KalmanMeth in #394
• Increasing test coverage by @jotak in #401
• Remove unused (?) codecov secret by @jotak in #400
• Test ConvertToBool by @ronensc in #403
• tcp flags: Update readme and default configuration by @ronensc in #410
• NETOBSERV-924 adapt to new ovn annotation format by @jotak in #404
• Expose cache size as an operational metric by @KalmanMeth in #398
• Add ingest stage to provide synthetic workload for benchmarks by @KalmanMeth in #395
• conntrack: Fix a bug in swapAB by @ronensc in #415
• NETOBSERV-962 - ADD write ipfix stage to pipeline builder by @acmenezes in #414
• NETOBSERV-973 skip duplicates by @jpinsonneau in #421
• Conntrack output field copy operations + fix duplicates by @jpinsonneau in #413
• conntrack: Add operational metrics on errors for hash computation and aggregators by @ronensc in #416
• NETOBSERV-934: Add icmpv4/v6 bits to FLP by @msherif1234 in #408
• NETOBSERV-984 - KafkaInterBrokerProtocalVersion throws warning and has ingestion errors by @jpinsonneau in #428
• NETOBSERV-994 FLP multiarch consistency by @jpinsonneau in #426
• Remove error logs in processing loop by @jotak in #431
• fix makefile by @msherif1234 in #433
• fix github ci image argument by @jpinsonneau in #436
• fix manifset build by @msherif1234 in #435
• Update workflow, setup workflow-test by @jotak in #438
• NETOBSERV-974 Implement SASL for Kafka (producer+consumer) by @jotak in #424
• Fix naming of k8s entries to ipfix export by @praveingk in #427
• Bump ubi-9.2 by @jotak in #440

New Contributors

• @acmenezes made their first contribution in #414
• @msherif1234 made their first contribution in #408

Full Changelog: v0.1.8...v0.1.9

v0.1.9-rc2

What's Changed

Breaking changes 🛠

• shorten default timeout for aggregate; allow configuration of timeout for aggregates

Non-breaking changes

• Add icmpv4/v6 bits to FLP
• KafkaInterBrokerProtocalVersion throws warning and has ingestion errors
• FLP multiarch consistency
• Remove error logs in processing loop

Full Changelog: v0.1.9-rc1...v0.1.9-rc2

v0.1.9-rc1

Connection tracking

• Updated endConnection logic and added TerminatingTimeout
• Added operations first & last to keep informations for first / last flow

API

• Added missing WriteIpfix helpers

v0.1.9-rc0

add config parameter to suppress go metrics (#394)

* suppress Go metrics and document metrics settings

* changed metrics-settings back to metricsSettings