Releases · dmachard/DNS-collector

@dmachard

If you find this project helpful, consider supporting it by becoming a GitHub Sponsors or simply by giving it a ⭐ to this project.

What's Changed

💡 Enhancements

feat(ci): add bind9 in automated dnstap test by @dmachard in #995
refactor(file logger): rename batchSize to currentBatchSize for clarity by @dmachard
chore(doc): comprehensive documentation restructure and enhancement by @dmachard

🔧 Bugfixes

fix: fixing kafka worker get cancelled after 10 seconds of broker unreachability by @ahsifer in #1000
fix(#1011): panic slice bounds out of range by @dmachard in #1019

📈 Dependency updates

build(deps): bump golang.org/x/sys from 0.32.0 to 0.33.0 by @dependabot in #998
build(deps): bump github.com/dmachard/go-netutils from 1.5.0 to 1.6.0 by @dependabot in #997
build(deps): bump github.com/miekg/dns from 1.1.65 to 1.1.66 by @dependabot in #1002
build(deps): bump golang from 1.24.2-alpine to 1.24.4-alpine by @dependabot in #1003 #1021
build(deps): bump golangci/golangci-lint-action from 7 to 8 by @dependabot in #996
build(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.35.0 to 1.36.0 by @dependabot in #1020
build(deps): bump golang.org/x/net from 0.40.0 to 0.41.0 by @dependabot in #1017 #1022

Full Changelog: v1.7.0...v1.8.0

@dmachard

What's Changed

If you find this project helpful, consider supporting it by becoming a GitHub Sponsors or simply by giving it a ⭐ to this project.

💡 Enhancements

feat: add tests for kafka producer by @dmachard in #992
feat: add support to get http-protocol from dnstap stream by @dmachard in #993
feat: update go-framestream to v1.3.0 - memory allocation optimized by @dmachard in #987
feat: rename buffer-size to batch-size in Kafka logger config (BREAKING CHANGE) by @dmachard in #981
feat: no more display latency for query in text format by @dmachard in #967
feat(ci): dnsdist v2 automatically tested in CI by @dmachard in #968
feat(ci): knot-resolver automatically tested in CI by @dmachard in #978

🔧 Bugfixes

fix(#962): downsample implementation error by @perlang in #963
fix(#974): update framestream lib to 1.2.0 to fix the panic by @dmachard in #980

📈 Dependency updates

build(deps): bump github.com/fsnotify/fsnotify from 1.8.0 to 1.9.0 by @dependabot in #988
build(deps): bump github.com/IBM/fluent-forward-go from 0.2.2 to 0.3.0 by @dependabot in #990
build(deps): bump github.com/prometheus/prometheus from 0.302.0 to 0.303.0 by @dependabot in #991
build(deps): bump github.com/prometheus/client_model from 0.6.1 to 0.6.2 by @dependabot in #989
build(deps): bump github.com/prometheus/client_golang from 1.21.0-rc.0 to 1.22.0 by @dependabot in #985
build(deps): bump google.golang.org/protobuf from 1.36.5 to 1.36.6 by @dependabot in #970
build(deps): bump github.com/klauspost/compress from 1.17.11 to 1.18.0 by @dependabot in #971
build(deps): bump github.com/golang/snappy from 0.0.4 to 1.0.0 by @dependabot in #972
build(deps): bump go.opentelemetry.io/otel/sdk from 1.34.0 to 1.35.0 by @dependabot in #942
build(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.34.0 to 1.35.0 by @dependabot in #944
build(deps): bump ebpf to 0.17.1 by @dmachard in #966
build(deps): bump golang.org/x/net from 0.35.0 to 0.38.0 by @dependabot in #955
build(deps): bump github.com/miekg/dns from 1.1.63 to 1.1.65 by @dependabot in #983
build(deps): bump github.com/IBM/sarama from 1.43.3 to 1.45.1 by @dependabot in #984

New Contributors

@perlang made their first contribution in #963

Full Changelog: v1.6.0...v1.7.0

@ahsifer

If you find this project helpful, consider supporting it by becoming a GitHub Sponsors or simply by giving it a ⭐ to this project.

💡 What's Changed

feat: added support for multiple Kafka brokers during the dial process by @ahsifer in #949
feat: introduced a new text directive to retrieve answer IP(s) in plain text format by @dmachard in #957 #961
build(go): added support for Go 1.24 by @dmachard in #959
build(go): update Dockerfile with go1.24, rename docker image by @dmachard in #964
build(docs): Update README.md, add more dns tools by @dmachard in #956

📈 Dependency updates

build(deps): bump github.com/dmachard/go-dnstap-protobuf from 1.2.0 to 1.3.0 by @dependabot in #941

New Contributors

@ahsifer made their first contribution in #949

Full Changelog: v1.5.0...v1.6.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

Highlights

This release introduces a new option in the PCAP generator to update the destination port to 53 with DoX traffic.

What's Changed

feat: new option to overwrite dns port on pcap output by @dmachard in #933
feat: bump go-powerdns-protobuf from 1.3.0 to 1.4.0 - add fields for headerFlags and edns by @dependabot in #919
chore(deps): deprecated message in goreleaser removed #930 by @dmachard in #932
chore(deps): bump alpine from 3.21.0 to 3.21.3 by @dependabot in #935 #923
chore(deps): bump github.com/prometheus/prometheus from 0.54.1 to 0.302.0 by @dependabot in #937
chore(deps): bump golang.org/x/net from 0.34.0 to 0.35.0 by @dependabot in #938

Full Changelog: v1.4.0...v1.5.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

Highlights

This release introduces a new transformer to reorder logs by timestamp, enhanced support for the PowerDNS protobuf format, and a new OpenTelemetry logger."

What's Changed

feat: set minimal go version to 1.23
feat(logger): new opentelemetry logger with tracing support by @dmachard in #912
feat(transformer): add configurable unique fields to traffic reducer by @dmachard in #905
feat(powerdns): add support for more fields (MessageId, RequestorId...) by @dmachard in #907 #909
feat(transformer): new reordering transform to sort logs by timestamp by @dmachard in #910
fix: add missing telemetry counter in powerdns collector by @dmachard in #911
chore(docs): Update README.md by @dmachard in #927
chore(deps): bump loki to v3.3.2 by @dmachard in #915
chore(deps): bump alpine from 3.20.3 to 3.21.0 by @dependabot in #899
chore(deps): bump golang from 1.23.3-alpine3.19 to 1.23.4-alpine3.19 by @dependabot in #900
chore(deps): bump google.golang.org/protobuf from 1.35.2 to 1.36.0 by @dependabot in #903
chore(deps): bump github.com/prometheus/common from 0.60.1 to 0.61.0 by @dependabot in #904
chore(deps): bump golang.org/x/net from 0.31.0 to 0.33.0 by @dependabot in #913

Full Changelog: v1.3.0...v1.4.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

Highlights

This release introduces a powerful new transformer designed to track newly observed domains. This release is also the final release for the year. Thank you for your support.

What's Changed

feat: New domain tracker by @dmachard in #892
feat: Add RD flag handling in text format directive by @dmachard in #893
feat: dns parser: set RCODE only in DNS responses by @dmachard in #885
feat: support direct sniffing on gre interface on packet sniffer by @dmachard in #884
feat: add support of the gre protocol decodin 10000 g on packet sniffer by @dmachard in #883
feat: bpf filter improved for packet sniffer by @dmachard in #883
fix: correct RCODE name from NOIMP to NOTIMP by @dmachard in #888
fix: properly set DNStap operation for DNS update based on QR flag by @dmachard in #889
fix: prevent multiple channel close in Telemetry Stop method by @dmachard in #890
chore(ci): update testing-dnstap.yml with unbound 1.22 by @dmachard in #868
chore(ci): update .goreleaser.yml by @dmachard in #869
chore(doc): update README.md - add docker pull badge by @dmachard in #870
chore(deps): bump golang from 1.23.2-alpine3.19 to 1.23.3-alpine3.19 by @dependabot in #871
chore(deps): bump golang.org/x/sys from 0.26.0 to 0.27.0 by @dependabot in #872
chore(deps): bump golang.org/x/net from 0.30.0 to 0.31.0 by @dependabot in #873
chore(deps): bump google.golang.org/protobuf from 1.35.1 to 1.35.2 by @dependabot in #880
chore(deps): bump github.com/tinylib/msgp from 1.2.4 to 1.2.5 by @dependabot in #897
chore(deps): bump golang.org/x/sys from 0.27.0 to 0.28.0 by @dependabot in #896
chore(deps): bump golang.org/x/crypto from 0.29.0 to 0.31.0 by @dependabot in #901

Full Changelog: v1.2.0...v1.3.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

What's Changed

feat: added ElasticSearch API basic authentication by @dmachard in #866
feat: add new jinja format settings in console and logfile by @dmachard in #856
fix: set go version in githubactions properly by @dmachard in #862
fix: dns parser - TLSA typo by @tomarcade in #860
fix #837 : file logger: compression is no more blocking by @dmachard in #854
fix #636 : file logger: no more block postrotate command by @dmachard in #855
chore(docs): update documentations by @dmachard in #861
chore(deps): bump github.com/tinylib/msgp from 1.2.2 to 1.2.3 by @dependabot in #858
chore(deps): bump github.com/prometheus/common from 0.60.0 to 0.60.1 by @dependabot in #857
chore(deps): bump github.com/tinylib/msgp from 1.2.3 to 1.2.4 by @dependabot in #863
chore(deps): bump github.com/fsnotify/fsnotify from 1.7.0 to 1.8.0 by @dependabot in #864

Bug reporters

New Contributors

@tomarcade made their first contribution in #860

Full Changelog: v1.1.0...v1.2.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

Highlights

This release introduces some fixes and increase performance with file logger.

What's Changed

feat: disable global telemetry by default + channel buffer size up to 8192 by @dmachard in #840
feat: file logger: reducing the frequency of disk writes by @dmachard in #841
feat: add arcount, nscount and ancount in json output #828 by @dmachard in #829
feat: lookup ECS ip on geoip transform #776 by @dmachard in #830
feat: prometheus logger: add new counter for dns messages operations by @dmachard in #852
feat: set go minimum version to 1.21 by @dmachard in #851
fix #849 : hang during shutdown with high load by @dmachard in #850
fix: invalid ingress counter for dnstap collector by @dmachard in #839
fix #831 : afpacket sniffer: fix deadlock on stop under load by @dmachard in #842
fix: error on dns decoder for response without question by @dmachard in #843
fix(doc): update transform_rewrite.md by @jpmens in #825
chore(deps): bump github.com/tinylib/msgp from 1.2.1 to 1.2.2 by @dependabot in #834
chore(deps): bump github.com/klauspost/compress from 1.17.9 to 1.17.11 by @dependabot in #824 #846
chore(deps): bump github.com/prometheus/client_golang from 1.20.3 to 1.20.5 by @dependabot in #823 #847
chore(deps): bump golang.org/x/net from 0.29.0 to 0.30.0 by @dependabot in #832
chore(deps): bump github.com/prometheus/common from 0.59.1 to 0.60.0 by @dependabot in #833
chore(deps): bump golang from 1.23.1-alpine3.19 to 1.23.2-alpine3.19 by @dependabot in #835
chore(deps): bump github.com/grafana/loki/v3 from 3.2.0 to 3.2.1 by @dependabot in #848
chore(deps): bump google.golang.org/protobuf from 1.34.2 to 1.35.1 by @dependabot in #844

Bug reporters

@BarboraAni #831

New Contributors

@jpmens made their first contribution in #825

Full Changelog: v1.0.0...v1.1.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

Highlights

The release is the first stable release with great new features.

What's Changed

feat: log malformed packet enabled by default by @dmachard in #819
feat: build with go1.23 by @dmachard in #818
feat: add tests for matching feature with pipeline mode by @dmachard in #797
feat: convert latency field to float + new advanced example by @dmachard in #758
feat: support round robin partitionner for kafka producer by @dmachard in #759 #809
feat: update README.md and remove beta code warning by @dmachard in #755
feat: add rewrite transform + quote some text directives by @dmachard in #756
feat: update normalize transform to replace non printable characters by @dmachard in #754
feat: add custom text format with jinja templating by @dmachard in #748
feat: enhanced text-format with raw text by @peterand-pa in #609
feat: move docker config to pipelines by @dmachard in #757
fix: matching with arrays failed with dnsmessage collector by @dmachard in #797
fix: decode properly dynamic/update dns queries by @dmachard in #819
chore(deps): bump to loki 3.2 by @dmachard in #742 #768 #782 #817
chore(docs): update README.md by @dmachard in #760
chore(deps): bump github.com/Azure/sdk/azidentity from 1.5.1 to 1.6.0 by @dependabot in #743
chore(deps): update unbound and pdns-recursor version in CI by @dmachard in #765
chore(deps): bump github.com/prometheus/common from 0.48.0 to 0.59.1 by @dependabot in #726 #762 #806
chore(deps): bump github.com/miekg/dns from 1.1.59 to 1.1.62 by @dependabot in #744 #788
chore(deps): bump google.golang.org/protobuf from 1.34.1 to 1.34.2 by @dependabot in #745
chore(deps): bump github.com/klauspost/compress from 1.17.8 to 1.17.9 by @dependabot in #746
chore(deps): bump alpine from 3.20.0 to 3.20.3 by @dependabot in #752 #778 #802
chore(deps): bump prometheus from 0.51.0 to 0.54.1 by @dependabot in #751 #773 #781 #794
chore(deps): bump github.com/dmachard/go-dnstap-protobuf from 1.0.1 to 1.0.2 by @dependabot in #750
chore(deps): bump github.com/oschwald/maxminddb-golang from 1.13.0 to 1.13.1 by @dependabot in #761
chore(deps): bump golang.org/x/net from 0.26.0 to 0.28.0 by @dependabot in #767 #780
chore(deps): bump golang.org/x/sys from 0.22.0 to 0.25.0 by @dependabot in #779 #783 #803
chore(deps): bump github.com/IBM/sarama from 1.43.2 to 1.43.3 by @dependabot in #787
chore(deps): bump github.com/creasty/defaults from 1.7.0 to 1.8.0 by @dependabot in #789
chore(deps): bump github.com/cilium/ebpf from 0.15.0 to 0.16.0 by @dependabot in #777
chore(deps): bump github.com/tinylib/msgp from 1.1.9 to 1.2.1 by @dependabot in #766 #804
chore(deps): bump golang from 1.22.4-alpine3.19 to 1.22.6-alpine3.19 by @dependabot in #770 #784
chore(deps): bump google.golang.org/grpc from 1.64.0 to 1.64.1 by @dependabot in #772
chore(deps): bump github.com/prometheus/client_golang from 1.19.1 to 1.20.3 by @dependabot in #805

Bug reporters

@drenton1 #799

New Contributors

@peterand-pa made their first contribution in #609

Full Changelog: v0.46.0...v1.0.0

@dmachard

If you find the project helpful, please consider supporting the project via monthly donation via GitHub Sponsors or simply add a star to this project.

Highlights

The release is the last one before the first stable release. In the meantime, this release introduces some great features:

Some new global metrics to follow your pipeline performance and dropped packets.
The multiplexer configuration mode is marked as DEPRECATED.
Please to update your config with pipelines definition.
The memory usage of the tool has been reduced.

What's Changed

feat: add integration examples with Loki, Prometheus and InfluxDB by @dmachard in #740
feat: new global settings for default buffer size set to 4096 instead of 65535 by @dmachard in #739
feat: add global telemetry #641 #512 by @dmachard in #724
feat: mark as deprecated the multiplexer mode by @dmachard in #719
feat: add pid file support by @dmachard in #723
fix(regression): dnstap files with ingestor not properly processed by @dmachard in #732
fix: invalid error message with config checker by @dmachard in #733
chore(deps): bump github.com/oschwald/maxminddb-golang from 1.12.0 to 1.13.0 by @dependabot in #725
chore(deps): bump golang from 1.22.3-alpine3.19 to 1.22.4-alpine3.19 by @dependabot in #734
chore(deps): bump golang.org/x/sys from 0.20.0 to 0.21.0 by @dependabot in #735
chore(deps): bump goreleaser/goreleaser-action from 5 to 6 by @dependabot in #730
chore(deps): bump golang.org/x/net from 0.25.0 to 0.26.0 by @dependabot in #736
chore(deps): bump alpine from 3.19.1 to 3.20.0 by @dependabot in #721

Bug reporters

@romainw #729

Full Changelog: v0.45.0...v0.46.0

Uh oh!

Releases: dmachard/DNS-collector

v1.8.0

What's Changed

💡 Enhancements

🔧 Bugfixes

📈 Dependency updates

Contributors

Uh oh!

v1.7.0

What's Changed

💡 Enhancements

🔧 Bugfixes

📈 Dependency updates

New Contributors

Contributors

Uh oh!

v1.6.0

💡 What's Changed

📈 Dependency updates

New Contributors

Contributors

Uh oh!

v1.5.0

Highlights

What's Changed

Contributors

Uh oh!

v1.4.0

Highlights

What's Changed

Contributors

Uh oh!

v1.3.0

Highlights

What's Changed

Contributors

Uh oh!

v1.2.0

What's Changed

Bug reporters

New Contributors

Contributors

Uh oh!

v1.1.0

Highlights

What's Changed

Bug reporters

New Contributors

Contributors

Uh oh!

v1.0.0

Highlights

What's Changed

Contributors

Uh oh!

v0.46.0

Highlights

What's Changed

Contributors

Uh oh!