Releases: fd4s/fs2-kafka
v3.8.0
What's Changed
- Update fs2-core to 3.12.0 in series/3.x by @scala-steward in #1400
- Update cats-effect, cats-effect-laws, ... to 3.6.1 in series/3.x by @scala-steward in #1402
- Update vulcan to 1.12.0 in series/3.x by @scala-steward in #1401
- Update scalafmt-core to 3.9.6 in series/3.x by @scala-steward in #1408
- removed
retries
value override by @Awethon in #1405
New Contributors
Full Changelog: v3.7.0...v3.8.0
v3.7.0
There was an issue earlier today which prevented v3.7.0 from being released properly.
The issue has now been fixed. Please enjoy the original release notes by @aartigao.
This release includes internal changes to KafkaConsumer
brought by @biochimia and @rodrigo-molina (thank you very much for your contributions! 🎉 ) as well as some bug fixes (welcome @ex-ratt and @eugkhp as new collaborators 🫂).
We've released two candidates that, after running some time in our production systems, we think we're in safe position for a new release 🥳 🚀
What's Changed
- Update cats-effect, cats-effect-laws, ... to 3.5.7 in series/3.x by @scala-steward in #1363
- Update sbt, scripted-plugin to 1.10.6 in series/3.x by @scala-steward in #1365
- Update kafka-avro-serializer to 7.7.2 in series/3.x by @scala-steward in #1361
- Update kafka-clients to 3.9.0 in series/3.x by @scala-steward in #1362
- chore: improve flaky test by @biochimia in #1370
- Update testcontainers-scala-kafka, ... to 0.41.5 in series/3.x by @scala-steward in #1371
- Update kafka-avro-serializer to 7.8.0 in series/3.x by @scala-steward in #1372
- Update sbt, scripted-plugin to 1.10.7 in series/3.x by @scala-steward in #1373
- Update sbt-typelevel, sbt-typelevel-site to 0.7.5 in series/3.x by @scala-steward in #1374
- chore: update copyright notices by @biochimia in #1377
- Instantiate underlying Kafka Consumer inside blocking context by @eugkhp in #1364
- Update scala-library to 2.13.16 in series/3.x by @scala-steward in #1382
- chore: make state transitions uncancelable by @biochimia in #1367
- Update scala3-library to 3.3.5 in series/3.x by @scala-steward in #1386
- Simply
KafkaConsumer.commitAsync
by @rodrigo-molina in #1375 - Update scalafmt-core to 3.8.6 in series/3.x by @scala-steward in #1388
- Update logback-classic to 1.3.15 in series/3.x by @scala-steward in #1379
- Update kafka-avro-serializer to 7.8.1 in series/3.x by @scala-steward in #1390
- Update testcontainers-scala-kafka, ... to 0.41.8 in series/3.x by @scala-steward in #1385
- Update sbt, scripted-plugin to 1.10.10 in series/3.x by @scala-steward in #1392
- Update sbt-typelevel, sbt-typelevel-site to 0.7.7 in series/3.x by @scala-steward in #1389
- Fix exeption of multiple promise completions (#1391) by @ex-ratt in #1393
- feat: drop use of FetchRequests by @biochimia in #1369
- chore: tweaks to handling of pending commits by @biochimia in #1368
- Update testcontainers-scala-kafka, ... to 0.43.0 in series/3.x by @scala-steward in #1394
- Update kafka-avro-serializer to 7.9.0 in series/3.x by @scala-steward in #1395
- Update sbt, scripted-plugin to 1.10.11 in series/3.x by @scala-steward in #1396
- Update scalafmt-core to 3.9.4 in series/3.x by @scala-steward in #1397
- fix: reset spillover after poll loop by @biochimia in #1398
New Contributors
Full Changelog: v3.6.0...v3.7.0
fs2-kafka v3.7.0-RC2
What's Changed
- Update testcontainers-scala-kafka, ... to 0.43.0 in series/3.x by @scala-steward in #1394
- Update kafka-avro-serializer to 7.9.0 in series/3.x by @scala-steward in #1395
- Update sbt, scripted-plugin to 1.10.11 in series/3.x by @scala-steward in #1396
- Update scalafmt-core to 3.9.4 in series/3.x by @scala-steward in #1397
- fix: reset spillover after poll loop by @biochimia in #1398
Full Changelog: v3.7.0-RC1...v3.7.0-RC2
fs2-kafka v3.7.0-RC1
This is a pre-release for testing internal changes around KafkaConsumer
introduced by @biochimia / @rodrigo-molina.
What's Changed
- Update cats-effect, cats-effect-laws, ... to 3.5.7 in series/3.x by @scala-steward in #1363
- Update sbt, scripted-plugin to 1.10.6 in series/3.x by @scala-steward in #1365
- Update kafka-avro-serializer to 7.7.2 in series/3.x by @scala-steward in #1361
- Update kafka-clients to 3.9.0 in series/3.x by @scala-steward in #1362
- chore: improve flaky test by @biochimia in #1370
- Update testcontainers-scala-kafka, ... to 0.41.5 in series/3.x by @scala-steward in #1371
- Update kafka-avro-serializer to 7.8.0 in series/3.x by @scala-steward in #1372
- Update sbt, scripted-plugin to 1.10.7 in series/3.x by @scala-steward in #1373
- Update sbt-typelevel, sbt-typelevel-site to 0.7.5 in series/3.x by @scala-steward in #1374
- chore: update copyright notices by @biochimia in #1377
- Instantiate underlying Kafka Consumer inside blocking context by @eugkhp in #1364
- Update scala-library to 2.13.16 in series/3.x by @scala-steward in #1382
- chore: make state transitions uncancelable by @biochimia in #1367
- Update scala3-library to 3.3.5 in series/3.x by @scala-steward in #1386
- Simply
KafkaConsumer.commitAsync
by @rodrigo-molina in #1375 - Update scalafmt-core to 3.8.6 in series/3.x by @scala-steward in #1388
- Update logback-classic to 1.3.15 in series/3.x by @scala-steward in #1379
- Update kafka-avro-serializer to 7.8.1 in series/3.x by @scala-steward in #1390
- Update testcontainers-scala-kafka, ... to 0.41.8 in series/3.x by @scala-steward in #1385
- Update sbt, scripted-plugin to 1.10.10 in series/3.x by @scala-steward in #1392
- Update sbt-typelevel, sbt-typelevel-site to 0.7.7 in series/3.x by @scala-steward in #1389
- Fix exeption of multiple promise completions (#1391) by @ex-ratt in #1393
- feat: drop use of FetchRequests by @biochimia in #1369
- chore: tweaks to handling of pending commits by @biochimia in #1368
New Contributors
Full Changelog: v3.6.0...v3.7.0-RC1
fs2-kafka v3.6.0
It's been a while since v3.6.0-RC1 was released for the community to test and I think we're in a safe position for a new release 🚀
Most of the changes included here are dependency updates but the most important feature is the changes around KafkaProducer
fail-fast scenarios (thanks @rodrigo-molina for your contribution! 🎉) and the bump of Scala versions.
What's Changed
- Update sbt-typelevel, sbt-typelevel-site to 0.7.0 in series/3.x by @scala-steward in #1320
- Update kafka-avro-serializer to 7.6.1 in series/3.x by @scala-steward in #1319
- Update scala-library to 2.13.14 in series/3.x by @scala-steward in #1324
- Update sbt-typelevel, sbt-typelevel-site to 0.7.1 in series/3.x by @scala-steward in #1327
- Update sbt to 1.10.0 in series/3.x by @scala-steward in #1326
- Update discipline-scalatest to 2.3.0 in series/3.x by @scala-steward in #1329
- Update testcontainers-scala-kafka, ... to 0.41.4 in series/3.x by @scala-steward in #1331
- Update scalafmt-core to 3.8.2 in series/3.x by @scala-steward in #1332
- Update sbt to 1.10.1 in series/3.x by @scala-steward in #1335
- Update kafka-clients to 3.7.1 in series/3.x by @scala-steward in #1334
- Update vulcan to 1.11.0 in series/3.x by @scala-steward in #1333
- Update kafka-avro-serializer to 7.6.2 in series/3.x by @scala-steward in #1336
- Update kafka-clients to 3.8.0 in series/3.x by @scala-steward in #1337
- Update scalafmt-core to 3.8.3 in series/3.x by @scala-steward in #1338
- Update sbt-typelevel, sbt-typelevel-site to 0.7.2 in series/3.x by @scala-steward in #1339
- Update fs2-core to 3.11.0 in series/3.x by @scala-steward in #1345
- Update kafka-avro-serializer to 7.7.0 in series/3.x by @scala-steward in #1342
- Update sbt-typelevel, sbt-typelevel-site to 0.7.3 in series/3.x by @scala-steward in #1347
- Update scala3-library to 3.3.4 in series/3.x by @scala-steward in #1350
- Update scala-library to 2.13.15 in series/3.x by @scala-steward in #1349
- Update sbt to 1.10.2 in series/3.x by @scala-steward in #1351
- Update kafka-avro-serializer to 7.7.1 in series/3.x by @scala-steward in #1348
- KafkaProducer.produce fails fast by @rodrigo-molina in #1340
- Fix compilation after #1340 merge by @aartigao in #1353
- Update scala-library to 2.12.20 in series/3.x by @scala-steward in #1346
- Update sbt-typelevel, sbt-typelevel-site to 0.7.4 in series/3.x by @scala-steward in #1354
- Update vulcan to 1.11.1 in series/3.x by @scala-steward in #1355
- Update sbt, scripted-plugin to 1.10.4 in series/3.x by @scala-steward in #1356
- Update cats-effect, cats-effect-laws, ... to 3.5.5 in series/3.x by @scala-steward in #1357
- Update sbt-buildinfo to 0.13.1 in series/3.x by @scala-steward in #1358
- Update kafka-clients to 3.8.1 in series/3.x by @scala-steward in #1359
- Update sbt, scripted-plugin to 1.10.5 in series/3.x by @scala-steward in #1360
New Contributors
- @rodrigo-molina made their first contribution in #1340
Full Changelog: v3.5.1...v3.6.0
fs2-kafka v3.6.0-RC1
This pre-release is done mainly to test changes around KafkaProducer
fail-fast but also includes the bump of Scala versions.
What's Changed
- Update sbt-typelevel, sbt-typelevel-site to 0.7.0 in series/3.x by @scala-steward in #1320
- Update kafka-avro-serializer to 7.6.1 in series/3.x by @scala-steward in #1319
- Update scala-library to 2.13.14 in series/3.x by @scala-steward in #1324
- Update sbt-typelevel, sbt-typelevel-site to 0.7.1 in series/3.x by @scala-steward in #1327
- Update sbt to 1.10.0 in series/3.x by @scala-steward in #1326
- Update discipline-scalatest to 2.3.0 in series/3.x by @scala-steward in #1329
- Update testcontainers-scala-kafka, ... to 0.41.4 in series/3.x by @scala-steward in #1331
- Update scalafmt-core to 3.8.2 in series/3.x by @scala-steward in #1332
- Update sbt to 1.10.1 in series/3.x by @scala-steward in #1335
- Update kafka-clients to 3.7.1 in series/3.x by @scala-steward in #1334
- Update vulcan to 1.11.0 in series/3.x by @scala-steward in #1333
- Update kafka-avro-serializer to 7.6.2 in series/3.x by @scala-steward in #1336
- Update kafka-clients to 3.8.0 in series/3.x by @scala-steward in #1337
- Update scalafmt-core to 3.8.3 in series/3.x by @scala-steward in #1338
- Update sbt-typelevel, sbt-typelevel-site to 0.7.2 in series/3.x by @scala-steward in #1339
- Update fs2-core to 3.11.0 in series/3.x by @scala-steward in #1345
- Update kafka-avro-serializer to 7.7.0 in series/3.x by @scala-steward in #1342
- Update sbt-typelevel, sbt-typelevel-site to 0.7.3 in series/3.x by @scala-steward in #1347
- Update scala3-library to 3.3.4 in series/3.x by @scala-steward in #1350
- Update scala-library to 2.13.15 in series/3.x by @scala-steward in #1349
- Update sbt to 1.10.2 in series/3.x by @scala-steward in #1351
- Update kafka-avro-serializer to 7.7.1 in series/3.x by @scala-steward in #1348
- KafkaProducer.produce fails fast by @rodrigo-molina in #1340
- Fix compilation after #1340 merge by @aartigao in #1353
- Update scala-library to 2.12.20 in series/3.x by @scala-steward in #1346
New Contributors
- @rodrigo-molina made their first contribution in #1340
Full Changelog: v3.5.1...v3.6.0-RC1
fs2-kafka v3.5.1
Important Notice: Producer performance regression fixed ⚠️
Changes introduced in #1126 cause a significant performance drop in Producer (you can find more details with some nice graphs in #1321).
Users are encouraged to use v3.5.1 and avoid v3.5.0 for this reason.
Many thanks to @atnoya for noticing and seeking the root cause 🎉 (and mention to @abestel for confirming he was experiencing the same issues).
What's Changed
- Update
tlBaseVersion
to match latest tag by @aartigao in #1323 - Revert #1126 as it's causing a performance regression by @atnoya in #1322
New Contributors
Full Changelog: v3.5.0...v3.5.1
Assets 2
fs2-kafka v3.5.0
Important Notice: Memory leak found 🐛
A leak in the fetch loop caused by a misuse of the CE Fiber API has been found and fixed (more info in #1318). Of course, all users are encouraged to upgrade ⬆️
All credits to @abestel who took the time to investigate the root cause a propose a fix for it! 🙇🏽 🥇 Awesome contribution! 🎉
Depending on the usage, the leak advances slowly or faster. As an example, here's the graph of one of our services for the last 12h in Staging (with the SNAPSHOT that includes #1318) and Prod (with v3.4.0) (both envs share exactly the same load) 👇🏽
Staging
Prod
Relevant Changes
Other Changes
- Update
tlBaseVersion
to match latest tag by @aartigao in #1313 - Update fs2-core to 3.10.0 in series/3.x by @scala-steward in #1314
- Update sbt-buildinfo to 0.12.0 in series/3.x by @scala-steward in #1315
- Retry
RebalanceInProgressException
inCommitRecovery.Default
by @aartigao in #1312 - Change
Blocking
to useSync#interruptible
, notblocking
by @bastewart in #1126 - Update scalafmt-core to 3.8.1 in series/3.x by @scala-steward in #1317
- Update fs2-core to 3.10.2 in series/3.x by @scala-steward in #1316
Full Changelog: v3.4.0...v3.5.0
fs2-kafka v3.4.0
This release contains mostly version bumps for the library dependencies, but some of them are important enough to create a minor version 👇🏽
Relevant changes
- Latest Scala libs for 2.12, 2.13 and 3.3
- Latest Kafka Clients 3.7.x lineage (updated from 3.6.x in previous versions)
- Latest Kafka Avro Serializer 7.6.x lineage (updated from 7.5.x in previous versions)
What's Changed
- Add
aartigao
to developers list by @aartigao in #1298 - Plugin dependencies under
sbt-typelevel
umbrella by @aartigao in #1297 - Update testcontainers-scala-kafka, ... to 0.41.3 in series/3.x by @scala-steward in #1299
- Update kafka-avro-serializer to 7.6.0 in series/3.x by @scala-steward in #1300
- Update scalafmt-core to 3.8.0 in series/3.x by @scala-steward in #1301
- Update sbt-typelevel, sbt-typelevel-site to 0.6.6 in series/3.x by @scala-steward in #1302
- Improve
NotSubscribedException
message by @aartigao in #1303 - Update sbt-typelevel, sbt-typelevel-site to 0.6.7 in series/3.x by @scala-steward in #1311
- Update kind-projector to 0.13.3 in series/3.x by @scala-steward in #1310
- Update kafka-clients to 3.7.0 in series/3.x by @scala-steward in #1304
- Update sbt to 1.9.9 in series/3.x by @scala-steward in #1308
- Update cats-effect, cats-effect-laws, ... to 3.5.4 in series/3.x by @scala-steward in #1309
- Update scala-library to 2.12.19 in series/3.x by @scala-steward in #1305
- Update scala-library to 2.13.13 in series/3.x by @scala-steward in #1306
- Update scala3-library to 3.3.3 in series/3.x by @scala-steward in #1307
Full Changelog: v3.3.1...v3.4.0
fs2-kafka v3.3.1
Important Notice: Binary Incompatibilities ⚠️
This release fixes v3.3.0 by bringing back the binary incompatible changes.
Users are encouraged to use v3.3.1 and avoid v3.3.0 for this reason.
What's Changed
Full Changelog: v3.3.0...v3.3.1