Description
Is your feature request related to a problem? Please describe.
AWS firehose ingestion cost is calculated per record, rounded up to 5KB for small records. If you send lots of PutRecords with small logs, the cost will be disproportionally expensive relative to the volume. Instead you can batch json logs into a ndjson (newline delimited json) inside of a single PutRecord, this works well in many circumstances and solves the expensive cost problem.
Describe the solution you'd like
Send batch of records as a singe firehose record delimited by newline under an option.
Describe alternatives you've considered
Use the old plugin https://github.com/aws/amazon-kinesis-firehose-for-fluent-bit, which supports the this feature under simple_aggregation: true.
Additional context
This issue is the same as [kinesis-firehose] Support simple_aggregation option to send multiple log events as a record #9279