Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws-for-fluent-bit emits firehose OUTPUT instead of newer kinesis_firehose OUTPUT #1006

Open
jbeaken opened this issue Oct 2, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@jbeaken
Copy link

jbeaken commented Oct 2, 2023

Describe the bug
firehose enabled creates an OUTPUT of name firehose, which is the old plugin. Logs warn

AWS for Fluent Bit Container Image Version 2.31.11time="2023-10-02T10:33:38Z" level=info msg="A new higher performance Firehose plugin has been released; you are using the old plugin. Check out the new plugin's documentation and consider migrating.\nhttps://docs.fluentbit.io/manual/pipeline/outputs/firehose"

Steps to reproduce

values.yaml :

  enabled: true
  match: "test"
  region: "us-east-1"
  deliveryStream: "my-stream" 

Expected outcome
A concise description of what you expected to happen.

    Name            kinesis_firehose
    Match           test
    region          us-east-1
    delivery_stream my-stream

but instead have Name firehose

Environment

  • Chart name: aws-for-fluent-bit
  • Chart version: 0.1.30
  • Kubernetes version: 1.24
  • Using EKS (yes/no), if so version? yes

Additional Context:

@jbeaken jbeaken added the bug Something isn't working label Oct 2, 2023
@jbeaken jbeaken changed the title aws-for-fluent-bit outputs firehose OUTPUT instead of never kinesis_firehose aws-for-fluent-bit outputs firehose OUTPUT instead of newer kinesis_firehose Oct 2, 2023
@jbeaken jbeaken changed the title aws-for-fluent-bit outputs firehose OUTPUT instead of newer kinesis_firehose aws-for-fluent-bit emits firehose OUTPUT instead of newer kinesis_firehose OUTPUT Oct 2, 2023
@s-maj
Copy link

s-maj commented Feb 10, 2024

You can workaround this by using additionalOutputs:

additionalOutputs: |
  [OUTPUT]
      Name            kinesis_firehose
      Match           *
      region          "{{ .cluster.fluentbit.aos_region }}"
      delivery_stream "{{ .cluster.fluentbit.firehose_name }}"
      time_key        time
      time_key_format %Y-%m-%dT%H:%M:%S.%3N

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
2 participants