Skip to content

Set log level of records serialized to DEBUG #174

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
jbeemster opened this issue May 15, 2020 · 0 comments · Fixed by #191
Closed

Set log level of records serialized to DEBUG #174

jbeemster opened this issue May 15, 2020 · 0 comments · Fixed by #191
Milestone
Version 1.0.0

Comments

@jbeemster
Copy link
Member

The logs are filling up with these types of messages:

[RecordProcessor-0000] WARN com.snowplowanalytics.s3.loader.S3Emitter - Successfully serialized 2187 records out of 2187

This for one seems like a weird log level to use for this message but also costs money when using tools like CloudWatch to store logs. Would be good to move this to DEBUG level.

The offending line:

snowplow-s3-loader/src/main/scala/com.snowplowanalytics.s3/loader/KinesisS3Emitter.scala

Line 110 in e27bf93

s3Emitter.log.warn(s"Successfully serialized $successSize records out of ${successSize + failures.size}")

@benjben benjben added this to the Version 0.7.1 milestone Dec 4, 2020
@benjben benjben changed the title Logging of records serialized at WARN level Set log level of records serialized to DEBUG Dec 11, 2020
benjben added a commit that referenced this issue Dec 11, 2020
@benjben
Set log level of records serialized to DEBUG (close #174)
3f7e888
@benjben benjben mentioned this issue Dec 11, 2020
Merged
benjben added a commit that referenced this issue Dec 15, 2020
@benjben
Set log level of records serialized to DEBUG (close #174)
24638c8
benjben added a commit that referenced this issue Dec 22, 2020
@benjben
Set log level of records serialized to DEBUG (close #174)
141d1fe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
Version 1.0.0
Development

Successfully merging a pull request may close this issue.

Bumps and fix partitioning for bad rows snowplow/snowplow-s3-loader
2 participants
@jbeemster @benjben