You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For SELF_DESCRIBING events I'm using the example configuration for partitionFormat (except after last slash). "partitionFormat": "{vendor}.{name}/model={model}/dt={yy}-{mm}-{dd}",
I would assume the first part of the prefix would be e.g.: com.snowplowanalytics.snowplow.badrows.schema_violations/.
However, this config will produce prefix. The last part timestamp of sort? com.snowplowanalytics.snowplow.badrows.705000000AM72
Changing {name} to {schema} works as expected: "partitionFormat": "{vendor}.{schema}/model={model}/dt={yy}-{mm}-{dd}",
This will create prefix: com.snowplowanalytics.snowplow.badrows.schema_violations/.
I think it is an error in the example configuration file, rather than error in the code, i.e. the intended syntax was {vendor}.{schema} instead of {vendor}.{name}.
I suggest I change it so that both {schema} and {name} are both valid and both do the same thing.
Version: 2.1.2
For SELF_DESCRIBING events I'm using the example configuration for partitionFormat (except after last slash).
"partitionFormat": "{vendor}.{name}/model={model}/dt={yy}-{mm}-{dd}",
I would assume the first part of the prefix would be e.g.:
com.snowplowanalytics.snowplow.badrows.schema_violations/.
However, this config will produce prefix. The last part timestamp of sort?
com.snowplowanalytics.snowplow.badrows.705000000AM72
Changing {name} to {schema} works as expected:
"partitionFormat": "{vendor}.{schema}/model={model}/dt={yy}-{mm}-{dd}",
This will create prefix:
com.snowplowanalytics.snowplow.badrows.schema_violations/.
Maybe this line has something to do with this behaviour?
https://github.com/snowplow/snowplow-s3-loader/blob/master/src/main/scala/com/snowplowanalytics/s3/loader/connector/KinesisS3Emitter.scala#L245
The text was updated successfully, but these errors were encountered: