Skip to content

Commit beb1568

Browse files
committed
Prepared for release
1 parent 5c873e4 commit beb1568

File tree

4 files changed

+28
-14
lines changed

4 files changed

+28
-14
lines changed

CHANGELOG

+12
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,15 @@
1+
Version 0.6.0 (2017-09-14)
2+
--------------------------
3+
Remove logging section from example config (#115)
4+
Add message when requiring that the Kinesis stream exist fails (#113)
5+
Refactor to change purpose of the S3Emitter class (#110)
6+
Support AT_TIMESTAMP as initial position (#109)
7+
Move configuration example to an examples top-level folder (#107)
8+
Configuration decoding with pureconfig (#105)
9+
Stop making the assembly jar executable (#104)
10+
Rename to Snowplow S3 Loader (#66)
11+
Add NSQ as a stream source (#64)
12+
113
Version 0.5.0 (2017-06-30)
214
--------------------------
315
Add a newline at the end of a gzipped tsv file (#49)

README.md

+12-11
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
# Snowplow S3 Loader
22

33
[![Build Status][travis-image]][travis]
4-
[![Release][release-image]][releases]
4+
[![Release][release-image]][releases]
55
[![License][license-image]][license]
66

77
## Overview
88

9-
The Snowplow S3 Loader consumes records from an [Amazon Kinesis][kinesis] stream, and writes them to S3.
9+
The Snowplow S3 Loader consumes records from an [Amazon Kinesis][kinesis] stream or [NSQ][nsq] topic, and writes them to S3.
1010

1111
There are 2 file formats supported:
1212
* LZO
@@ -49,9 +49,9 @@ NOTE: These are already installed in the Vagrant quickstart environment.
4949
The Snowplow S3 Loader has the following command-line interface:
5050

5151
```
52-
snowplow-s3-loader: Version 0.5.0
52+
snowplow-s3-loader: Version 0.6.0
5353
54-
Usage: java -jar snowplow-s3-loader.jar [options]
54+
Usage: snowplow-s3-loader [options]
5555
5656
--config <filename>
5757
```
@@ -62,17 +62,17 @@ Create your own config file:
6262

6363
```bash
6464
guest$ cd /vagrant
65-
guest$ cp src/main/resources/config.hocon.sample my.conf
65+
guest$ cp examples/config.hocon.sample my.conf
6666
```
6767

6868
You will need to edit all fields in the config. Consult [this portion][config] of the setup guide on how to fill in the fields.
6969

7070
Next, start the sink, making sure to specify your new config file:
7171

7272
```bash
73-
guest$ sbt "run --config my.conf"
73+
guest$ java -jar snowplow-s3-loader-0.6.0.jar --config my.conf
7474
```
75-
75+
7676
## Find out more
7777

7878
| Technical Docs | Setup Guide | Roadmap & Contributing |
@@ -96,13 +96,14 @@ limitations under the License.
9696
[travis-image]: https://travis-ci.org/snowplow/snowplow-s3-loader.png?branch=master
9797
[travis]: http://travis-ci.org/snowplow/snowplow-s3-loader
9898

99-
[release-image]: http://img.shields.io/badge/release-0.5.0-blue.svg?style=flat
99+
[release-image]: http://img.shields.io/badge/release-0.6.0-blue.svg?style=flat
100100
[releases]: https://github.com/snowplow/snowplow-s3-loader/releases
101101

102102
[license-image]: http://img.shields.io/badge/license-Apache--2-blue.svg?style=flat
103103
[license]: http://www.apache.org/licenses/LICENSE-2.0
104104

105105
[kinesis]: http://aws.amazon.com/kinesis/
106+
[nsq]: http://nsq.io/
106107
[snowplow]: http://snowplowanalytics.com
107108
[hadoop-lzo]: https://github.com/twitter/hadoop-lzo
108109
[protobufs]: https://github.com/google/protobuf/
@@ -113,9 +114,9 @@ limitations under the License.
113114
[vagrant-install]: http://docs.vagrantup.com/v2/installation/index.html
114115
[virtualbox-install]: https://www.virtualbox.org/wiki/Downloads
115116

116-
[setup]: https://github.com/snowplow/snowplow/wiki/kinesis-lzo-s3-sink-setup
117-
[config]: https://github.com/snowplow/snowplow/wiki/kinesis-lzo-s3-sink-setup#configuration
118-
[techdocs]: https://github.com/snowplow/snowplow/wiki/kinesis-lzo-s3-sink
117+
[setup]: https://github.com/snowplow/snowplow/wiki/snowplow-s3-loader-setup
118+
[config]: https://github.com/snowplow/snowplow/wiki/snowplow-s3-loader-setup#configuration
119+
[techdocs]: https://github.com/snowplow/snowplow/wiki/s3-loader
119120

120121
[techdocs-image]: https://d3i6fms1cm1j0i.cloudfront.net/github/images/techdocs.png
121122
[setup-image]: https://d3i6fms1cm1j0i.cloudfront.net/github/images/setup.png

build.sbt

+3-3
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,8 @@
1515
lazy val root = project.in(file("."))
1616
.settings(
1717
name := "snowplow-s3-loader",
18-
version := "0.5.0",
19-
description := "S3 Loader"
18+
version := "0.6.0",
19+
description := "Load the contents of a Kinesis stream or NSQ topic to S3"
2020
)
2121
.settings(BuildSettings.buildSettings)
2222
.settings(BuildSettings.sbtAssemblySettings)
@@ -46,4 +46,4 @@ lazy val root = project.in(file("."))
4646
)
4747
)
4848

49-
shellPrompt := { _ => "s3-loader> " }
49+
shellPrompt := { _ => "s3-loader> " }

project/BuildSettings.scala

+1
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,7 @@ object BuildSettings {
3737
"-Yno-adapted-args",
3838
"-Ywarn-dead-code",
3939
"-Ywarn-numeric-widen",
40+
"-Ywarn-unused-import",
4041
"-Xfuture",
4142
"-Xlint"
4243
)

0 commit comments

Comments
 (0)