Skip to content

Commit

Permalink
release 0.1 version
Browse files Browse the repository at this point in the history
  • Loading branch information
@chiwanpark
chiwanpark committed Dec 31, 2013
1 parent 21672c2 commit c21d705
Show file tree
Hide file tree
Showing 2 changed files with 17 additions and 7 deletions.
22 changes: 16 additions & 6 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,21 +6,31 @@ Redis extension for Flume NG ([http://flume.apache.org](http://flume.apache.org)

## Current Version

* Development: 0.1-SNAPSHOT
* Stable: none
* Development: 0.2-SNAPSHOT
* Stable: 0.1

## Current Supported Features

* Custom sources using Redis [SUBSCRIBE](http://redis.io/commands/subscribe) command (single channel)
* Source using Redis [SUBSCRIBE](http://redis.io/commands/subscribe) command (single channel)
* Sink using Redis [PUBLISH](http://redis.io/commands/publish) command (single channel)

## Usage

1. Build this library witn ```mvn package``` command.
1. Build or Download jar.
* Checkout and build this repository.
1. Stable release (currently version 0.1) is recommended.
1. Build this library with ```mvn package``` command.
* Or download built jar in release page. ([/~https://github.com/chiwanpark/flume-ng-redis/releases](/~https://github.com/chiwanpark/flume-ng-redis/releases))
1. Copy ```flume-ng-redis-[VERSION].jar``` or ```flume-ng-redis-[VERSION]-jar-with-dependencies.jar``` into your flume library path.
* If you use ```flume-ng-redis-[VERSION].jar```, you have to download Jedis ([/~https://github.com/xetorthio/jedis](/~https://github.com/xetorthio/jedis)) and copy it to flume library path.
1. Copy configuration sample file or create your own configuration.
1. Run Flume. (Following command is sample for RedisSubscribeDrivenSource.)
1. Run Flume.
* Following command is sample for RedisSubscribeDrivenSource.

bin/flume-ng agent -n agent -c conf -f conf/example-SubscribeDrivenSource.properties -Dflume.root.logger=DEBUG,console
bin/flume-ng agent -n agent -c conf -f conf/example-SubscribeDrivenSource.properties -Dflume.root.logger=DEBUG,console
* Following commend is sample for RedisPublishDrivenSink

bin/flume-ng agent -n -agent -c conf -f conf/example-PublishDrivenSink.properties

## Dependencies

Expand Down
2 changes: 1 addition & 1 deletion pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

<groupId>com.chiwanpark.flume.plugins</groupId>
<artifactId>flume-ng-redis</artifactId>
<version>0.1-SNAPSHOT</version>
<version>0.1</version>
<packaging>jar</packaging>

<properties>
Expand Down

2 comments on commit c21d705

@wxlfight
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

我模仿别人的架构，将storm结果数据通过flume写到redis，但是我不清楚这之间使用flume做数据传输有什么好处？我看一些公司的架构，比如唯品会的，他们都是用flume来衔接数据的producer和consumer的，这仅仅是为了缓存吗？还有其他好处吗？我是新手没什么经验，望提示一下。另外，你这个插件能用吗？

@chiwanpark
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@wxlfight Hello. Unfortunately, I cannot understand your question because I cannot read Chinese. If you write your question in English or Korean (probably), I will answer your question. Please rewrite your question. Thanks.

Please sign in to comment.