实时分析数据分析平台——storm
下面的代码统计各个数字0~100之间的计数结果
public class DoubleAndTripleBolt extends BaseRichBolt { private OutputCollectorBase _collector; @Override//prepare函数里面也可以通过collector发送数据流 public void prepare(Map conf, TopologyContext context, OutputCollectorBase collector) { _collector = collector; } @Override//处理数据,发送数据流,记着ack保证数据不丢失 public void execute(Tuple input) { int val = input.getInteger(0); _collector.emit(input, new Values(val*2, val*3)); _collector.ack(input); } @Override//需要声明输出数据流的格式 public void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(new Fields("double", "triple")); } }参照网页
https://github.com/nathanmarz/storm/wiki/Tutorial
https://github.com/nathanmarz/storm-starter
http://xumingming.sinaapp.com/category/storm/
http://www.oschina.net/p/twitter-storm
Trident用来做实时分析不错
https://github.com/nathanmarz/storm/wiki/Trident-tutorial
http://www.ibm.com/developerworks/cn/opensource/os-twitterstorm/index.html