Solr4.0 tomcat集群和elasticSearch一些事

? 最近业余时间接触es不久，碰到了一些关于批量添加数据的问题，在本地机器上配置了三个节点的集群，一共有5.2w的元数据，批量更新的时候尼玛总是出现IO异常问题，数据少还中，比如500，1000。已经做了批量更新的间隔，如一次1000,500,200都试过，还是IO。如果说是本机配置的不够，2G的足够了吧，通过一个侧面的例子也能反应出来，同样在本机做了一个numshards=3的solr集群，更新25.8w的数据都没有问题。

? 下面贴出创建es索引，更新数据的代码，有懂的朋友帮解答一下，ps: es的资料太少了，光看例子都够费劲的，尼玛java链式方法老长老长，显得牛逼吗。

??

public void createIndex() throws IOException {XContentBuilder content = XContentFactory.jsonBuilder().startObject().startObject("vType").startObject("properties").startObject("title").field("type", "string").field("indexAnalyzer", "ik").field("searchAnalyzer", "ik").endObject().startObject("author").field("type", "string").field("indexAnalyzer","ik").field("searchAnalyzer", "ik").endObject().startObject("keyword").field("type", "string").field("indexAnalyzer","ik").field("searchAnalyzer", "ik").endObject().startObject("fenlei").field("type", "string").endObject().startObject("other").field("type", "string").endObject().startObject("subname").field("type", "string").endObject().startObject("subtitles").field("type", "string").endObject().startObject("summary").field("type", "string").field("indexAnalyzer","ik").field("searchAnalyzer", "ik").endObject().startObject("videolink").field("type", "string").endObject().endObject().endObject().endObject();client.admin().indices().prepareCreate("video").addMapping("vType", content)          .setSettings(ImmutableSettings.settingsBuilder().put("number_of_shards", 8)).execute().actionGet();}

?

???? 更新数据的代码：

????

public void bulkData(){BulkRequestBuilder blukRequest = client.prepareBulk();try {IndexReader reader = IndexReader.open(FSDirectory.open(new File(store_path)));int maxDocs = reader.maxDoc();List<Document> list  = new ArrayList<Document>();int count = 0;for (int i = 0; i < maxDocs; i++) {list.add(reader.document(i));if(list.size()%100==0){for(int j =0;j<list.size();j++){Document doc = list.get(j);blukRequest.add(client.prepareIndex("video", "vType", String.valueOf((j+count)))   .setSource(XContentFactory.jsonBuilder()                     .startObject()                     .field("title",doc.get("title"))                     .field("author",doc.get("author"))                     .field("keyword",doc.get("keyword"))                     .field("fenlei",doc.get("fenlei"))                     .field("other",doc.get("other"))                     .field("subname",doc.get("subname"))                     .field("subtitles",doc.get("subtitles"))                     .field("summary",doc.get("summary"))                     .field("videolink", doc.get("videolink"))                     .endObject()                     ));}count+=list.size();BulkResponse bulkResponse = blukRequest.execute().actionGet();client.admin().indices().prepareRefresh().execute().actionGet();if(!bulkResponse.hasFailures())System.out.println("------success!");elseSystem.out.println("------failure!");list.clear();} }if(list.size()>0){for(int i =0;i<list.size();i++){Document doc = list.get(i);blukRequest.add(client.prepareIndex("video", "vType", String.valueOf((i+count)))   .setSource(XContentFactory.jsonBuilder()                     .startObject()                     .field("title",doc.get("title"))                     .field("author",doc.get("author"))                     .field("keyword",doc.get("keyword"))                     .field("fenlei",doc.get("fenlei"))                     .field("other",doc.get("other"))                     .field("subname",doc.get("subname"))                     .field("subtitles",doc.get("subtitles"))                     .field("summary",doc.get("summary"))                     .field("videolink", doc.get("videolink"))                     .endObject()                     ));count+=list.size();BulkResponse bulkResponse = blukRequest.execute().actionGet();//client.admin().indices().prepareRefresh().execute().actionGet();if(!bulkResponse.hasFailures())System.out.println("------success!");elseSystem.out.println("------failure!");list.clear();}}} catch (CorruptIndexException e) {} catch (IOException e) {e.printStackTrace();}}

?? 还是静坐等待高手的指点ing......

???接下来介绍solr4.0Alpha,喜欢solr的朋友可以学习了哦...

?? 限于篇幅solr4.0+tomcat的安装，查看我的百度空间http://hi.baidu.com/620734263/item/372ea2c7955fbc7088ad9eaa

??