enwiki-20131001 dump & CSVs

Help
2013-11-21
2013-11-29
  • liupengjie
    liupengjie
    2013-11-21

    I asked you to do all the tests, the use of several machines in testing, how much memory each machine, thank you very much

     
  • single machine: OptiPlex 780
    16 GB RAM
    ubuntu64
    hadoop 2.2.0
    took about 3 days

     
  • liupengjie
    liupengjie
    2013-11-29

    Hello, I want to consulting you, you install in the Java API process, running the demo class WikipediaDefiner. Java a success? My abnormal, I OutOfMemoryError: Java heap space. My JVM configuration is as follows

    -Xms513m
    -Xmx2G
    -XX:MaxPermSize=256m
    -XX:ReservedCodeCacheSize=128m
    -XX:+UseCodeCacheFlushing
    -XX:-UseGCOverheadLimit
    -ea
    -Dsun.io.useCanonCaches=false
    -Djava.net.preferIPv4Stack=true

     
    Last edit: liupengjie 2013-12-08