tdbloader3
----------

This is an experimental (pure Java) version of tdbloader2 (which uses UNIX 
sort instead). See also: https://issues.apache.org/jira/browse/JENA-117

If you want to try it, here is how you can checkout and compile it:

  cd /tmp
  svn co https://svn.apache.org/repos/asf/incubator/jena/Scratch/PC/tdbloader3/trunk/ tdbloader3
  cd /tmp/tdbloader3
  mvn package

This is how you can run it:

  java -cp target/jena-tdbloader3-0.1-incubating-SNAPSHOT-jar-with-dependencies.jar -server -d64 -Xmx6144M cmd.tdbloader3 --no-stats --compression --spill-size 1500000 --loc /tmp/tdb /opt/datasets/raw/openlibrary-2011-06-02.nt.gz

For a list of the options:

  java -cp target/jena-tdbloader3-0.1-incubating-SNAPSHOT-jar-with-dependencies.jar cmd.tdbloader3 -h

  cmd.tdbloader3 --loc=DIR FILE ...
  General
      -v   --verbose         Verbose
      -q   --quiet           Run with minimal output
      --debug                Output information for debugging
      --help
      --version              Version information
      --loc                  Location
      --compression          Use compression for intermediate files
      --buffer-size          The size of buffers for IO in bytes
      --gzip-outside         GZIP...(Buffered...())
      --spill-size           The size of spillable segments in tuples|records
      --no-stats             Do not generate the stats file
      --no-buffer            Do not use Buffered{Input|Output}Stream
      --max-merge-files      Specify the maximum number of files to merge at the same time (default: 100)