Tool for using Spark to copy URLs to a cluster in parallel.
Builds using Apache Maven. Run mvn package to build, and
run with spark-submit --class net.fnothaft.copier.Copier target/copier*.jar.
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Tool for using Spark to copy URLs to a cluster in parallel.
Builds using Apache Maven. Run mvn package to build, and
run with spark-submit --class net.fnothaft.copier.Copier target/copier*.jar.