package pardi
Install
Dune Dependency
Authors
Maintainers
Sources
sha256=a340c038bdbf3bec1000966b7e55442e98f43272fcc69f343cc61dbb1f9a1da0
md5=0fc687f48a2a34973d414994618dea19
Description
Almost like GNU parallel; just better.
Pardi pushes further the point at which you have to use a supercomputer. Alternatively, it can be used on a supercomputer to make life in there much more fun and productive.
Put back the fun into computing: use pardi!
usage: pardi ... {-i|--input} : where to read from {-o|--output} : where to write to (default=stdout) [-s|--shell]: only shell commands in input file [{-n|--nprocs} ]: max jobs in parallel (default=all cores) [{-c|--chunks} ]: how many chunks per job (default=1) [{-d|--demux} {l|b:|r:|s:}]: how to cut input file into chunks (line/bytes/regexp/sep_line; default=line) {-w|--work} : command to execute on each chunk %IN and %OUT are special tokens [{-m|--mux} {c|n}]: how to mux job results in output file (cat/null; default=cat) [{-ie|--input-ext} ]: append file extension to work input files [{-oe|--output-ext} ]: append file extension to work output files [{-p|--preserve}]: mux results while preserving input order
Published: 16 Apr 2021
README
ParDi
Parallel and Distributed execution of command lines, pardi !
Example
Compress a file in parallel using 1MB chunks:
pardi -d b:1048576 -p -i <YOUR_BIG_FILE> -o <YOUR_BIG_FILE>.xz -w 'xz -c -9 %IN > %OUT'
Standardize molecules in parallel:
pip3 install chemo-standardizer
pardi -i input.smi -o output_std.smi -c 400 -d l -ie '.smi' -oe '.smi' \
-w 'standardiser -i %IN -o %OUT 2>/dev/null'
Install
For beginners or non opam users: download and execute the latest self-installer shell script from (https://github.com/UnixJunkie/pardi/releases).
Then, execute:
./pardi-2.0.1.sh ~/usr/pardi-2.0.1
This will create ~/usr/pardi-2.0.1/bin/pardi.
For opam users:
opam install pardi
Do not hesitate to contact the author in case of troubles or if you have any question.