this repo has no description
anil.recoil.org
1opam-version: "2.0"
2authors: "Francois Berenger"
3maintainer: "unixjunkie@sdf.org"
4homepage: "https://github.com/UnixJunkie/pardi"
5bug-reports: "https://github.com/UnixJunkie/pardi/issues"
6dev-repo: "git+https://github.com/UnixJunkie/pardi.git"
7license: "GPL-1.0-or-later"
8build: ["dune" "build" "-p" name "-j" jobs]
9depends: [
10 "dune" {< "3.0"}
11 "batteries"
12 "dolog" {< "4.0.0"}
13 "parany" {>= "6.0.0" & < "10.0.0"}
14 "minicli"
15 "ocaml" {>= "4.05.0"}
16]
17synopsis: "Parallel and distributed execution of command lines, pardi!"
18description: """
19Command line tool to parallelize programs which are not parallel;
20provided that you can cut an input file into independent chunks.
21
22For example, to compress a file in parallel using 1MB chunks:
23
24$ pardi -d b:1048576 -m s -i <YOUR_BIG_FILE> -o <YOUR_BIG_FILE>.gz \
25 -w 'xz -c -9 %IN > %OUT'
26
27You can cut the input file by lines (e.g. SMI files),
28by number of bytes (for binary files),
29by a separating line verifying a regexp (quite generic)
30or by a block separating line (e.g. MOL2/SDF/PDB file formats).
31
32If processing a single record of your input file is too fine grained,
33you can play with the -c option to reach better parallelization
34(try 10,20,50,100,200,500,etc).
35
36usage:
37pardi ...
38 {-i|--input} <file>: where to read from (default=stdin)
39 {-o|--output} <file>: where to write to (default=stdout)
40 [{-n|--nprocs} <int>]: max jobs in parallel (default=all cores)
41 [{-c|--chunks} <int>]: how many chunks per job (default=1)
42 [{-d|--demux} {l|b:<int>|r:<regexp>|s:<string>}]: how to cut input
43 file into chunks (line/bytes/regexp/sep_line; default=line)
44 {-w|--work} <string>: command to execute on each chunk
45 [{-m|--mux} {c|s|n}]: how to mux job results in output file
46 (cat/sorted_cat/null; default=cat)
47 [{-ie|--input-ext} <string>]: append file extension to work input files
48 [{-oe|--output-ext} <string>]: append file extension to work output files
49"""
50url {
51 src: "https://github.com/UnixJunkie/pardi/archive/v1.0.1.tar.gz"
52 checksum: "sha512=dd739298166765f0537f5b74680b5e59bd976d7847ac9390195cb82addc64b9271b11f07d9ceb91f62748bd96de73c6f8391204748f7b024ed659f23d03bd2a9"
53}