Specify multiple binary names?

[airtonix]

ie, all the llama.cpp binaries.

What cmd would I run so that all of those binaries are downloaded in one go?

[autarch]

There is an --extract-all option which will unpack the entire archive. Would that work for your use case?

[polarathene]

Would that work for your use case?

I'd rather a way to filter/specify what to extract if possible? For example moonrepo/proto has two binaries proto + proto-shim, but the archive also has other content:

$ ubi --project moonrepo/proto --tag v0.54.1 --in /tmp/example --extract-all

$ ls -1 /tmp/example
CHANGELOG.md
LICENSE
README.md
proto
proto-shim

If using ubi to do a reasonable thing like --in /usr/local/bin/, those markdown documents and license aren't files you'd want to place at the target location.

Here's a Dockerfile snippet for that same program but without ubi, I can extract with a filter for the two files via tar but it's a tad clunky (full path in archive required):

FROM downloader AS get-proto
ARG PROTO_ARCH=x86_64
ARG PROTO_VERSION=0.54.1
ARG PROTO_RELEASE="https://github.com/moonrepo/proto/releases/download/v${PROTO_VERSION}/proto_cli-${PROTO_ARCH}-unknown-linux-musl.tar.xz"
# NOTE:
# `--no-same-owner` used as release archive files have ownership of `1001:127`
# `--strip-components=1` required to extract contents without retaining archived parent directory (eg: `proto_cli-x86_64-unknown-linux-musl`)
RUN wget -qO - "${PROTO_RELEASE}" \
  | tar --extract --xz --no-same-owner --directory /usr/local/bin --strip-components=1 \
  "proto_cli-${PROTO_ARCH}-unknown-linux-musl/proto" "proto_cli-${PROTO_ARCH}-unknown-linux-musl/proto-shim"

With UBI we could simplify that to:

FROM downloader AS get-proto
ARG PROTO_VERSION=0.54.1
RUN ubi --project moonrepo/proto --tag "v${PROTO_VERSION}" --in /tmp/example \
    --extract proto proto-shim

I used additional args/inputs which I don't think are used by UBI? So technically --extract-all could remain the option name as the values aren't tied to it, but would effectively be the existing logic you already have to find proto inferred from moonrepo/proto? Just additionally filtering for proto-shim as well.

Alternatively, if you could support --bin proto --bin proto-shim or --bins proto,proto-shim that would work. I believe some alternative tools support a glob/regex pattern filter to include/exclude.

---

Reference - How eget supports this functionality

Using zyedidia/eget with --file globbing option (no regex pattern):

Dockerfile:

FROM alpine AS bin-eget
ARG TARGETARCH
ARG RELEASE_VERSION=1.3.4
ARG RELEASE_URL=https://github.com/zyedidia/eget/releases/download/v${RELEASE_VERSION}/eget-${RELEASE_VERSION}-linux_${TARGETARCH}.tar.gz
RUN <<HEREDOC
  wget -qO - "${RELEASE_URL}" | tar \
    --extract --gzip \
    --directory /usr/local/bin \
    --strip-components=1 \
    --no-same-owner \
    eget-${RELEASE_VERSION}-linux_${TARGETARCH}/eget
HEREDOC

# Either grab the executable manually or build a container with above `Dockerfile`:
$ docker build --tag localhost/eget:1.3.4 .
$ docker run --rm -it localhost/eget:1.3.4

# Actual usage:
# NOTE: `--asset` + `--all` are necessary to avoid interactive prompts
$ eget moonrepo/proto --tag v0.54.1 --asset musl --to /tmp/example/ --file '**/proto*' --all

https://github.com/moonrepo/proto/releases/download/v0.54.1/proto_cli-x86_64-unknown-linux-musl.tar.xz
Downloading 100%
Checksum verified with proto_cli-x86_64-unknown-linux-musl.tar.xz.sha256
Extracted `proto_cli-x86_64-unknown-linux-musl/proto-shim` to `/tmp/example/proto-shim`
Extracted `proto_cli-x86_64-unknown-linux-musl/proto` to `/tmp/example/proto`

$ ls -1 /tmp/example
proto
proto-shim

NOTE: eget will present a prompt when it's asset and file extraction filtering has multiple choices:

• There's a glibc and musl libc variant. --asset can be repeated multiple times with a string to match (or prefixed with ^ for a string match to ignore).
• --all is like UBI --extract-all. Without it the --file glob provided identifies two matches within the archive and prompts for which file to choose, when combined with --all this effectively filters out other files from the archive.

Interactive prompt examples

# Without `--asset musl`:
$ eget moonrepo/proto --tag v0.54.1 --to /tmp/example

2 matches found: please select manually
(1) proto_cli-x86_64-unknown-linux-gnu.tar.xz
(2) proto_cli-x86_64-unknown-linux-musl.tar.xz
Enter selection number:

# Without `--all`:
$ eget moonrepo/proto --tag v0.54.1 --asset musl --to /tmp/example/ --file '**/proto*'

2 candidates for target `**/proto*` found: please select manually
(1) proto_cli-x86_64-unknown-linux-musl/proto-shim
(2) proto_cli-x86_64-unknown-linux-musl/proto
(3) all
Enter selection number:

NOTE: A caveat with eget is that --to:

• Will install to a directory only if that directory already exists.
• Otherwise (directory doesn't exist) when the --to value:
  • Has a trailing / => fails to extract the binary but directory is created.
  • Has no trailing / => Equivalent to UBI --in + --rename-exe in that --to acts as a move and will create a binary (any parent directories are created without issue). Thus error prone if not careful.
  • Is paired with --all => Directory path is created and all assets extracted.

As eget isn't maintained (no commit activity since July 2024), nor any established community fork... It'd be nice to find an alternative replacement 😁

If the --file glob option at eget looks viable, perhaps for ubi a better option name like:

• --filter
• --file-filter
• --files (could imply --extract-all, but with a filter applied?)

[polarathene]

For the original authors query, it's a bit more tricky with just a glob. Unlike --asset in eget the --file option doesn't support multiple glob inputs:

# Most binaries have a `llama-` prefix:
$ eget 'ggml-org/llama.cpp' --tag b7798 --asset '^vulkan' --to /tmp/example/ --file 'llama-*/llama*' --all
# Except for `rpc-server`:
$ eget 'ggml-org/llama.cpp' --tag b7798 --asset '^vulkan' --to /tmp/example/ --file 'llama-*/rpc-server' --all

$ ls -1 /tmp/example
llama-batched-bench
llama-bench
llama-cli
llama-completion
llama-fit-params
llama-gemma3-cli
llama-gguf-split
llama-imatrix
llama-llava-cli
llama-minicpmv-cli
llama-mtmd-cli
llama-perplexity
llama-quantize
llama-qwen2vl-cli
llama-server
llama-tokenize
llama-tts
rpc-server

The folder structure is a bit different from what the screenshot implied, I also used this release tag as the current latest release tag has failed it's release CI job to upload the assets.

So maybe given the above --glob / --extract-glob as a repeatable option would work for ubi to be invoked only once and get all those binaries 👍

---

Equivalent command for UBI would then be something like this:

ubi \
  --extract-glob 'llama-*/llama*' \
  --extract-glob 'llama-*/rpc-server' \
  --in /tmp/example \
  --url https://github.com/ggml-org/llama.cpp/releases/download/b7798/llama-b7798-bin-ubuntu-x64.tar.gz

NOTES:

• Cannot use --project ggml-org/llama.cpp --tag b7798 (due to non-standard asset name)
• --matching ubuntu-vulkan should only return one result but fails due to earlier filtering logic (no OS match). Hence needing --url