SkillA skill gives Relay a specialist method it can reuse on your work.AI & Agent ToolingCommunity
Medium riskSecurity review passed

huggingface-local-models

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm.

How it works

What huggingface-local-models does

Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

Inputs and results

What goes in, what comes back

  1. You give

    A short brief describing what you need

    Add a specialist method to the work.

  2. You get

    A finished result to review

    The method guides the work with your files and context.

  3. You check

    The sources and open questions

    Review the output against your brief.

Questions and answers

Questions about huggingface-local-models

Updated May 13, 2026.

What does huggingface-local-models do?

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

Who is huggingface-local-models for?

It is designed for teams that want to hand off recurring work and review the result before it is used.

What do I need to use it?

Nothing extra is needed. Sign in to Relay to run it with your own files and context.

What does huggingface-local-models produce?

A finished result to review. Results come back with their sources and any open questions for you to check before anything is used.

How much does huggingface-local-models cost?

It is free to use. Paid model usage, if any, is shown before a run.

Can an AI agent use it?

Yes. Agents can read its public definition through the Relay API and run it with a person’s authorization. See the For Agents page for how to connect.

Details

Trust, access and technical details

Trust and access

Visibility
Public: anyone can view
Status
Published and maintained
Pricing
Free
Medium riskSecurity review passedBehavior not evaluated
Reviewed version
cmoq1di4b02q6…
Reviewed
May 13, 2026
Static signals
3 signals
Source provenance
Commit pinned

Security review is a static package assessment, not a guarantee of safety or a behavioral qualification.

Use it from code or an agent

Read the public definition, then check cost and inputs with a preflight before a run.

Open definition

POST /api/v1/runs/preflight

How agents connect to Relay →

Tags and source

Repo
huggingface/skills
License
Apache-2.0

Have a task this would help with?

Describe it. Relay plans the work, picks the right playbook and shows the cost before anything runs.

Loading request box