Files
penguin-harness/changelog/0.2.0/2026-07-22-skills.md
T
2026-07-23 02:06:43 +08:00

2.0 KiB

Skills: local serving and fine-tuning join AI App Development

Three new built-in skills extend the AI App Development group so agents can stand up and tune the models they build on:

  • vllm — install and serve models with vLLM's OpenAI-compatible server, including the tool-calling flags agent harnesses need (--enable-auto-tool-choice --tool-call-parser …), quantization and memory options, and troubleshooting.
  • ollama — pull and serve local models with Ollama, its OpenAI-compatible endpoint, and context-length tuning via OLLAMA_CONTEXT_LENGTH or a Modelfile.
  • llamafactory — fine-tune with LlamaFactory (dataset registration, llamafactory-cli train/export/chat/api driven by the upstream example YAMLs), then serve the result with vLLM or with Ollama via a Modelfile import.

Both serving skills share a guided workflow: ask the user which model to serve (recommending the small Qwen3.5-0.8B default when they have no preference) and which engine they prefer — Ollama as the approachable default, vLLM when throughput matters — then serve, verify, and register the endpoint with the penguin CLI (models appear in penguin config model list only after model add). Each skill's icon follows the project's official mark.

The hard root-separation guardrail lives where configuration is taught — the penguin-cli skill (now v5) and the penguin-sdk skill: configuring Penguin's own model uses the default root, but models configured for an AI app under development must use the app's own project directory (--root ./penguin_data) unless the user chose otherwise — never the global ~/.penguin/data. The serving skills point at that rule rather than restating it.

The agenthub-models skill tracks the AgentHub 0.4.1 upgrade: it documents the new supported-model registry, the config parameters a client may now reject outright, and the Gemini 3.6 / Kimi K3 / GLM-5.2 families with their reasoning-effort knobs, alongside a routing table rewritten from the release's actual client-matching order.