{"product_id":"bertil-model-distillation-on-device","title":"Bertil — Model Distillation \u0026 On-Device Engineer AI Skill","description":"\u003cdiv style=\"font-family: 'DM Sans', sans-serif; color: #1A1A18; max-width: 680px;\"\u003e\n  \u003cp style=\"font-size: 16px; font-weight: 600; line-height: 1.5; margin: 0 0 8px 0;\"\u003eDrop Bertil into Claude and get a distillation engineer who measures the quality cost of every quantization step instead of assuming INT4 is free.\u003c\/p\u003e\n  \u003cp style=\"font-size: 13px; color: #555550; line-height: 1.7; margin: 0 0 28px 0;\"\u003eBertil makes a small model good enough and gets it onto the device: knowledge distillation from a large teacher across response, feature and rationale distillation; task-specific small language models; quantization across INT8, INT4, GPTQ, AWQ and GGUF with the quality cost measured rather than assumed; pruning and sparsity; LoRA and adapter merging; on-device runtimes including llama.cpp, MLX, ONNX Runtime, Core ML and TFLite; memory, thermal and battery budgets on real hardware; latency on mobile and edge silicon; the hybrid pattern where a small model handles the common path and escalates the rest; offline capability and update distribution; and honest evaluation against the teacher on the tasks that matter.\u003c\/p\u003e\n  \u003cdiv style=\"background: #EBEDFA; border-radius: 12px; padding: 24px 28px; margin-bottom: 24px;\"\u003e\n    \u003cp style=\"font-size: 10px; font-weight: 600; color: #2F46DA; letter-spacing: 0.08em; text-transform: uppercase; margin: 0 0 16px 0;\"\u003eWhat you get\u003c\/p\u003e\n    \u003cul style=\"margin: 0; padding: 0; list-style: none;\"\u003e\n\u003cli style=\"font-size: 13px; padding: 7px 0; border-bottom: 1px solid rgba(47,70,218,0.14); display: flex; gap: 10px;\"\u003e\n\u003cspan style=\"color:#2F46DA; font-weight:600;\"\u003e→\u003c\/span\u003e\u003cspan\u003eResponse, feature and rationale distillation from a teacher\u003c\/span\u003e\n\u003c\/li\u003e\n\u003cli style=\"font-size: 13px; padding: 7px 0; border-bottom: 1px solid rgba(47,70,218,0.14); display: flex; gap: 10px;\"\u003e\n\u003cspan style=\"color:#2F46DA; font-weight:600;\"\u003e→\u003c\/span\u003e\u003cspan\u003eINT8\/INT4, GPTQ, AWQ and GGUF with measured quality cost\u003c\/span\u003e\n\u003c\/li\u003e\n\u003cli style=\"font-size: 13px; padding: 7px 0; border-bottom: 1px solid rgba(47,70,218,0.14); display: flex; gap: 10px;\"\u003e\n\u003cspan style=\"color:#2F46DA; font-weight:600;\"\u003e→\u003c\/span\u003e\u003cspan\u003ellama.cpp, MLX, Core ML, ONNX and TFLite on real hardware\u003c\/span\u003e\n\u003c\/li\u003e\n\u003cli style=\"font-size: 13px; padding: 7px 0;  display: flex; gap: 10px;\"\u003e\n\u003cspan style=\"color:#2F46DA; font-weight:600;\"\u003e→\u003c\/span\u003e\u003cspan\u003eMemory, thermal and battery budgets; hybrid escalation patterns\u003c\/span\u003e\n\u003c\/li\u003e\n    \u003c\/ul\u003e\n  \u003c\/div\u003e\n  \u003cdiv style=\"display:flex; align-items:center; gap:20px; background:#FFFFFF; border:1px solid #E8E6E0; border-radius:8px; padding:14px 20px; margin-bottom:24px;\"\u003e\n    \u003cspan style=\"font-size:11px; color:#888780; font-family:monospace;\"\u003e📄 bertil-model-distillation-on-device.skill\u003c\/span\u003e\n    \u003cspan style=\"font-size:11px; color:#888780;\"\u003eUnder 2 min install\u003c\/span\u003e\n    \u003cspan style=\"font-size:11px; color:#888780;\"\u003eWorks with Claude, ChatGPT \u0026amp; any AI chat\u003c\/span\u003e\n  \u003c\/div\u003e\n  \u003cdiv style=\"border-left:3px solid #2F46DA; padding-left:16px;\"\u003e\n    \u003cp style=\"font-size:10px; font-weight:600; color:#2F46DA; letter-spacing:0.08em; text-transform:uppercase; margin:0 0 6px 0;\"\u003eHow to install\u003c\/p\u003e\n    \u003cp style=\"font-size:12px; color:#555550; line-height:1.7; margin:0;\"\u003eDownload the .skill package → open Claude → paste SKILL.md into your Project Instructions or system prompt → describe your requirement → Bertil builds the answer. Includes a full worked example so you see exactly what you get.\u003c\/p\u003e\n  \u003c\/div\u003e\n\u003c\/div\u003e","brand":"KissMySkills","offers":[{"title":"Default Title","offer_id":58385010196744,"sku":null,"price":14.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/1036\/1444\/7880\/files\/2764b203-8001-446a-abe8-0cf11ff6df76.png?v=1786051439","url":"https:\/\/kissmyskills.com\/zh\/products\/bertil-model-distillation-on-device","provider":"KissMySkills","version":"1.0","type":"link"}