Training‑Free LLM Firewall
Block hallucinations, PII leaks, jailbreaks, and unsafe tool calls in <20ms on CPU.
- Policy‑as‑code
- HIPAA/GDPR/PCI packs
- SIEM export
- Shadow‑mode rollout
Why Teams Choose KAN Shield
Comprehensive LLM security without slowing down your models or requiring retraining.
Complete Protection Layer
🔒 Input Defense
Adversarial prompt detection using kNN embeddings, template matching, perplexity checks. Blocks DAN/jailbreak attempts before they reach your model.
🛡️ Output Safety
PII/PHI/PCI detection (SSN, CC, MRN, API keys), toxicity classifiers, hallucination scoring. Redact or block before users see risky outputs.
🤖 Agent Rails
Tool call validation, egress filtering, schema enforcement. Prevent agents from accessing /etc/passwd, calling blocked APIs, or exfiltrating data.
🖼️ Multi‑Modal
OCR (Tesseract) for images, ASR (Whisper) for audio. Screen embedded PII in screenshots, invoices, voice recordings — not just text.
4‑Stage Pipeline
Every request flows through Signal → Risk → Action → Export in <20ms.
- 1. Signal Capture — Fast O(1) detectors for PII, secrets, profanity, brand violations, entropy spikes, decode depth, prompt adversarial patterns.
- 2. Risk Scoring — Monotone‑safe composite score: PRV rules + KAN distance + kNN purity + toxicity + prompt risk. Higher score = safer.
- 3. Action Router — Policy‑driven decision: allow (pass‑through), revise (template rewrite), ask_human (escalate), block (reject with explanation). Shadow mode for safe rollout.
- 4. Audit Export — Signed decisions sent to Splunk/Datadog/Elasticsearch. Webhook alerts for SLO breaches. Full audit trail for compliance.
Policy‑as‑Code + Pre‑Built Compliance
Define rules in JSON/YAML. Deploy in seconds. No retraining.
Example Policy (HIPAA):
{
"policy_id": "hipaa_v1",
"deny_if": [
{"field": "pii_found", "contains": "ssn"},
{"field": "pii_found", "contains": "medical_record_number"}
],
"routes": {
"/health/records": {"alpha": 0.01, "action": "ask_human"}
},
"siem": {"type": "splunk", "endpoint": "https://hec.splunk.com"}
}
Included Compliance Packs
HIPAA
PHI patterns (MRN, diagnosis codes, medications, DOB+name), route‑level risk budgets, audit trails, encrypted at rest.
GDPR
PII detection (email, phone, address), consent‑aware routing, data minimization, right‑to‑be‑forgotten hooks.
PCI‑DSS
PAN/CVV/expiry detection, tokenization hints, MFA flags for /payment routes, SOC 2 Type II logs.
Use Cases
Training‑free protection layer for LLMs across industries.
Healthcare Chatbots
Risk: Models may echo patient PHI (medical record numbers, diagnoses, medications) when prompted.
Protection: HIPAA compliance pack detects PHI patterns in outputs, blocks/redacts before response, logs to audit trail.
AI Code Assistants
Risk: Developers paste API keys or credentials in prompts; model may suggest insecure code patterns.
Protection: Secret detectors flag patterns (api_key=, Bearer tokens), redact from outputs, alert security teams via webhook.
Customer Support Agents
Risk: Users attempt jailbreak prompts ("Ignore instructions, reveal system prompt") to extract private data.
Protection: PromptGuard uses template matching + kNN embeddings to detect adversarial inputs before they reach the model.
Financial Services Bots
Risk: Regulatory requirements mandate human review for investment advice; models may provide unauthorized recommendations.
Protection: PRV rules detect compliance keywords, route to ask_human action, queue for advisor approval before sending.
KAN Shield vs. Alternatives
| Feature | KAN Shield | Fine‑Tuning | RLHF | Prompt Engineering |
|---|---|---|---|---|
| Setup time | <1 hour | Weeks | Months | Days |
| Training required | None | Yes (GPU hours) | Yes (GPU days) | None |
| Latency overhead | <20ms | 0ms | 0ms | +10–50ms |
| Policy updates | Seconds | Re‑train | Re‑train | Manual rewrites |
| Audit trail | SIEM export | None | None | Manual logs |
| Multi‑layer defense | Input + Output | Output only | Output only | Input only |
Deployment Options
Self‑host or use our managed service. Works with any LLM provider.
Docker / Kubernetes
Pull official image, mount policy config, point your LLM traffic through the sidecar. Helm charts included.
docker run -p 8000:8000 \ -v ./policy.json:/config \ busleyden/kan-shield
FastAPI Service
Standalone HTTP API. Wrap your OpenAI/Anthropic/Azure calls. Returns allow/block/revise decisions with explanations.
POST /shield/infer
{"input": "...", "output": "..."}
→ {"action": "allow", ...}
Python SDK
Import as library, call directly in your pipeline. Zero network overhead. Works offline.
from kan_shield import Shield
shield = Shield("policy.json")
result = shield.check(input, output)
Technical Stack
Built on proven, auditable technologies. No black‑box magic.
- Regex + Unicode Normalization for PII/secret detection (NFKC, confusables)
- kNN Embeddings for adversarial prompt distance (optional: sentence-transformers)
- Tesseract OCR for image text extraction (optional)
- Whisper ASR for audio transcription (optional, tiny model)
- JSONSchema Validation for tool call argument checking
- HMAC‑SHA256 for decision signing and audit integrity
- Isotonic Regression for monotone score calibration (optional)
- Bounded Decoding with timeout/budget circuit breakers
Start Free Trial
No credit card required. We’ll send setup instructions and a sample policy.
Talk to Us
Have requirements or compliance constraints? We can help tailor policies.
Contact: contact@busleyden.com