Llm

Glossary

AI Gateway

A centralized proxy layer that routes, governs, monitors, and optimizes requests to LLM providers, serving as the control plane for …

Glossary

LLMOps - LLM Operations

The practices, tools, and infrastructure for deploying, monitoring, and managing large language model applications in production …

Patterns

PII Redaction Pipeline

Automated detection and removal of personally identifiable information from LLM inputs and outputs: detection strategies, redaction methods, …

Glossary

WebSocket

What WebSockets are, how they enable real-time bidirectional communication, and why they are used for streaming LLM token delivery to …