Guardrail solutions based on small classification models (such as BERT-level models for toxicity detection) typically have latencies ranging from tens to hundreds of milliseconds.