Using a local small model avoids compliance and data privacy issues associated with sending production logs and sensitive metrics to third-party services.