Privacy-Preserving LLM Observability: Distributed Tracing, Silent Drift Detection and Data Minimisation
How can engineering teams monitor production RAG and LLM pipelines for latency stalls and silent retrieval drift without stockpiling confidential prompts in log stores? An applied CODLAB study on W3C tracing, OpenTelemetry, shift tests, and GDPR.