Understanding the Role and Limits of API-Based LLM Monitoring | Not Hacker News!