Should I invest in auditing LLM responses for compliance?

To address your concern, it's essential to understand the motivations behind your company's desire to audit LLM responses for compliance. Typically, this is driven by the need to ensure regulatory adherence, mitigate potential risks, or maintain brand reputation. However, before dismissing the idea, consider the potential benefits of such an audit, such as identifying biases or inaccuracies in LLM outputs. Instead of outright dismissing the subscription, you could explore alternative solutions that achieve the same goals, such as implementing in-house auditing processes or adjusting your LLM usage guidelines. You could also discuss the costs and potential return on investment (ROI) of the proposed subscription.