Pythia allows setting up alerts directly from the dashboard so you can stay updated with your AI system. These alerts can be customized by configuring the following:
Define an alert rule specific to your needs.
Set a contact point to receive notifications.
Set a notification policy to receive notifications via email, SMS, or enterprise messaging systems.
You can specify alert_type and threshold in your Pythia dashboard to receive notifications. For example, if you set alert_type to ACCURACY_RULE, you will receive email notifications related to the accuracy of your LLM claims.
The threshold specifies your desired budget for API usage. Specifying a threshold allows keeping track of your budget and control your spending.