---
title: "AI and Compliance- Performance and Accuracy"
canonical: "https://support.mercell.com/space/MSF/196215505029/AI%20and%20Compliance-%20Performance%20and%20Accuracy"
format: markdown
---
**Finnish coming soon**

---

# 🇬🇧 AI and Compliance- Performance and Accuracy

### Evaluation Metrics

** **

**What metrics will be used to evaluate the performance and accuracy of the AI summaries?**

The performance and accuracy of the AI summaries will be evaluated using the following metrics:

- **Precision:**The proportion of relevant information correctly identified in the summaries.
- **Recall**: The proportion of all relevant information that is captured in the summaries.
- **F1 Score:** The harmonic mean of precision and recall, providing a single metric for overall accuracy.
- **User Satisfaction:** Feedback from users regarding the usefulness and relevance of the summaries.
- **Comparison to Benchmarks:** Comparison of AI-generated summaries against human-generated benchmarks to ensure quality.


### Continuous Monitoring

** **

** How will we monitor the AI system's performance over time to ensure consistent quality and accuracy?**

Continuous monitoring will be implemented through:

- **Automated Monitoring:** Automated systems to track the performance metrics and alert the team to any significant changes or declines in quality.
- **Regular Performance Reviews: **Scheduled performance reviews to analyse metrics and make necessary adjustments.
- **User Feedback Analysis:** Ongoing collection and analysis of user feedback to identify areas for improvement.
- **Performance Logs:** Detailed logs of system performance over time, allowing for trend analysis and proactive adjustments.