PII Production

Appearance

Success Metrics ​

To measure the success of the PII App, we will track a range of metrics that reflect user adoption, system performance, customer satisfaction, revenue growth, regulatory compliance, and other key areas. The following success metrics will be monitored.

Adoption Rate ​

  • Number of Active Users: Track the number of active users on a monthly basis to gauge user engagement and adoption of the PII App.
  • Volume of Processed Documents: Monitor the volume of documents processed by the application, including the number of uploads, redactions, and downloads. This will help measure the app's usage and its impact on reducing manual redaction efforts.

Accuracy ​

  • PII Detection Accuracy: Measure the precision and recall of the PII detection algorithms. Precision indicates the proportion of correctly identified PII entities out of all identified entities, while recall indicates the proportion of correctly identified PII entities out of all actual PII entities.
  • Redaction Accuracy: Assess the accuracy of the redaction process to ensure that all identified PII is properly redacted without affecting non-PII data.

Customer Satisfaction ​

  • Surveys and Feedback: Conduct regular customer satisfaction surveys to gather feedback on the user experience, functionality, and overall satisfaction with the PII App. Track Net Promoter Score (NPS) and other satisfaction metrics.
  • Support Tickets: Monitor the number and types of support tickets submitted by users to identify common issues and areas for improvement.

Revenue ​

  • Subscription Growth: Track the number of new subscriptions and renewals on a monthly basis to measure revenue growth and the financial success of the PII App.
  • Customer Lifetime Value: Calculate the average revenue generated per customer over the duration of their subscription to assess the long-term value of the customer base.

Compliance ​

  • Regulatory Compliance: Ensure that the application meets all relevant data privacy and protection regulations, such as GDPR, CCPA, and POPIA. Conduct regular audits and assessments to verify compliance.
  • Audit Logs: Monitor audit logs to ensure that all actions related to PII access and redaction are properly recorded and traceable, demonstrating adherence to compliance requirements.

Performance ​

  • System Uptime: Measure the uptime of the application, aiming for a minimum of 99.9% availability in production environments.
  • Response Time: Track the response time for user interactions and document processing tasks, ensuring that they are completed within acceptable timeframes.
  • Throughput: Monitor the system’s ability to handle concurrent document processing tasks without significant performance degradation.

Scalability ​

  • Horizontal Scalability: Assess the system's ability to scale horizontally by adding additional instances to handle increased loads.
  • Vertical Scalability: Evaluate the system’s ability to scale vertically by upgrading existing infrastructure to accommodate more processing power as needed.

Maintainability ​

  • Code Quality Metrics: Use static code analysis tools to measure code quality, ensuring adherence to coding standards and best practices.
  • Technical Debt: Track the accumulation of technical debt and prioritise refactoring efforts to maintain a clean and maintainable codebase.

Extensibility ​

  • Feature Adoption: Monitor the adoption of new features and enhancements to gauge their impact and effectiveness.
  • Customisation Requests: Track the number and types of customisation requests from users to identify common needs and areas for potential improvement.

Interoperability ​

  • Integration Success Rate: Measure the success rate of integrations with external systems, ensuring seamless data exchange and communication.
  • API Usage Metrics: Track the usage of APIs to understand how they are being utilised and identify any performance bottlenecks or issues.