Several ongoing tasks for this ticket:
Make sense of metrics in Cloudflare Turnstile dashboard
Examine the Turnstile metrics reported by Cloudflare and determine whether they tell us anything useful about the effectiveness of Turnstile.
Monitor spam metrics in New Relic
In #2118, I added code to report spam check metrics to New Relic. Evaluate these metrics as they accumulate over the next 2 weeks. The metrics tell us:
- How often Touchpoints is rejecting submissions for being spam
- How often each of our spam check methods has been applied
- How often each of our spam check methods has identified spam
Recruit beta testers to flag spam
The key metric we need in order to judge the effectiveness of Turnstile is % of submissions received that are spam (as judged by form owners). We want this metric to go down, without unduly affecting the secondary metric total count of non-spam submissions. In order to compute these metrics, we need at least some of our beta testers to commit to assessing and marking spam for all submissions received within some period before Turnstile was enabled and some period after Turnstile was enabled.
Several ongoing tasks for this ticket:
Make sense of metrics in Cloudflare Turnstile dashboard
Examine the Turnstile metrics reported by Cloudflare and determine whether they tell us anything useful about the effectiveness of Turnstile.
Monitor spam metrics in New Relic
In #2118, I added code to report spam check metrics to New Relic. Evaluate these metrics as they accumulate over the next 2 weeks. The metrics tell us:
Recruit beta testers to flag spam
The key metric we need in order to judge the effectiveness of Turnstile is % of submissions received that are spam (as judged by form owners). We want this metric to go down, without unduly affecting the secondary metric total count of non-spam submissions. In order to compute these metrics, we need at least some of our beta testers to commit to assessing and marking spam for all submissions received within some period before Turnstile was enabled and some period after Turnstile was enabled.