Evals for Flagright

Real-time alerting on in-flight transactions

Detection and disposition of a transaction as it is processed, including latency-sensitive decisioning.

Post-transaction / retrospective monitoring

Batch or lookback review of settled activity and re-alerting on newly suspicious patterns.

Alert quality and false-positive burden

Signal-to-noise on generated alerts, given the stated goal of reducing repetitive triage.

Network and typology detection

Ontology-driven surfacing of fraud networks and linked-entity behavior across accounts.

Nested no-code rule construction

Building sophisticated multi-condition logic through the configuration surface rather than code.

Natural-language rule authoring

AI Rule Builder translating a stated AML policy intent into a configured rule.

Rule simulation before deployment

Estimating the effect of a proposed rule or threshold change on alert volume ahead of go-live.

Shadow rule isolation

Confirming a rule under test refines quietly without affecting live operations or analyst queues.

Continuous risk reassessment

Score movement in response to changed customer behavior rather than static onboarding-time risk.

Configurable matching algorithms

Tuning name and entity match strictness, including transliteration and near-match handling.

Screening hit adjudication

True-match versus false-positive disposition and the record left behind for each decision.

Risk-score explainability

Attribution of a score or score change to the specific contributing factors.

Grounding of agent conclusions in case evidence

Whether stated findings trace to actual transaction, customer, and screening data on the case.

Explanation and audit trail of AI reasoning

Whether an agent's recommendation can be reconstructed and defended after the fact.

Deference to human judgment

Handling of ambiguous or low-confidence cases where the agent should escalate rather than decide.

Agent scope boundaries

Behavior when a request falls outside the agent's data access or authorized actions.

Case lifecycle and disposition integrity

State transitions from alert through investigation to closure, with attribution and timestamps.

Custom investigation workflow execution

Whether a workflow built to a firm's compliance logic routes and gates as configured.

Quality assurance sampling and review

Enforcement of investigation quality standards across analyst work at volume.

Escalation and handoff

Routing a case to a reviewer, MLRO, or filing decision without loss of context.

SAR generation completeness and accuracy

Whether a filing narrative and fields reflect the underlying investigation record.

Jurisdictional format handling

Correct form and schema selection across FinCEN and GoAML destinations.

Filing deadline and status tracking

Visibility into pending, submitted, and rejected filings and their timing obligations.

Audit-ready evidence retention

Reconstructing who decided what, on what evidence, for an examiner or internal audit.