Technical guidance for understanding the evaluation system, evidence format, and Heartcode implementation.
Version 0.1 — Public Draft
Overview
System Architecture
Evaluation Process
Evidence Model
Provider Comparison
Privacy Boundary
Limitations
Versioning
API Status
Overview
Validator Master is a reference implementation of the Heartcode Protocol for transparent and reproducible conversational AI behavior evaluation.
Prompt → Provider Adapter → AI Provider → Normalized Response → Heartcode Evaluator → Evidence Report
Evaluation Process
Receive a non-sensitive prompt
Send the same normalized request to selected providers
Preserve the complete provider responses
Apply a versioned Heartcode evaluator
Produce rule-level findings and reproducibility metadata
Evidence Model
Original prompt
Provider response
Provider and model
Rule verdicts
Findings
Supporting evidence
Protocol version
Evaluator version
Timestamp
Provider Comparison
Provider comparison uses the same prompt and normalized request structure. Results describe evaluated behavior for that specific interaction and should not be treated as permanent provider rankings.
Privacy Boundary
The public demo is designed for non-sensitive inputs. Prompts and responses are not stored by default, provider credentials remain server-side, and prompt content should not be included in analytics or routine logs.
Do not submit personal, medical, legal, confidential, proprietary, or identifying information.
Limitations
Evaluation results are specific to the submitted interaction
No automated evaluator can prove complete AI safety
Findings may require human review
Results are not legal, medical, security, or compliance advice
Validator Master does not certify HIPAA, GDPR, SOC 2, or regulatory compliance
Versioning
Heartcode rules, challenge suites, evaluator behavior, and evidence schemas are versioned so results can be interpreted and reproduced accurately.
API Status
Public API not yet available
The evaluation API is under development and will be documented after the request schema, security controls, rate limits, and privacy protections are finalized.