Research Validation Plan
The empirical study this prototype is designed to enable.
Research Questions
RQ1Can evidence-grounded Customer Twins represent preference patterns of Toba tourism consumers?
RQ2How closely do Customer Twin evaluations align with real customer evaluations?
RQ3Does human calibration improve Customer Twin alignment?
RQ4Can calibrated Customer Twins reduce the number of concepts requiring initial physical testing?
Experimental Comparison
Proposed baselines for a future ablation study
Baseline 1
Generic LLM
Baseline 2
LLM + Persona
Baseline 3
LLM + Persona + Evidence
Baseline 4
LLM + Persona + Evidence + Human Calibration
Evaluation Metrics
Same metrics used by the Calibration module
Spearman ρMAEDecision AgreementStability
No baseline in this comparison has been run yet. This page documents the intended research design; all reported metrics elsewhere in this prototype are illustrative demo data, not results of this study.Proposed Research