Our COA Development and Evaluation Service
Following good questionnaire design practice is an essential component in COA e.g. PRO and ClinRO development and evaluation, but is rarely reported as part of its development. A poorly designed COA measure and poor content validity will have a negative impact on data quality as well as the cultural adaptation from the source language.
At dhpresearch we provide a comprehensive integrated service that ensures your COA design meets the highest standards prior to translatability assessment, cultural adaption, field testing and psychometric evaluation.
How we shorten the development time of COAs and the cost of adaptation:
- Reducing the need for multiple rounds of cognitive interviewing with scripted and standardised probes
- Identifying format and design weaknesses within items that affect responder compliance not necessarily reflected in the psychometric properties of the measure
- ensuring optimised face validity in the original language prior to translatability assessment for cross-cultural adaptation
Stage 1 COA Review
QuesTReviewTM is our proprietary expert review diagnostic tool which benchmarks your COA against 32 design parameters of questionnaire design good practice which ensures your COA design is fully optimised prior to translatability assessment or undergoing cognitive interviews.
Results of the QuesTReviewTM appraisal are used to revise question wording, response wording, question ordering, questionnaire format etc.
QuesTReviewTM also provides an overall estimate of the level of fatigue experienced by respondents to complete the questionnaire based on use of question type.
Stage 2 Cognitive Interviewing
People don't always interpret questions in the way we intend which can result in measurement error, affecting the validity and accuracy of the survey. Cognitive testing improves data collection tools, like questionnaires and diaries, ensuring the best quality data.
Qualitative feedback from QuesTReviewTM enables the development of scripted (anticipated) and standardised probes in order to reduce interviewer variation and enable maximum control by the interviewer.
Stage 3 Analysis
To maximise the quality of analysis, using Q-Notes we code and analyse interview data using one or a combination from 5 coding systems dependent on time and resources, nature of the material tested, respondent population, sample size. In our analysis we also take account of other critical issues such as (a) the appropriate data aggregation methodology and (b) levels of analysis including, within and across interview and across subgroups.
Stage 4 Reporting
We provide a comprehensive and detailed report that uses a structured format that facilitates ease of reading.
Our report writing centres first, on the importance of integrating, and placing in context the different sources of evidence. Secondly, the importance of simplifying the data, adding clarity and focusing on the end decision-making process.