Evaluation and Analysis

Psychometric properties of ACP 360

Analysis of the data from the first 466 participants in ACP 360 (5886 colleague and 8563 patient ratings) shows that: 

• ACP 360 questionnaires have good internal consistency
• Colleagues and patients agree on their rating of a consultant
• Ratings by colleagues and patients do not correlate with consultants' self-ratings - they flag up issues of which a consultant may be unaware
• Inter-rater reliability is such that ratings by 13 colleagues and 25 patients are required

A survey of psychiatrists who have used ACP 360 found that

75% found the results of the assessments helpful

85% found the report clear and easy to understand

90% agreed that the instructions were easy to follow and that no training was required to take part and stated that the report would form part of their next appraisal

Although most psychiatrists in the survey had only recently recieved their report, a substantial number had already changed the way in which they interacted with their colleagues and patients based on their results.

What psychiatrists Say About ACP 360

'I used the findings to reflect on my practice and to identify areas where I could change'

'A relatively simple process that was much easier than I feared'

'I noticed that my colleagues' and my patients' views were very different than the way I see my practice. I have tried to listen more'

'I used my results as evidence for my application for a Clinical Excellence award'

'I have found the feedback on areas I need to improve quite motivating and have since endeavoured to improve on them'

Back to ACP 360 main page