We hope the following will answer all your questions about ACP360.
If more information is needed, please contact a member of the ACP360 team by emailing ACP360@rcpsych.ac.uk or calling 0208 618 4029.
How long does the ACP 360 process take?The process takes about 8 weeks. If you reach the recommended number of returns, you are able to contact the ACP 360 team for your report to be generated (this will be generated within 1 working day).
We recommend that you collect at least 25 patient responses, and 13 colleague responses.
How many feedback responses do I need to collect before I can request my report to be generated?
This is alongside your self-assessment. If collecting the above amount of responses is not achievable, please contact the team.
Can ACP 360 be used by SAS doctors who have completed their core training in psychiatry?
360-degree feedback (sometimes known as multi-source feedback) is a model of assessment which aims to present more rounded feedback to an individual than the traditional “top-down” approach where feedback is gathered only from an individual’s line manager.
What can 360 feedback tell me?
It is an opportunity to gain a perspective on how important aspects of your work performance are perceived by colleagues and service users. Scores can help you to identify areas of good practice as well as areas that you might further develop.
ACP 360 offer a 270 version of the assessment. The report will be compiled of feedback from colleagues and your self-assessment.
What if I am not able to collect patient feedback?
Free text comments can complement the numerical feedback in the main report by giving you further insight into your strengths and areas for development. The experience from other multi-source feedback tools which use free text is that participants find this component of the assessment valuable and encouraging.
How is free text feedback included?
Both colleagues and patients are given the option to leave free text comments in their feedback.
A high number of colleagues and patients complete assessments and their responses are aggregated. Negative responses from one person will not greatly affect the mean scores. Also, the ACP 360 report is just one part of the portfolio of information that will be considered at your appraisal.
Could unfair criticism from one colleague skew my results?
Please be aware that we do not share individual colleague responses with participants.
All data is presented in aggregate form and individual questionnaires are not available.
You should read the report in full and reflect on what it suggests are areas where you are strong and areas on which you might want to work in the future. Do these fit with your self-perception? You should not focus unduly on one single item but on domain scores and what the report as a whole tells you about yourself.
How should I read the main report?
The benchmark scores are there to guide you. Do not become fixated on whether you are above or below the mean. Remember that a score of 4 means that your performance has been assessed as being moderately high (good) on the behaviour(s) covered by that item or domain. Any score of 4 or above means that your patients and colleagues have high regard for you.
Firstly, you should take time yourself to reflect on what you can learn from the report.
With whom should I share my report?
After that, the best setting to discuss your report is in your appraisal meeting. If you have a mentor or coach, you may also wish to share elements of your report with them.
There is a space on the system which allows you to enter the details of your appraiser, so you can electronically send them you report. This is optional.
Discuss any concerns with the colleague who is conducting your appraisal or with another trusted colleague or mentor.
What should I do if I am concerned about my results?
Remember that ACP 360 is not an examination, there is no pass or fail, and the process is designed to enable you to reflect on and improve your practice.
The ACP 360 report should be included in the portfolio of information that you discuss with your appraiser. The discussion with your appraiser should consider the strengths and areas for development in a balanced way.
How do I use the report as part of my appraisal?
We recommend that you develop an action plan to address any issues that have been identified by the ACP 360 process. This might be part of a wider personal development plan agreed with your appraiser and/or peer group.
What else can I do with the results?
Some issues might also be taken into the job planning process with your clinical manager. For example, if it is agreed during the appraisal discussion that an unduly heavy workload is a factor affecting your results.
We recommend that you make a diary note to review your action plan and progress 6 months after appraisal. The action plan can then be further reviewed at your next appraisal meeting.
This should be discussed with your appraiser, as needs may vary. As a guide, we recommend that psychiatrists undertake ACP 360 at least once every 5 years.
When should I next undergo ACP 360?
The GMC requires revalidation every 5 years.
If you wish to withdraw from ACP 360 please contact us within 30 days of registration and we will offer you a full refund as long as you have not activated your account.
What if I enrol and don’t complete the process?
How have the ACP 360 results been gathered?
The report is based on questionnaire returns from the participant, a number of colleagues and patients.
The participant was asked to involve a sufficient number of colleagues (a recommended minimum of 13 returns) and of patients (a recommended minimum number of 25 returns) to obtain valid and reliable results.
The participant and their colleagues complete an online questionnaire and the service users post them in paper form, or complete through an online questionnaire.
We don’t know the identity of the colleagues or service user feedback.
How are colleague assessors selected?
How and when will I receive the ACP 360 report?
The psychiatrist being assessed should receive a report within 8 weeks of starting the ACP 360 process.
He/she should add the ACP 360 report to their appraisal folder and provide this to their appraiser in good time and at least a week before the appraisal meeting.
There is also the option for them to send the report directly to their assigned appraiser.
What should I do before the appraisal meeting?
The appraiser should take time to read through the report and note any domains in which the appraisee is scoring significantly outside the norms of the benchmark data.
Where there are extreme scores, it is important to check the number of returns for the items in that domain.
The appraiser may form some preliminary thoughts. However, interpretation of the results is a joint process between appraiser and appraisee. Remember that a score of 4 means that performance has been assessed as being moderately high (good) on the behaviour(s) covered by that item or domain.
Any score of 4 or above that means that patients and colleagues have high regard for the psychiatrist concerned.
How should I discuss the report in the appraisal meeting?
It is important to remember that some appraisees will be very anxious about this, particularly if they have never participated in multi-source feedback before.
The process is intended to be formative and the discussion should be positive. Its purpose is to help the participant to identify his or her strengths and areas that he or she might wish to work on as part of their personal and professional development.
The appraiser should stress the fact that ACP 360 is designed to encourage personal development, not to single out poor practice.
The ACP 360 assessment report should be considered as one part of the wider appraisal process and should not be considered in isolation. Items or domains where the number of colleague raters is below 13 or if patient raters is below 25 should be treated cautiously.
What else should I be encouraging the appraisee to do?
We recommend that you encourage the appraisee to develop an action plan to address any issues that have been identified by the ACP 360 process.
This should focus on two or three main areas rather than trying to encompass every aspect of the report. This action planning might be part of the appraisee’s wider personal development plan agreed with you as their appraiser and/or with the appraisee’s peer group.
You might encourage the appraisee to take some issues into the job planning process with their clinical manager. For example, if it is agreed during the appraisal discussion that an unduly heavy workload is a factor affecting their results.
We recommend that the appraisee makes a diary note to review their action plan and progress 6 months after appraisal. The action plan can then be further reviewed at the next appraisal meeting.
How often should psychiatrists undertake ACP 360?
You should discuss this with the appraisee, as needs may vary. As a guide, we recommend that psychiatrists undertake ACP 360 at least once every 5 years in line with GMC requirements.
I cannot log on to the site…The online questionnaire can only be accessed via the unique link contained in the invitation email.
To enter the survey system, you must always use the link contained in this email invitation - you cannot type the address into the browser yourself as it will not contain your security code.
If you have used the link and have then logged out, please close your internet browser and log in again by using the link contained inside your email invitation.
I have previously logged in successfully, but now I cannot get past the login screen…
Please ensure that you use the link contained within the email invitation.This link is unique to you and must be used in combination with the email address that received the invitation otherwise you will not be allowed to login.
If you took a survey recently or have received several email invitations from different colleagues then it is possible that your browser was not logged off the site.
Please clear your browsers cookies and try again using the link contained inside the email invitation.
I have completed an online questionnaire about a colleague but now wish to go in and change the scores…Once a questionnaire is submitted, it cannot be changed and only one questionnaire can be completed by a nominated colleague. This is to maintain the integrity the data.
Entering the email address for each colleague seems quite time-consuming and subject to error - is there any way I can do this more efficiently?Email addresses can be copied and pasted into the necessary boxes.
You can also 'click and drag' these from some email address lists or from a Word document.
My colleagues report that they have not received the invitation emailInvitation emails to colleagues are generated automatically - if a colleague reports that they have not received an invitation email, please re-visit your assessment homepage to check that their email address have been entered correctly.
It may be useful to check that there are no spaces within the address.
If you have entered a web-based email address - i.e. @yahoo.com or hotmail.co.uk, please ask your colleagues to check their junk mail folders.