Frequently asked questions about ACP360

ACP-360-logo-300

Frequently asked questions about ACP360

How long does the ACP 360 process take?

The process takes about 8 weeks. If you reach the recommended number of returns, you are able to contact the ACP 360 team for your report to be generated (this will be generated within 1 working day).


How many feedback responses do I need to collect before I can request my report to be generated?

We recommend that you collect at least 25 patient responses, and 13 colleague responses.

This is alongside your self-assessment. If collecting the above amount of responses is not achievable, please contact the team.


Can ACP 360 be used by SAS doctors who have completed their core training in psychiatry?

Yes.


What can 360 feedback tell me?

360-degree feedback (sometimes known as multi-source feedback) is a model of assessment which aims to present more rounded feedback to an individual than the traditional “top-down” approach where feedback is gathered only from an individual’s line manager.

It is an opportunity to gain a perspective on how important aspects of your work performance are perceived by colleagues and service users. Scores can help you to identify areas of good practice as well as areas that you might further develop.


What if I am not able to collect patient feedback?

ACP 360 offer a 270 version of the assessment. The report will be compiled of feedback from colleagues and your self-assessment.


How is free text feedback included?

Free text comments can complement the numerical feedback in the main report by giving you further insight into your strengths and areas for development. The experience from other multi-source feedback tools which use free text is that participants find this component of the assessment valuable and encouraging.

Both colleagues and patients are given the option to leave free text comments in their feedback.


Could unfair criticism from one colleague skew my results?

A high number of colleagues and patients complete assessments and their responses are aggregated. Negative responses from one person will not greatly affect the mean scores. Also, the ACP 360 report is just one part of the portfolio of information that will be considered at your appraisal.

Please be aware that we do not share individual colleague responses with participants.

All data is presented in aggregate form and individual questionnaires are not available.


How should I read the main report?

You should read the report in full and reflect on what it suggests are areas where you are strong and areas on which you might want to work in the future. Do these fit with your self-perception? You should not focus unduly on one single item but on domain scores and what the report as a whole tells you about yourself. 

The benchmark scores are there to guide you. Do not become fixated on whether you are above or below the mean.  Remember that a score of 4 means that your performance has been assessed as being moderately high (good) on the behaviour(s) covered by that item or domain. Any score of 4 or above means that your patients and colleagues have high regard for you.


With whom should I share my report?

Firstly, you should take time yourself to reflect on what you can learn from the report.

After that, the best setting to discuss your report is in your appraisal meeting. If you have a mentor or coach, you may also wish to share elements of your report with them.

There is a space on the system which allows you to enter the details of your appraiser, so you can electronically send them you report. This is optional.


What should I do if I am concerned about my results?

Discuss any concerns with the colleague who is conducting your appraisal or with another trusted colleague or mentor.

Remember that ACP 360 is not an examination, there is no pass or fail, and the process is designed to enable you to reflect on and improve your practice.


How do I use the report as part of my appraisal?

The ACP 360 report should be included in the portfolio of information that you discuss with your appraiser. The discussion with your appraiser should consider the strengths and areas for development in a balanced way.


What else can I do with the results?

We recommend that you develop an action plan to address any issues that have been identified by the ACP 360 process. This might be part of a wider personal development plan agreed with your appraiser and/or peer group.

Some issues might also be taken into the job planning process with your clinical manager. For example, if it is agreed during the appraisal discussion that an unduly heavy workload is a factor affecting your results.

We recommend that you make a diary note to review your action plan and progress 6 months after appraisal. The action plan can then be further reviewed at your next appraisal meeting.


When should I next undergo ACP 360?

This should be discussed with your appraiser, as needs may vary. As a guide, we recommend that psychiatrists undertake ACP 360 at least once every 5 years.

The GMC requires revalidation every 5 years.


What if I enrol and don’t complete the process?

If you wish to withdraw from ACP 360 please contact us within 30 days of registration and we will offer you a full refund as long as you have not activated your account.

How have the ACP 360 results been gathered?

The report is based on questionnaire returns from the participant, a number of colleagues and patients. 

The participant was asked to involve a sufficient number of colleagues (a recommended minimum of 13 returns) and of patients (a recommended minimum number of 25 returns) to obtain valid and reliable results.

The participant and their colleagues complete an online questionnaire and the service users post them in paper form, or complete through an online questionnaire.

We don’t know the identity of the colleagues or service user feedback.

How are colleague assessors selected?

How to select colleague assessors.

How and when will I receive the ACP 360 report?

The psychiatrist being assessed should receive a report within 8 weeks of starting the ACP 360 process.

He/she should add the ACP 360 report to their appraisal folder and provide this to their appraiser in good time and at least a week before the appraisal meeting.

There is also the option for them to send the report directly to their assigned appraiser.

What should I do before the appraisal meeting?

The appraiser should take time to read through the report and note any domains in which the appraisee is scoring significantly outside the norms of the benchmark data. 

Where there are extreme scores, it is important to check the number of returns for the items in that domain.

The appraiser may form some preliminary thoughts. However, interpretation of the results is a joint process between appraiser and appraisee. Remember that a score of 4 means that performance has been assessed as being moderately high (good) on the behaviour(s) covered by that item or domain.

Any score of 4 or above that means that patients and colleagues have high regard for the psychiatrist concerned.

How should I discuss the report in the appraisal meeting?

It is important to remember that some appraisees will be very anxious about this, particularly if they have never participated in multi-source feedback before.

The process is intended to be formative and the discussion should be positive. Its purpose is to help the participant to identify his or her strengths and areas that he or she might wish to work on as part of their personal and professional development. 

The appraiser should stress the fact that ACP 360 is designed to encourage personal development, not to single out poor practice. 

The ACP 360 assessment report should be considered as one part of the wider appraisal process and should not be considered in isolation. Items or domains where the number of colleague raters is below 13 or if patient raters is below 25 should be treated cautiously.

What else should I be encouraging the appraisee to do?

We recommend that you encourage the appraisee to develop an action plan to address any issues that have been identified by the ACP 360 process.

This should focus on two or three main areas rather than trying to encompass every aspect of the report. This action planning might be part of the appraisee’s wider personal development plan agreed with you as their appraiser and/or with the appraisee’s peer group. 

You might encourage the appraisee to take some issues into the job planning process with their clinical manager. For example, if it is agreed during the appraisal discussion that an unduly heavy workload is a factor affecting their results.

We recommend that the appraisee makes a diary note to review their action plan and progress 6 months after appraisal. The action plan can then be further reviewed at the next appraisal meeting.

How often should psychiatrists undertake ACP 360?

You should discuss this with the appraisee, as needs may vary. As a guide, we recommend that psychiatrists undertake ACP 360 at least once every 5 years in line with GMC requirements.

I cannot log on to the site…

The online questionnaire can only be accessed via the unique link contained in the invitation email.

To enter the survey system, you must always use the link contained in this email invitation - you cannot type the address into the browser yourself as it will not contain your security code.

If you have used the link and have then logged out, please close your internet browser and log in again by using the link contained inside your email invitation.

I have previously logged in successfully, but now I cannot get past the login screen…

Please ensure that you use the link contained within the email invitation.

This link is unique to you and must be used in combination with the email address that received the invitation otherwise you will not be allowed to login.

If you took a survey recently or have received several email invitations from different colleagues then it is possible that your browser was not logged off the site.

Please clear your browsers cookies and try again using the link contained inside the email invitation.

I have completed an online questionnaire about a colleague but now wish to go in and change the scores…

Once a questionnaire is submitted, it cannot be changed and only one questionnaire can be completed by a nominated colleague. This is to maintain the integrity the data.

Entering the email address for each colleague seems quite time-consuming and subject to error - is there any way I can do this more efficiently?

Email addresses can be copied and pasted into the necessary boxes.

You can also 'click and drag' these from some email address lists or from a Word document.

My colleagues report that they have not received the invitation email

Invitation emails to colleagues are generated automatically - if a colleague reports that they have not received an invitation email, please re-visit your assessment homepage to check that their email address have been entered correctly.

It may be useful to check that there are no spaces within the address.

If you have entered a web-based email address - i.e. @yahoo.com or hotmail.co.uk, please ask your colleagues to check their junk mail folders.
If your question isn't answered here please email the ACP360 team who will be happy to help. Alternatively you can call the team on 0203 701 2696/5.
Get in contact to receive further information regarding a career in psychiatry