Frequently asked questions

This page will be updated on a regular basis

Q. How will the audit data be used?

A. Data will be analysed by the NCAP team at the Royal College of Psychiatrists and reported on at national and Trust/Health Board level. Trusts/Health Boards will also receive local reports at an appropriate level of greater break-down of results.

Q. Will my Trust/Health Board be identified in the report?

A. Data will be provided at National and Trust/Health Board level and further appropriate levels of result's breakdown will be made available in local reports. Each Trust/Health Board has a unique identifier and these will be available in the national reports.

Q. Who will have access to the data?

A. The national reports will be made publicly available and data aggregated at Trust/Health Board level will be made available on data.gov.uk. In addition, aggregate data on key performance indicators will be provided to the Care Quality Commission (CQC) to inform visits.

Q. Can participation in NCAP be included in Quality Accounts?

A. Yes, as a NCAPOP audit, participation can be included in Quality Accounts.

Q. How will the quality of the data be assured?

A. A random number of participating services were selected for quality assurance visits in early 2018 and the same will happen in early 2019. The purpose of these visits will be to independently check a small sample of records. 

Q. Where can we view a copy of the most recent data flow chart for NCAP?

Here is a copy of our NCAP data flow chart (last updated February 2018).

Q. What is the timeline for NCAP?

A. A high-level time line for the EIP spotlight audit is available via Resources for audit.

 

Q. Were there service user and carer components to the core audit?

A. There were no service user or carer questionnaires in the core audit, although a service user survey is planned to take place in Year 3 (2019/20).

Q. Will there be an avenue for carer and/or service user input?

A. There will be a service user questionnaire for patients in EIP services in Year 3 of the audit (2019/20).

Q. Will there be a contextual questionnaire like in the EIP Network self-assessment last year?

A. Yes, like last year, each team will be asked to complete one contextual data questionnaire, along with a copy of the case note audit tool for all patients identified in the sample. 

Q. Are there differences in the tools to the EIP Network self-assessment from last year?

A. There are some minor differences. You can see a summary of the changes.

Q. One patient declined to give permission to contact their family; in another case it wasn't felt appropriate that the family be involved in the patient's care. How can we reflect this in the questions about a carer-focused education and support programme?

A. Please answer 'No' to question 5 regarding whether the person has an identified family member, friend or carer who supports them. This means that you will not be required to answer question 10, which asks about a carer-focused education and support programme.

Q. What option should be chosen if a patient refused to state their ethnicity?

A. If the patient's ethnicity is not stated or not known, please choose 'not documented' when answering question 3.

Q. What would count as a ‘full package of care’ for Q11 on the contextual data questionnaire?

A. A full package of care is defined as service users receiving care which was appropriate for them at the time. It does not necessarily mean that the service user had to have received every single element of the NICE recommended care. The full package of care would refer to those service users who were discharged either after completing a 3-year pathway or those who were discharged earlier because they recovered early. This excludes service users who were discharged for non-engagement.

Q. We’re part of the South Region EIP Programme. Are we able to use data submitted for the EIP Matrix as in the self-assessment exercise last year?

A. Unfortunately, it won’t be possible for organisations to use data they'd submitted via the matrix this year. This is because the matrix used service information, whereas NCAP uses a sample and case note audit, therefore the samples are different for each.

Q. Is ethical approval or patient consent required for the audit?

A. NCAP conforms to the CCQI ethical audit  standards and does not require ethics approval nor patient consent.

Q. Our Trust participates in the annual EIP Network self-assessment – will this audit replace it, or will we be asked to participate in both?

A. NCAP EIP spotlight audit will replace the EIP self-assessment exercise in 2018/19.

Q. Will the sample size for our organisation be 100 patients in total or 100 patients per team?

A The sample size is 100 patients per team within the organisation. If there are less than 100 patients within a team who meet the sampling criteria, then we would just sample all of those on the caseload who do meet criteria.

Q. What time frame will we be auditing?

A. To meet the eligibility criteria, patients must have been on the team’s caseload for 6 months or more at the census date (1 February 2018) and still on the caseload in September 2018 when the list of patients is submitted to the NCAP team.

A. The cut-off for data collection is the 31st October and so data collected must represent the care provided prior to this date (not the census date). Physical health screening and interventions must have taken place in the 12 months prior to 31 October 2018; for other questions, the intervention must have been delivered in accordance to the guidance.

Q. What period of the Early Intervention in Psychosis Waiting Times data will be used for Standard 1 (Service users with first episode of psychosis start treatment in early intervention in psychosis services within two weeks of referral {allocated to, and engaged with, and EIP care coordinator})?

A. Data from November 2018 – January 2019 will be used.

Q. How does the NCAP data collection relate to the collection of physical health CQUIN data for EIP services in 2018?

A. In order to minimise the burden of data collection, information on the proportion of people who have been screened and had interventions for their physical health will be extracted from this year’s National Audit of Early Intervention in Psychosis for EIP services.

A. In 2018/2019, in addition to demonstrating cardio metabolic assessment and treatment for patients with psychoses, EIP services must also demonstrate positive outcomes in relation to BMI and smoking cessation for patients. To do this, we will ask for separate data on smoking status and weight for some service users identified in the CQUIN 2017/18 sample.

Q. Will patients under 18 be included in the CQUIN?

A. All patients born after 2000 will be excluded from the analysis. Please note that as we don’t have information on the month of birth, it’s not possible to exclude patients born in November and December 2000, and therefore who may still have been 17 at the end of data collection. For more information on eligibility, please see the overview of EIP CQUIN data collection.

Q. Is there any information regarding the inpatient/community CQUIN for 2018/2019?

A.Yes, please see the inpatient and community CQUIN webpages.

Q. For the EIP BMI outcome indicator, how will cases be analysed where initial baseline is “not recorded”, “documented evidence of refusal” or “person was pregnant”?

A. If either weight measurement (pre or post commencement of anti-psychotic medication) is not available, then this case would not be included in the calculations for this indicator, as both weights are required to determine a change in weight. However, we will also be reporting on the number of cases for which this information is not available to NHS England.

Q. When we received the sample for the EIP CQUIN Smoking and BMI outcome indicators, we didn’t have any patients in the smoking outcome indicator list. Is this correct?

A. Yes, smoking status will be extracted from the data submitted for the spotlight audit for all patients eligible for the indicator who are also in your NCAP sample. You will only have been asked to provide smoking status for any patients who were not in your NCAP sample. This means that some teams may not have had any patients in the sample for the EIP CQUIN smoking indicator.

Q. What happens after the CQUIN ends in 2019?

A. CQUIN is a financial lever intended to improve the quality of care over a given period of time. This CQUIN measured performance from 2014/2015 and has led to improvements in the quality of physical health screening and interventions for people with SMI who are at risk of developing a preventable disease.

2018/19 is the final year of ‘The Improving Physical Health for People with SMI’ CQUIN and providers and commissioners should work to ensure the improvements made during the CQUIN implementation are sustained and implemented.

To support this, NHS England has included a new requirement in the NHS Standard Contract which can be found here, and NHS England will continue to monitor delivery of physical health checks and interventions for people with severe mental illness through the Physical healthcare for people with SMI: Primary care data collection.
Get in contact to receive further information regarding a career in psychiatry