The task of creating or even reviewing health care guidelines and policies never falls to ICU trainees at the level of exam candidacy, and therefore all questions on this matter will seem foreign and mildly insulting. As plebs, we are not expected to participate in such matters. However, the college has made it important to learn how healthcare policy is made. There are discrete steps and important keywords to spout in the answer.
Question 15 from the first paper of 2014 asked about the steps which would be required to review or change the guidelines for transfusion practice in the ICU. Question 10 from the first paper of 2017 wanted a policy to control a rampant CLABSI rate, and Question 27 from the first paper of 2019 had the candidates dealing with an epidemic of delirium. A similarly themed Question 4 from the second paper of 2016 had asked the candidates to set up a Rapid Response Team service, but as this falls more into the "critical care outreach" basket it has ended up in its own chapter.
There are no official CICM resources for this, and fewer still are published works on the subject of what makes good practice in policymaking. Oh's Manual has nothing on the subject. The best resource I could find was this "Document development and review framework" from the Sydney Children's Hospital. The document is helpfully titled "PLEASE TYPE POLICY TITLE HERE", and features a helpful flowchart of policy development complete with warnings to run things past your department manager. Additionally, it has several excellent references:
- Moulding et al, 1999
- Schünemann et al, 2006 ( the first in a series of such articles, about the methods used by WHO to create their recommendations)
- Silagy et al, 1998 (same, but from the NHMRC)
- Guideline development resources from www.agreetrust.org
The content of these documents has been mixed with the college answer from Question 15 and presented below. Wherever it is found, cringe-inducing corporate buzzspeak is italicised so that it can be more easily memorised and regurgitated in return for marks.
In brief, guideline development should consist of the following key stages:
- Define the process which requires a practice guideline
- Compose a panel of experts and stakeholders, and nominate its leader
- Develop the questions answered by the guideline
- Develop selection criteria for the published evidence
- Perform a literature search according to these criteria
- Appraise the evidence, extract data from it, and synthesise recommendations
- Draft guidelines, and expose the draft to external review
- Publish the final draft
- Monitor adherence and uptake
- Audit the practice to monitor outcome changes associated with the new guidelines
- Prepare scheduled updates
Identify the practice
- A need for review is identified, and the department manager approves of this.
- The specific area is defined as a practice policy or work process which requires a protocol to standardise practice, improve outcomes or prevent adverse events.
- An existing guideline or policy may be in need of revision
Compose the guidelines panel
- Key stakeholders form a multidisciplinary working party .
- A multidisciplinary approach is called for which involves consumers
- The working part appoints a Team Leader (or, one if appointed from the top down)
- Timeframes are identified, as to how long it should take to create the policy, and the mandatory review period (for the next time this policy needs to be updated)
- A schedule of meetings is drawn up, with key dates for completion of policy drafts and other important time intervals in the process
Identify the question
- The purpose and scope of the guidelines is clearly defined
- Specific questions are determined, eg. "Should any specific haemoglobin concentration trigger a mandatory transfusion?"
- The target audience for the guidelines is defined
- Specific health outcomes are defined, which the guideline should address
Develop research strategies
- Evidence selection criteria are developed
- A literature search is performed with the abovementioned criteria. If possible, a systematic literature review should be undertaken.
- The evidence is reviewed and critically appraised
- Data relevant to the guideline is extracted and presented for the working party to assess
- The working part develops a series of recommendations according the the presented data
- Other similar policies and guidelines from other institutions are explored and useful material is borrowed or adapted
- A cost analysis is performed and the cost of the new policy is compared to that of existing practice
- Possible barriers to implementation are considered
- A draft of the guideline is generated
Specific features and properties of the guidelines document
- A good guidelines statement should:
- Identify the organisation responsible
- Define the purpose of the guideline
- List individuals and groups responsible for its development
- Document clearly the process of evaluation of the evidence
- Provide a bibliography
- Detail the assumptions
- Record public policy and economic questions which were considered
- Identify the need for special training required for implementation
- Record how consumer concerns were taken into account
- Detail methods for dissemination
- Detail the timeframe for evaluation
- The draft is widely circulated
- Key personnel outside the working panel are nominated to critique the draft
- Consideration is given to suggestions and commends on the draft, and by recursive improvement a final draft is created which is approved by all key stakeholders.
- The final draft is then framed in a pre-defined publication format for thematic consistency with other existing guidelines
- The final product is submitted for approval by the department manager.
- Roll-out occurs on a previously specified date, of which all key audiences are made aware well in advance.
- The final policy is then widely circulated. Alternatively, the guidelines may be piloted in pre-specified locations or scenarios before wirder circulation.
- Internal and external education sessions are held to update staff on the new practice
- Guideline documents are made accessible
- Contact is made with educators, to act as ‘champions’ to promote the guideline
- Experts are made available for contact and questions
Audit and quality assurance
- Repeated data analysis and collection should be carried out after the guidelines are disseminated and implemented.
- Guideline dissemination efficacy, uptake and adherence by practitioners, consumer satisfaction and health outcomes are possible data to be collected for audit.
- Auditors are nominated from departments to implement this policy monitoring processes
- The auditing team creates short-term and long-term frameworks for evaluation and identifies who will conduct the studies.
- Regular meetings are scheduled by the auditors to monitor compliance and to feed back on the implementation process
- A multidisciplinary group not unlike the one which developed the guidelines should meet regularly to determine whether new evidence needs to be incorporated.
- The group should review research strategies of the original group, and improve on the process where possible
- Outcomes and recommendations arising from audit activity should be incorporated into the revision process