Fuailelagi Samoa Saleupolu Heger 12103972 Introduction This annotated bibliography is focused on exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. It includes the use of its two key client feedback measures: the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS). It is crucial to note from the outset that the PCOMS is not a therapeutic model or technique, as some perceive it to be. Developed jointly by therapists Barry Duncan and Scott Miller, the PCOMS evolved from what was known as a Client Directed Outcome Informed (CDOI) approach to therapy in the early years of the 2000s. Sometimes used interchangeably, the CDOI approach and the PCOMS use the ORS and SRS measures respectively, to seek client feedback at every single session about their view on the progress of therapy and their view on the quality of the relationship or therapeutic alliance. The use of these measures provides significant data that monitors and measures clients’ progress of change, treatment outcomes and effectiveness. Yet at its core, the PCOMS is about promoting a genuine way of working in collaboration and partnership with clients. In counselling, evidence-‐based practice (EBP) continues to be an ongoing topic of fierce debate and discussion. Particularly in regards to the validation of therapeutic models and/or techniques as evidence to prove the efficacy of treatment. However, in the midst of this debate the simplicity of the PCOMS is compelling. Equally so is the promotion of social justice and the empowerment of clients to lead and direct clinicians in their journey of change and recovery. Additionally, it is now a decade or so since its development and numerous arguments supporting its efficacy, the PCOMS is now one of only two client feedback programmes registered with the National Registry of Evidence-‐based Programs and Practices (NREPP)(2013) in the United States. For this annotated bibliography, the primary mode of research will be the Discover and Google Scholar search engines accessed through the Massey University library. Others such as Scopus and Web of Science will also be used. The key words that will be used for include: Partners for Change Outcome Management System, PCOMS, client directed outcome informed, CDOI, client-‐based feedback, outcome rating scale, ORS, session rating scale, SRS, Barry Duncan, Scott Miller, in relation to counselling and psychotherapy. The following key abbreviated terms will also be used throughout the annotated bibliography: PCOMS – Partners for Change Outcome Management System CDOI – Client Directed Outcome Informed ORS – Outcome Rating Scale SRS – Session Rating Scale NREPP – National Registry of Evidence-‐based Programs and Practices The sources considered will initially be those published over the past decade or so, with a focus on the past three to five years. Also a range of different sources such as books and journal articles will be considered, selected and reviewed based on its relevance and/or contribution to the topic. With particular attention to the validity of the PCOMS, the use of the ORS and SRS, the settings in which it is used and/or studied, its impact on treatment outcomes, therapeutic alliance, and the potential implication/s for clinical practice where applicable, in Aotearoa New Zealand. 1 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693-‐704. doi: 10.1037/a0016062 Form no.: 1 of 10 Keywords: PCOMS, couple therapy, client-‐based feedback, outcome measure Relevance rating: 96% Annotation: In this article, Anker, Duncan, and Sparks introduce a stirring backdrop of the challenges faced in mental health service delivery. Including the significant rate of dropouts, the ineffectiveness of treatment for some clients, therapist flexibility in the therapeutic alliance, and the overall confidence of clients in treatment. The article also draws attention to other key conceptions of research such as practice-‐based evidence (Barkham et al., 2001) and patient-‐focused research (Howard, Moras, Brill, Martinovich, & Lutz, 1996), both supporting the PCOMS and systematic client-‐focused feedback on treatment progress. Anker, Duncan, and Sparks share their findings of a study where the main purpose was to investigate the effects of using client feedback in couple therapy. The study compared two groups: feedback and treatment as usual (TAU) or no feedback. Randomised selection was used to place couples into a group. Anker, Duncan, and Sparks postulated that the feedback group would reveal a significant difference to the TAU group. The study is noteworthy, considering that prior to this, no other client feedback studies had been conducted specifically in couple therapy. Its key findings supported the authors’ established hypothesis in which the feedback group achieved quantifiably substantial change, at almost four times more than the TAU group. Additionally, at the six-‐month follow up, the feedback group maintained its lead of significant change compared to the TAU group. Despite the authors identifying and discussing numerous limitations of the study, the study appears to provide strong support for using client-‐based feedback in therapy. It suggests the feasibility of using client-‐based feedback in couple therapy in addition to individual therapy. However, one of the limitations identified is the uncertainty of whether other settings of couple therapy would reap similar results for example, ethnically diverse contexts. Therefore, there is certainly scope for areas such as that and others identified by the authors to be investigated further. 2 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Drury, N. (2007). The Kaupapa Outcome Rating Scale. New Zealand Journal Of Counselling, 27(1), 21-‐32. Form no.: 2 of 10 Keywords: kaupapa outcome rating scale, client feedback, Māori mental health Relevance rating: 89 % Annotation: A key area of clinical practice is the ability to work in culturally appropriate and relevant ways. In this article, Drury describes the mental health sector in Aotearoa New Zealand at the time of publication, as one that appears to have had an expectation of ‘best practice’ that predominantly meant only evidence-‐based therapies and treatments was to be used ‘on’ clients, likening it to process of colonisation. He highlights and discusses the relevant literature strongly supporting client-‐feedback measures, and presents the Kaupapa Outcome Rating Scale (KORS). Developed by Drury and used in his own practice, the KORS is based on the PCOMS ORS. However, the four questions reflect Durie’s (1998) Māori model of health, te Whare Tapa Whā. Drury was of the view that the questions of the Hua Oranga outcome measures for Māori mental health that were being developed at the time, failed to place the client at the centre of the change process. To a certain degree the article acts as a reminder of the significance of cultural awareness and appropriateness in clinical practice. Yet, it also provides an outcome measure that has been used effectively with tangata whaiora, by the author himself. It is also interesting to note the absence of a kaupapa Māori equivalent of the SRS measure, which is not explained or discussed in the article. Although Drury indicates a number of areas where the KORS may be explored further, particularly in relation to other Māori outcome measures. It appears that to date, little progress has been made. Even though there has been significant development with the Hua Oranga measure, since the time of writing including a recently completed project piloting its training and implementation across the mental health sector (McClintock, Sokratov, Mellsop, & Kingi, 2013). Furthermore, it does suggest that the cultural appropriateness and/or relevance of the PCOMS measures is certainly an area warranting further study and investigation. 3 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Duncan, B. L. (2012). The Partners for Change Outcome Management System (PCOMS): The heart and soul of change project. Canadian Psychology/Psychologie Canadienne, 53(2), 93-‐104. doi: 10.1037/a0027762 Form no.: 3 of 10 Keywords: PCOMS, client-‐feedback, evidence-‐based practice Relevance rating: 98% Annotation: Drawing on various studies demonstrating the significant benefits of PCOMS, Duncan presents a convincing case for the use of client feedback on outcomes, as a valid and effective way of measuring, monitoring and incorporating evidence into clinical practice. PCOMS is a relatively recent development that has generated momentum over the past three to five years. One that is significantly related to Rosenweig’s (1936) common factors explanation of therapeutic efficacy. Duncan provides a comprehensive description of the PCOMS story including the ORS and SRS measures. Detailing its inception, its development, and the growth of its usage, to its current status as an evidence-‐based practice. He discusses how the PCOMS encourages the values of privileging the client’s voice, expecting recovery, social justice, and a partnership that is led by clients to facilitate change and support their journey towards wellness. Duncan explains in depth how these PCOMS values relate to its implementation in non-‐clinical settings such as public behavioural health, and to the broader context of mental health service delivery, such as the clinical process and therapist development. In regards to clinical practice, it seems that a significant leap of faith is required by both individual clinicians and organisations to embrace this way of working, as it may be perceived as unconventional. However, Duncan does provide a checklist for organisations to judge their readiness for a PCOMS implementation. Additionally, in regards to Aotearoa New Zealand, the value of client privilege in shaping their care and treatment relates to the Māori principle of tino rangatiratanga or self-‐
determination, as reflected in the development of Drury’s Kaupapa Outcome Rating Scale (2007). As one of the co-‐founders of the PCOMS, Duncan clearly and logically presents a strong case for the implementation of client feedback programmes on outcomes, as a way of improving delivery and quality of service. 4 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Duncan, B. L., Miller, S. D., & Sparks, J. A. (2004). The heroic client: A revolutionary way to improve effectiveness through client-‐directed, outcome-‐informed therapy (Rev. ed.). San Fransisco, CA: Jossey-‐Bass. Form no.: 4 of 10 Keywords: client directed, outcome informed, effective treatment, psychotherapy Relevance rating: 99 % Annotation: This book is one of the early publications introducing the client-‐directed, outcome-‐informed (CDOI) approach to psychotherapy. Duncan, Miller, and Sparks provide a compelling and thought-‐provoking analysis of mental health service delivery. They examine the research and discuss various aspects of mental health including: the medical model framework, the evidence of psychotherapy treatment, clinical practice, and the use of psychoactive medication. All in relation to a single focus – the client, who is often a silent partner in these circumstances. Duncan, Miller, and Sparks challenge the medical model’s prescriptive diagnosis and evidence-‐based treatment of mental illness. They highlight a series of studies supporting what is referred to as the ‘Dodo bird verdict’ (Rosenzweig, 1936) suggesting that therapeutic change occurs as a result of multiple factors common to all therapies, as opposed to singling out the efficacy of one over others. The authors present an alternative to the medical model that focuses inherently on the client. Seeking constant feedback from clients is about privileging their voice, believing in their theory of change and supporting them to achieve their goals. The authors provide a detailed and comprehensive description of this CDOI approach, using a range of clinical illustrations of how it is applied in therapy, including both successful and challenging experiences. The CDOI approach has now progressed into the PCOMS and it appears only a few organisations have utilised it in Aotearoa New Zealand. Due to potential resistance, it seems there may be a challenge in its successful implementation and operation. However, the benefits of the PCOMS include accountability by providing a means to monitor progress. In addition is the potential of improving quality of service, where clinicians may specifically identify and pursue further professional development as a result of direct client feedback received. 5 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Gillaspy, J. R., & Murphy, J. J. (2012). Incorporating outcome and session rating scales in solution-‐focused brief therapy. In C. Franklin, T. S. Trepper, W. J. Gingerich, E. E. McCollum (Eds.), Solution-‐focused brief therapy: A handbook of evidence-‐based practice (pp. 73-‐91). New York, NY, US: Oxford University Press. Form no.: 5 of 10 Keywords: Outcome Rating Scale, Session Rating Scale, evidence-‐based practice, solution-‐focused brief therapy Relevance rating: 93 % Annotation: Gillaspy and Murphy’s introduction grounds this chapter in a reminder that the primary purpose of counselling, is to help people change. The PCOMS focus on privileging the client’s voice is closely aligned with the tenets of solution-‐focused brief therapy (SFBT). As Gillaspy and Murphy delve further into describing the connection between the ORS, the SRS and SFBT, they also consistently refer to existing evidence that supports and validates both client-‐based feedback and the PCOMS measures. In addition to explaining how clients complete an ORS and SRS form, Gillaspy and Murphy also briefly describe the PCOSMS measures used for children. They clearly outline, practical examples of how the ORS and SRS measures are both used in SFBT therapy. From initial contact and introduction of the measures, to using the feedback received in discussions with clients about their progress and the therapeutic alliance. Further practical guidance is provided to address possible challenges identified for practitioners of SFBT. Gillaspy and Murphy offer a number of constructive suggestions for further research of the PCOMS measures. A couple of suggestions include how to maximise the use of the ORS and SRS in therapy, and how best to incorporate the measures in therapist supervision and professional development. Supervision is central to clinical practice. The use of the ORS and SRS in supervision has demonstrated positive outcomes for clients (Reese et al., 2009). However, it appears that there is also potential for further study and exploration of how the ORS and SRS may be used in the context of supervision, to measure the supervisory alliance and the outcome of the supervision process for the supervisee. 6 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Green, D., & Latchford, G. (2012). Maximising the benefits of psychotherapy: A practice-‐
based evidence approach. Chichester, West Sussex, UK: John Wiley & Sons. Form no.: 6 of 10 Keywords: psychotherapy, practice-‐based evidence, CDOI, evidence-‐based practice Relevance rating: 96 % Annotation: Through the lens of a client-‐based feedback approach to therapy, this book unpacks and analyses further the ongoing psychotherapy debate (Wampold, 2001). Green and Latchford present and review an extensive range of literature from both sides of the debate, providing a comprehensive exploration of the recurring questions about psychotherapy that include: what works in therapy, how does it work, and how do we know it works? In light of the growing support and evidence for the client-‐based feedback on outcome and alliance in therapy, this book is timely. The authors examine the rules of what is considered evidence-‐based and its application to practice. They also discuss the concept of practice-‐based evidence and how it too may inform and enhance practice, highlighting the value of seeking regular client-‐feedback as a form of practice-‐based evidence, with particular reference to CDOI or the PCOMS. Drawn from their own experience, one of the authors offers practical illustrations of the ORS and SRS measures, demonstrating the benefits and challenges of their usage and the leanings derived from the experiences. As the authors consistently review the evidence for client-‐based feedback, they also recognise areas of further development and research. Similar to Gillaspy and Murphy (2012), they indicate supervision as one of these areas. They review related evidence (Reese et al., 2009), discussing the weaknesses of the study as well as the potential use of feedback in therapist supervision and training, and the scope for further research. They also offer a newly developed measure similar to the SRS, called the Leeds Alliance in Supervision Scale. The book provides food for thought and encourages therapists to keep an open mind about the evidence available, reflect on current practice and consider how change occurs for clients. Overall, Green and Latchford present a book that stimulates much thought in relation to understanding and applying evidence-‐based practice and practice-‐based evidence, particularly in regards to systematic client-‐based feedback. 7 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Janse, P., Boezen-‐Hilberdink, L., van Dijk, M. K., Verbraak, M. M., & Hutschemaekers, G. M. (2014). Measuring feedback from clients: The psychometric properties of the Dutch Outcome Rating Scale and Session Rating Scale. European Journal of Psychological Assessment, 30(2), 86-‐92. doi: 10.1027/10155759/a000172 Form no.: 7 of 10 Keywords: client feedback, Outcome Rating Scale, Session Rating Scale, validity, Relevance rating: 90 % Annotation: This article summarises the findings of a study that explored the validity and reliability of the Dutch ORS and SRS, in comparison to previous studies done in both the Netherlands and the United States. Despite the Dutch ORS and SRS measures being used widely, the authors explain the rationale behind this study, that although two other studies had been done in the Netherlands, the measures had not been adequately verified. According to Janse, Boezen-‐Hilberdink, van Dijk, Verbraak, and Hutschemaekers, one of the two studies comprised of an unrepresentative sample and limitation for generalisation. The other was narrowly focused on the validity of the ORS. However, those studies also alluded to the impact of cultural difference on the use of the PCOMS measures, when the interpretaion of Dutch data based on American clinical cut off scores or standards revealed clear differences. Therefore, Janse et. al set out to assess the psychometric properties of the Dutch ORS and SRS, and establish Dutch standards to interpret data. The findings of this study showed that the Dutch ORS and SRS are sufficiently reliable, but not completely validated. Another outcome was the establishment of Dutch standards, which also revealed slight differences compared to the American equivalent. The authors identify and discus several limitations of their study and also raise a number of areas for further research. It seems, that while there is support for the use of the Dutch ORS and SRS in the Netherlands, as Janse et. al clearly point out, from a research and practice perspective it raises questions about whether the American standards or clinical cut off scores, will suffice for use in other countries. Highlighting further the question of whether the PCOMS is culturally transferrable, which is a substantially relevant question for consideration and investigation for the Aotearoa New Zealand context. 8 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72-‐79. doi: 10.1037/a0022238 Form no.: 8 of 10 Keywords: PCOMS, Outcome Questionnaire-‐45, client feedback, Relevance rating: 95 % Annotation: Lambert and Shimokawa begin this article, by explaining one of the many reasons that justify the importance and value of systematic client-‐based feedback in psychotherapy, that is the challenge of therapists to identify those who deteriorate while in treatment. The focus of this article is on an evaluation and comparison of the two main systems used in client feedback, the PCOMS and the Outcome Questionnaire-‐45 (OQ-‐45). Both of which are only two systems registered with the National Registry of Evidence-‐based Programs and Practices (NREPP) in the United States. The authors, one of whom is a co-‐developer of the OQ-‐45 also provide a description of both systems including their measures. However, it seems the OQ-‐45 renders a more in-‐depth explanation that includes additional measures such as the Assessment for Signal Cases (ASC) and the Clinical Support Tool (CST), compared to the brief PCOMS summary. The meta-‐analysis used to statistically review the two systems is based on three PCOMS studies and six OQ-‐45 studies. While both systems are revealed to improve outcomes in their respective studies, Lambert and Shimokawa also mildly express a few critical views of the PCOMS studies in comparison to the OQ-‐45 studies. However, they proceed to provide further suggestions to support the collection and use of client feedback in therapy, as well as a clinical illustration of how and when the ASC and CST were used in practice. The article is one of few sources that compare the two feedback management systems side by side. However, it provides strong evidence systematic client-‐based feedback in practice and encourages clinicians to consider its implementation. 9 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. (2009). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-‐efficacy. Training and Education in Professional Psychology, 3(3), 157-‐168. doi: 10.1037/a0015673 Form no.: 9 of 10 Keywords: client feedback, clinical supervision, counsellor training Relevance rating: 90 % Annotation: Supervision is a significant element of clinical practice, extending also to those who are in training. Reese, Usher, Bowman, Norsworthy, Halstead, Rowlands, and Chisholm conducted a study that examined the use of client-‐based feedback as a basis for clinical supervision sessions with counselling students, its impact on client outcomes and other areas. Including the supervisory alliance, supervision satisfaction, and the student counsellor’s view of self-‐efficacy. Students were allocated to a feedback or no feedback group and were monitored over the period of an academic year. The feedback group followed the PCOMS framework of utilising the ORS and SRS measures and discussing the collected data from their clients in supervision. Other measures were used to measure the supervisory relationship and counsellor self-‐efficacy. The findings revealed that the students in the feedback group resulted in better outcomes with their clients, compared to the no feedback group. However regarding the supervisory alliance, there was no major difference between the two groups. Lastly, the study also indicates a correlation between self-‐efficacy and outcome, yet only for those in the feedback group. The overall purpose of the study was to explore the use of systematic client-‐based feedback in clinical supervision of student counsellors. The authors describe the study as an exploratory one, highlighting and discussing a number of its limitations such as the sample size, the challenge of ensuring the integrity of the treatment and the different service settings to name a few. Based on the initial findings, it certainly deems to be an area worth investigating further. For one to consider implementing the PCOMS in practice, particularly in a clinical supervision setting, it is important for both counsellor and supervisor to actively believe and be invested in the programme. 10 Fuailelagi Samoa Saleupolu Heger 12103972 Topic: Exploring the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Reference: Shaw, S. L., & Murray, K. W. (2014). Monitoring alliance and outcome with client feedback measures. Journal of Mental Health Counseling, 36(1), 43-‐57. Form no.: 10 of 10 Keywords: therapeutic alliance, treatment outcomes, client feedback, PCOMS Relevance rating: 97 % Annotation: This article provides a basic, yet comprehensive overview of the rationale and research that supports the use of client-‐based feedback to monitor therapeutic progress and alliance. As they review a range of aspects of client-‐based feedback, Shaw and Murray specifically discuss the PCOMS measures, the ORS and SRS to monitor treatment outcomes and the alliance. The authors maintain the benefits of seeking client feedback such as a reduction in the rate of dropouts and improved outcomes. Shaw and Murray write with conviction as they provide a motivating case for using client feedback in clinical practice, supported by compelling evidence. They examine further some of the areas of client feedback including the prediction of positive outcomes, the improvement of outcomes and the alliance, client perceptions of outcome and empathy, and resistance to the use of client feedback that are reflected in various studies. Additionally, the authors provide an illustration of how the ORS and SRS measures are introduced to clients, and how the results may be discussed with them. As the authors discuss the significance and value of the ORS and SRS measures, their key arguments point to the underlying values of providing clients with a voice, and to be led by what clients deem fit for their own recovery. All of which contribute to the strength and quality of the therapeutic alliance, furthering the potential of achieving positive outcomes. However, Shaw and Murray also highlight and discuss some of the limitations of the ORS and SRS. Including the risk of undermining the principle of being client-‐focused and directed, which may occur as a result of a clinician failing to convey belief in the client to achieve change, with the use of the ORS and SRS measures. Overall, the authors promote the ORS and SRS as ultra-‐brief, valid, and practical measures to support and empower clients to achieve their goal/s. 11 Fuailelagi Samoa Saleupolu Heger 12103972 Conclusion A recent cover story of the North and South magazine titled ‘Counselling…cure or con?’ (Chisolm, 2013) discusses the growth of counsellors in Aoteroa New Zealand, shares stories of individual counselling experiences, and the use of client feedback to inform clinical practice. The focus of this annotated bibliography was an exploration of the evidence-‐based practice of the Partners for Change Outcome Management System (PCOMS) and its implication/s for clinical practice where applicable, in Aotearoa New Zealand. Evidence-‐based practice (EBP) is defined by the American Psychological Association as “…the integration of the best available research with the clinical expertise in the context of patient characteristics, culture and character” (2006, p. 273). With this definition, the term ‘evidence-‐based’ seems to carry less of an impression of scientific rigidity and openness to what may be considered practice-‐based evidence. The PCOMS certainly falls into this category. Over the past three to five years, numerous publications has emerged about client feedback, evidence-‐
based practice, therapeutic alliance, and efficacy of counselling and psychotherapy, relating to the PCOMS and other client feedback programmes. This indicates a continuous growth in the application of the PCOMS in counselling and psychotherapy. It has also been a matter of interest to delve further into the arguments presented for and against the ‘common factors theory’. The focus of the annotated bibliography was moderately broad. Further parameters that may have been included to provide a bit more focus include identifying a specific definition or understanding of what evidence-‐based practice meant in the context of the PCOMS. In conclusion, the PCOMS appears to be a relatively recent development, particularly here in Aotearoa New Zealand. The PCOMS is based on a framework that starkly contrasts the conventional approach in counselling and psychotherapy that is often reflective of the medical model of diagnosis and treatment. The PCOMS values include the privileging of the client’s voice, an expectation of recovery, social justice and a partnership guided by clients to facilitate change and support their journey towards wellness. In this annotated bibliography, the consistency of the research reflected across the different sources conveys a significantly strong support for the efficacy of the PCOMS, regarding outcome and alliance. However, equally so is the vast scope for potential research of the PCOMS, in a range of areas mentioned in this annotated bibliography. Including training and development, clinical supervision, and particularly the cultural contextualisation of the ORS and SRS measures. 12 Fuailelagi Samoa Saleupolu Heger 12103972 References American Psychological Association. (2006). Evidence-‐based practice in psychology: APA presidential task force on evidence-‐based practice. American Psychologist, 61(4), 271-‐285. doi: 10.1037/0003-‐066X.61.4.271 Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693-‐704. doi: 10.1037/a0016062 Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-‐Clark, J., Evans, C., . . . McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-‐OM: Toward practice-‐based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69(2), 184-‐196. doi: 10.1037/0022-‐006x.69.2.184 Chisolm, D. (2013). Counselling...cure or con? North & South, 34-‐42. Drury, N. (2007). The kaupapa outcome rating scale. New Zealand Journal of Counselling, 27(1), 21-‐32. Duncan, B. L. (2012). The Partners for Change Outcome Management System (PCOMS): The heart and soul of change project. Canadian Psychology/Psychologie canadienne, 53(2), 93-‐104. doi: 10.1037/a0027762 Duncan, B. L., Miller, S. D., & Sparks, J. A. (2004). The heroic client: A revolutionary way to improve effectiveness through client-‐directed, outcome-‐informed therapy (Rev. ed.). San Fransisco, CA: Jossey-‐Bass. Durie, M. (1998). Whaiora: Maori health development. Auckland: Oxford University Press. Gillaspy, J. R., & Murphy, J. J. (2012). Incorporating outcome and session rating scales in solution-‐
focused brief therapy. In C. Franklin, T. S. Trepper, W. J. Gingerich, & E. E. McCollum (Eds.), Solution-‐focused brief therapy: A handbook of evidence-‐based practice (pp. 73-‐91). New York, NY: Oxford University Press. Green, D., & Latchford, G. (2012). Maximising the benefits of psychotherapy: A practice-‐based evidence approach. Chichester, West Sussex, UK: John Wiley & Sons. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51(10), 1059-‐1064. doi: 10.1037/0003-‐066x.51.10.1059 Janse, P., Boezen-‐Hilberdink, L., van Dijk, M. K., Verbraak, M. M., & Hutschemaekers, G. M. (2014). Measuring feedback from clients: The psychometric properties of the Dutch Outcome Rating Scale and Session Rating Scale. European Journal of Psychological Assessment, 30(2), 86-‐92. doi: 10.1027/10155759/a000172 Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72-‐79. doi: 10.1037/a0022238 McClintock, K., Sokratov, A., Mellsop, G., & Kingi, T. (2013). Hua Oranga: Service utility pilot of a mental health outcome measurement for an indigenous population. The International Indigenous Policy Journal, 4(3). National Registry of Evidence-‐based Programs and Practices. (2013). Intervention summary -‐ Partners for Change Outcome Management System (PCOMS): The heart and soul of change project. from http://www.nrepp.samhsa.gov/ViewIntervention.aspx?id=250 13 Fuailelagi Samoa Saleupolu Heger 12103972 Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. (2009). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-‐efficacy. Training and Education in Professional Psychology, 3(3), 157-‐168. doi: 10.1037/a0015673 Rosenzweig, S. (1936). Some implicit common factors in diverse methods of psychotherapy. American Journal of Orthopsychiatry, 6(3), 412-‐415. Shaw, S. L., & Murray, K. W. (2014). Monitoring alliance and outcome with client feedback measures. Journal of Mental Health Counseling, 36(1), 43-‐57. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, N.J.: Lawerence Erlbaum Associates. 14