Being a professor of counseling I get lots of questions like this: “What do you think of _____ (a new or popular counseling model/intervention)? These days, I’m being asked about coaching models, neurofeedback, EMDR, EFT, brainspotting, the use of SPECT scans, the use of psychiatric medications, nutritional supplements, and the like. In past years, I might have been asked about theophostic ministry, DBT, or ECT.
To be honest, I haven’t read every counseling model to the nth degree. I know a bit about a lot of models and a whole lot about some models. So, I try to be careful not to offer too much critique on what I don’t know first hand. That said, I do think there are good ways to go about evaluating any new model and proponents’ claims of efficacy. Over the next few posts I plan to show you how I try to investigate any new (to me) model:
Step One: Start with Suspicion
What? Shouldn’t we give them a fair shake? Yes, of course. And we will. But first, I do think it is helpful to ask yourself, a few key questions about what you are being sold.
- Who is promoting this model/intervention? What financial benefit are they seeking?
- What claims or promises do they make about their successes? Do they seem reasonable? Overly optimistic?
- What supporting evidence is offered? Anything other than anecdotes from the inner circle of disciples? Any empirical evidence?
- Do supporters distance from everything that has gone on before? How do they connect to mainstream models?
- How transparent are the authors about what is being done?
None of these questions will answer our ultimate question of the value of any new model. There are excellent new models with almost no empirical evidence. Conversely, there are those who connect their intervention to a piece of mainstream research but do so only tangentially (thereby giving the appearance of scientific support but lacking validity and reliability (i.e., much of the change your brain popular models)).
A model that starts in the popular sphere may turn out to be good. Yet, we still want to gather the data about the motives and purpose of the new model. Take coaching for example. There is good evidence that coaching techniques work. However, much of what you find in popular places (bookstores and the Internet) is about someone trying to make a buck, either to coach you or to sell you a certification to become a coach. Thus, it is important to look at “packaging” to see what we are being sold. We may well want to buy the “product” but buyers need to know that sellers don’t usually talk about the weaknesses of their product.
Watch out for those models that over-sell their results, especially in the area of “complete freedom” from suffering. These are almost always unsupported by empirical evidence and certainly do not line up with good theology. We want complete removal of mental pain. This isn’t a bad desire, but it does set us up to buy the “next best thing” without proper critical evaluation. And well-meaning friends may tempt us to try out some new technique because it worked for them.
And yet, we need to be open to the possibility that there is something new on the horizon. Truthful anecdotes still have some merit. And so, tomorrow I will suggest that step two includes “reading with an open mind.”
Musings on Faith and Psychology 