Case and Commentary

May 2008

Do Secret Shoppers Have a Place in Medicine? Commentary 1

James C. Loden, MD
Virtual Mentor. 2008;10(5):288-291. doi: 10.1001/virtualmentor.2008.10.5.ccas5-0805.

Case

The staff at Urban Clinic had gathered for a morning meeting. Jim, the executive director, waited until everyone had coffee and had found a place to sit. Then he began, "Today I want to brief you on a new quality program. We're going to try a mystery shopper technique starting as soon as we can. You've probably heard about how this works in retail stores. I think it could help us improve patient satisfaction and office efficiency.

"What happens is, some trained market researchers will call the office to see how the phone system works and how the staff handles the calls. They'll make appointments and they'll arrive early and observe the staff and the environment. A few of them—pretty good actors I might add—will actually go through with a physician encounter.

"When we get the results from all this, we'll know a lot more about how to improve the quality of our patient experience. Any questions or comments?"

George, one of the internists, said, "It sounds okay Jim, but we're not exactly running a Wal-Mart here, are we?"

"Well, we aren't the first to try this. Massachusetts General has been running a similar quality improvement program for 8 years," said Jim.

"I'm still skeptical; we haven't got the money that some large institutions have, and it doesn't seem totally fair to be so devious," George mused.

Other staffers worried about the additional time it would take and who would be blamed or even fired if the results were bad.

Jim closed the meeting by saying he'd take all the comments into account before they rolled out the final version of the program. "Thanks for your input. Remember, we're in a competitive marketplace. And we owe it to our patients to do our best on all fronts."

Commentary 1

For the last 2 years I have employed "secret shoppers" to evaluate Loden Vision Centers, a Nashville-based practice that employs three ophthalmologists and two optometrists. Sixty percent of the practice revenue comes from insurance and Medicare, and 40 percent, from elective refractive surgery. There are approximately 53 other physicians in the area with whom we compete for clients.

Given this competitive practice environment, we are constantly looking for ways to improve our client-to-client referrals. Many ophthalmology journals discuss marketing and practice growth strategies. One article that particularly caught my attention was about a company that conducted ghost-shopping in medical settings. As founder and managing partner for Loden Vision Centers, I had had suspicions that the staff was not always as mindful about service and other patient satisfaction markers when a supervisor was not present. I questioned whether we—and I include myself in this—were really delivering the high-quality care that I perceived we were. These nagging concerns led me to try a ghost-shopping program. After we were assessed, several deficiencies (and several successes) were identified. In one instance, I thought we were weak in a particular area, but this was not borne out in the evaluation.

Results of Our Experience

There were a couple of areas we learned we could improve on, and at least one where no change was needed.

  1. Directions. More than 50 percent of our secret shoppers reported difficulty or great difficulty finding our offices. Although it is easy for me to get there—I drive to work everyday—we found that many people struggled just to locate the building. In response, we made our maps easier to read, improved Internet directions to the facilities, and posted pictures of the offices on our web site.
  2. Employees don't always perform as trained. Some of my suspicions were validated. The secret shoppers found that employees did not always wear name tags, introduce themselves, explain how or why tests were being performed, or tell clients in the exam room who would be coming in next and the approximate time of the doctor's or technician's return before leaving the room. I learned that I consistently left the exam room without asking clients whether they had any questions.
  3. A few positives. We learned, for example, that we didn't need to upgrade our reception area. We had contemplated a major renovation of this space and it was estimated to cost at least $50,000. Before proceeding with these plans, we asked our secret shoppers for their recommendations. We found that our facility more than met expectations for our type of practice, and no facility upgrades were recommended.

Making the Decision to Use Ghost Shoppers

In our case scenario, we see a confrontation between Jim and George. Jim wishes to improve patient care and the patient experience, but George is skeptical of using secret shoppers to achieve this goal.

I believe that the decision to employ a secret shopper should not be a group decision but one made by the practice manager and senior managing partner who alone should know that secret shopping is going to occur. I would also suggest that the office manager not be told the times and dates of the visit so that a true evaluation of day-to-day operations can be made. It is our experience that when staff are told they are going to be assessed within a certain time frame, they maintain a high level of care for that period and then gradually return to their old habits.

When the results of the secret shopping visits are available, the initial evaluations should be discussed in a staff meeting and presented in a positive light. During this meeting, the areas where improvement is needed should be talked about and corrective steps decided upon. A second round of secret shopping should be performed to see whether the staff has implemented the changes that came about after the initial assessment. Punitive action should not be considered unless there is repeated failure to act in accordance with established performance guidelines.

I do not believe that words such as "devious" and "spying" are accurate in describing secret shopping. Employees, including doctors, are paid to do specific tasks; if they choose to perform at a level that is less than acceptable, they need to improve or find other jobs. It is the responsibility of management to assure a quality client experience—and this experience is affected by all employees, from the one with the lowest salary rank to the most senior partner. In fact, I think it is more devious to allow an underperforming facility to make health care decisions for a client than to use secret shoppers as a quality improvement tool. I side with Jim, who says we owe it to our clients to do our best.

Assessing the Case

The complaints lodged by George are typical of comments made by uninformed, noncompetitive physicians and employees. The fees charged by secret shopping companies are nominal compared to the gross income lost due to poor client experiences. During the entire shopping process, a practice may lose three to five billable patient encounters per physician. This is a miniscule amount of time and it can help you to serve your clients significantly better in the long term. To use time and money as an excuse not to engage in secret shopping is short-sighted behavior.

George's comment that "we're not running a Wal-Mart here, are we?" shows the lack of business acumen that I see in so many of my fellow physicians. No, we aren't and shouldn't be a discount store, but we are a business. If we can't make money, we can't keep the doors open. In these days of declining reimbursement fees, if we want to run a successful medical practice, we must provide better, more efficient care than the physicians we are "competing" against. We must look to the retail industry at times for ideas on how to judge whether doctors and staff alike are delivering the care that clients, partners, and other staff members deserve.

The number of elective surgery procedures I perform has increased by 100 percent since instituting secret shopping because our client-to-client referrals have increased. I credit much of this to the experience of secret shoppers, which helped our office improve client experiences before, during, and after their operative procedures.

For practices and facilities that are not in competition for potential clients, secret shopping still makes ethical and financial sense. Overhead costs are quickly driven up by employees who perform their job inefficiently. In fact, there are times when employees may take histories and perform tests and labs in a way that could adversely affect diagnosis and outcomes. From a physician standpoint, even if you have a line of clients or patients at the door, do you really want a physician partner who is either short and curt with them or inefficiently verbose?

No matter the size or the makeup of your practice, I think you will find the experience of using secret shoppers rewarding and insightful rather than unethical and devious, as many who are uninformed about the practice predict.

Citation

Virtual Mentor. 2008;10(5):288-291.

DOI

10.1001/virtualmentor.2008.10.5.ccas5-0805.

Conflict of Interest Disclosure

Dr. Loden has granted permission to the secret shopper company he employed to post a statement of his satisfaction with, and intent to continue using, their services on their web site. He received and will receive no payment or discounted services for this testimonial.

The people and events in this case are fictional. Resemblance to real events or to names of people, living or dead, is entirely coincidental. The viewpoints expressed on this site are those of the authors and do not necessarily reflect the views and policies of the AMA.