|
?:reviewBody
|
-
Physicians are important players in the health care debate. They've been courted by both supporters and opponents of the Democratic reform plan. President Barack Obama held a Rose Garden ceremony with some of them recently. And now opponents of the Democratic health care plan are citing poll results that supposedly show that lots of doctors would be so unhappy with the reforms that they'd quit their jobs. Fox News Channel political commentator Glenn Beck mentioned this on his Oct. 12, 2009, show during a wide-ranging critique of the Democratic plan. He said that the plan could harm doctors financially and make medical students have doubts about pursuing the profession. Do you really think that you're going to see an increase in medical students? I don't think so, Beck said. Especially consider that the percentage of doctors who say they'll quit if this is passed is only 45 percent. No worries. Ha! You'll be able to find a good doctor. Really, you will. If true, the sudden departure of 45 percent of the nation's doctors would indeed constitute a stinging rejection of the Democratic effort by an influential health care constituency. But that number sounded high to us, so we decided to look into the statistic's origins. It came from a survey of practicing physicians published in mid September. The survey was sponsored by the newspaper Investor's Business Daily and was done by the firm TechnoMetrica Institute of Policy and Politics, or TIPP. The survey was conducted between Aug. 28, 2009, and Sept. 15, 2009. It was mailed to 25,600 physicians nationwide at addresses purchased from a list broker. We found several problems with the poll and the way Beck described its results: • Beck misstated what the poll asked . Beck said that 45 percent of doctors will quit. But in fact, the poll found that 45 percent of doctors said they will consider quitting. Considering quitting isn't the same thing as quitting, which makes Beck's statement a significant exaggeration. In addition, the specific question asked of respondents was, If Congress passes their health care plan, will you ... continue your practice, [or] consider leaving your practice or taking an early retirement? This wording leaves open the possibility that respondents are saying they might simply leave their current practice to join another practice, rather than quit. • The poll had a low response rate . According to the statistics published in IBD , 1,376 practicing physicians responded to the poll, out of the 25,600 solicited nationally. That's a 5.4 percent response rate. In one of its articles about the poll, IBD bills this as a high rate of return, considering how difficult doctors are to get hold of. But another survey of doctors released around the same time managed to do better — much better. That other survey was conducted by Salomeh Keyhani and Alex Federman, internists and researchers at the Mount Sinai School of Medicine in New York City, who published the results in the New England Journal of Medicine . They mailed 5,157 questionnaires and got a response rate that exceeded 43 percent — nearly eight times the IBD survey's rate. In fact, Keyhani and Federman reached almost 50 percent more doctors despite sending out only one-fifth the number of inquiries. (They did not ask doctors if they would consider quitting as the other poll did.) Does a higher response rate matter? In this case, it's hard to know for sure, said Karlyn Bowman, a polling analyst with the conservative American Enterprise Institute. However, she added, higher response rates give me more confidence in results, a point echoed by other experts we interviewed. • The sponsor was listed prominently on the survey, possibly influencing who responded . The survey was sent out on Investor’s Business Daily letterhead, and the introduction said in part, The results of this survey will be on Investor’s Business Daily’s front page and investors.com. A press release will also be prepared. This will give doctors a voice in this key issue. This type of framing matters because IBD 's editorial page is known for its conservative stance, including opposition to the Democratic health care effort. While it’s safe to assume that not everyone who received the survey knew about IBD 's political leanings, some respondents presumably did — and among those who did, such knowledge could have made a difference in determining who responded. Liberals might have been less likely to respond, while conservatives in tune with the IBD editorials would have been more enthusiastic about responding. In such a small sample, even a modest bias of that sort could skew the results. • The wording of questions may have influenced who responded . In an interview, Mark Blumenthal, who blogs at pollster.com and has written critically of the IBD poll, said the wording of the questions could have skewed the results. He noted that, unlike telephone polls, mail polls enable the recipient to skim the entire list of questions before deciding to answer any of them. With the IBD poll, respondents might have thought some of the questions had a subtext that was critical of the Democratic proposal. One was, Do you believe the government can cover 47 million more people and it will cost less money and the quality of care will be better? Another was, If Congress passes their plan, do you expect fewer students to apply to med schools in the future [or] more students to apply to med schools in the future? A third was, Under a government plan, do you think drug companies will have incentives to continue developing as many life saving new drugs? (Grammatical errors in original; full survey text available here .) Collectively, these questions imply that health care reform will mean very bad things for medicine, Blumenthal said. I'm guessing that a proreform doctor would be inclined to ignore, and not return, a survey if the questions seem leading or biased. Could the prominence of the IBD name and the question wording have made a difference? The evidence suggests that may be true. In the IBD poll, 65 percent of the doctors who responded said they opposed government's proposed health care plan while just 33 percent supported it. By contrast, the Keyhani-Federman poll found that 63 percent of doctors surveyed favored giving patients a choice between public and private insurance, as congressional Democrats and President Barack Obama have advocated. Another 10 percent said they favored a single-payer health care system — a solution that is actually to the left of the president. In other words, the results of the two polls are so far apart that they are essentially opposites. The truth may actually lie somewhere in between the two surveys. It's worth noting that the Keyhani-Federman poll received financial support from the Robert Wood Johnson Foundation, which favors health care reform. Also, National Public Radio has said that Keyhani and Federman belong to ... the National Physicians Alliance. It supports a public option, and Keyhani has spoken publicly about her own support for a public option. A campaign finance database search found that both researchers donated to the Obama campaign in 2008 — $500 from Keyhani and $300 from Federman. In addition, the initial postcard Keyhani and Federman sent to doctors included the subheading, Congress wants to hear from doctors on health care reform — advocacy-style language similar to what the IBD poll said. This may have produced some ideological bias in the opposite direction from IBD 's poll. (In an interview, Federman said the reason for choosing the words they did stemmed from what the literature shows about what works to get docs to respond to surveys.) Finally, Don Dillman, an expert in mail-based polls and a professor at Washington State University, suggests another factor that could make the IBD poll results on doctors quitting vastly overstated: People don't usually make decisions about changing careers lightly. If one is trained to be a physician, then are you going to take on another occupation? he asks. This concern is especially relevant for younger physicians, who would likely find few new careers that would earn them enough income to pay off their debts from attending medical school. So, back to Beck's statement. First, he misstated the results of the poll. The survey didn't say 45 percent would quit; it said they would consider quitting, which is considerably different. Moreover, polling experts have raised significant questions about the poll's methodology. Of special concern are the combination of the heavy mention of IBD 's name and questions that experts said appeared to be seeking answers critical of health reform. We'd like to see an independent poll assessing doctors' views of health care reform, but neither the findings from the IBD survey nor those from the Keyhani-Federman study are fully persuasive to us. We rate Beck's statement False.
(en)
|
![[This page as RDF]](http://data.gesis.org/claimskg/static/rdf-icon.gif){kind=icon}