User:Pikkaboo/sandbox

Possible Sources
Satisficing:

http://books.google.com/books?id=ErMMGz1RIUcC&pg=PA436&lpg=PA436&dq=satisficing+jon+krosnick&source=bl&ots=QDK71_GAxf&sig=ICOWkzwfL7sCtjerq94sP3_eZ0I&hl=en&sa=X&ei=HXOlUOajBYrniAKxhIHIBg&ved=0CGoQ6AEwCTgU#v=onepage&q=satisficing%20jon%20krosnick&f=false
 * respondents pick the first satisfactory option and agree because they don't think of assertions offered in questions
 * "Maximizing Questionnaire Quality": respondents not motivated to think about the rating scales, may give the same answer to every rating question

http://lefthandedbiochemist.wordpress.com/2011/11/22/questionnaire-design-some-tips-on-generating-meaningful-data/  <== Questionable credibility

http://regbaker.typepad.com/regs_blog/2011/05/getting-to-the-bottom-of-the-respondent-engagement-problem.html
 * Jon Krosnick introduced the term "satisficing" to describe the tendency for survey respondents to lose interest and become distracted or impatient as they progress through a survey, putting less and less effort into answering questions.

http://www.economist.com/node/13350892 <== Relate to Krosnick's work
 * Herbert Simon (1916-2001) is most famous for what is known to economists as the theory of bounded rationality, a theory about economic decision-making that Simon himself preferred to call “satisficing”, a combination of two words: “satisfy” and “suffice”.

very good source; possibly get in print? ===> http://books.google.com/books?id=0PLNhGk-MlgC&pg=PA32&lpg=PA32&dq=satisficing+krosnick&source=bl&ots=qAJ0EfGPab&sig=lem1af2uPKa9iAU76lsvyL_ge_Y&hl=en&sa=X&ei=tXmlULbiM8SfiQLA9ICYBg&ved=0CGoQ6AEwCQ#v=onepage&q=satisficing%20krosnick&f=false
 * not every respondent goes through all the steps required of each and every question

http://www.factualworld.com/article/Jon_Krosnick
 * Krosnick developed a theory of survey satisficing, proposing that the optimal answer to a question involves cognitive work, and that respondents would use satisficing to ease their burden.

Other:

http://news.bbc.co.uk/2/hi/uk_news/politics/906877.stm

http://articles.cnn.com/2011-12-13/politics/politics_obama-disappointment_1_president-obama-barack-obama-young-voters/2?_s=PM:POLITICS

http://abcnews.go.com/US/PollVault/abc-news-polling-methodology-standards/story?id=145373#.UJxSIzmb-4A

Work
Krosnick's work focuses on the design and methodology of questionnaires and surveys, and he has served as a consultant to the government, academia and industry on these issues. Krosnick was a principal investigator leading the American National Election Studies from 2005 to 2009, along with Arthur Lupia of the University of Michigan. He was a member of the National Election Study Ad Hoc Committee on Survey Mode which compiled a report for the National Election Study Board of Overseers on the pros and cons of moving from face-to-face to telephone interviews. He has also studied the psychology of attitudes and researched how voters make up their minds and how campaigns influence them. He has conducted research into the survey results on American attitudes toward global warming, how negativity in campaigns affects turnout, ballot-order effects, how wording of an amendment matters, and analyzing polls on public perceptions on global warming. He has also been an on-television commentator on election night.

Survey methodology
Krosnick and colleagues compared Internet surveys, telephone surveys and face-to-face (FTF) surveys, and found people providing socially desirable answers more often in telephone surveys than in the other two cases. Face-to-face-survey respondents more enthusiastically responded. Since such interviews are costly, Krosnick piloted a study of providing computers and an Internet connection to a set of randomly sampled people, and inducing them that way to answer survey questions online over a period of time. This method is known to produce samples, after subtracting those who refused to participate after being in the initial sample, reflecting population counts of various groups proportionately.

Opt-in surveys
Krosnick has published studies questioning the use of Internet opt-in surveys. It has been known such surveys did not result in a random sample because participants were a self-selected group. Along with David Yeagar, Krosnick performed an analysis in 2008 and concluded such surveys produced results varying from traditional surveys even after they were statistically adjusted to cancel effects from their non-random nature. In a study in 2009, the same authors found such studies could not be used even to compare how a group's behavior or attitude changed over time, or how their responses to different issues related to one another. In this particular study, Krosnick and Yeagar also made sure that they used the same procedure to weight the raw data demographically in order for their surveys to be equally representative in terms of gender, age, race, etc. They then calculated the average error for the surveys on 13 additional measures of "secondary demographics" and other non-demographic factors. In both these measures, the responses of opt-in Internet surveys differed statistically from those in traditional surveys. The authors used two surveys on the same issue from the U.S. Census Bureau, with one being a traditional poll and the other an Internet opt-in one.

Studies in voter turnout
Among his work in political psychology, Krosnick has studied the psychology behind voter turnouts. In 2008, Krosnick published "Why do people vote? A psychological analysis of the causes of voter turnout," in which he designated several factors that increase and depress voter turnout during elections. Among these factors were age, race, residential mobility, and marital status. It also showed that contrary to popular belief, an increased sense of diversity within communities actually discouraged people from voting. The report also designated the most effective methods that candidates could use to increase voter turnout. Of common campaign practices, Krosnick's study found that canvassing was the most effective way to increase voter turnout, whereas common practices such as phone calls to people's houses seemed to have no effect at all. The study also found that involving people in civic service made them more likely to vote in the coming elections.

Krosnick later traveled to Washington to present studies on voting psychology at the annual meeting of the American Political Science Association. This particular study was conducted by the National Election Study (NES), has been funded by the National Science Foundation for the past 30 years, and involved researchers from Princeton, Northwestern, and the University of Chicago. It spans over a 16-year period and involved more than 5,000 Americans in face-to-face interviews over the course of four elections. The resulting analysis of voter turnout was a part of a larger study that involved NES data from seven presidential elections and more than 25,000 respondents. In the end, these studies revealed a new way of thinking about voter decision-making that, according to Krosnick, was more consistent with psychological theory than reigning theories in political science at the time.

One of the results of the study indicated that higher voter turnouts occurred when one candidate is disliked to the point of being a threat to voters, while the other is perceived as a hero. However, subjects who liked both candidates were not as likely to vote, even if they liked one significantly more than the other. This also holds true for subjects who disliked both candidates because in these cases voters would be happy or unhappy with either outcome. The studies also indicated that mudslinging in political campaigns effectively increased voter turnout, provided that candidates vilified their opponents tastefully without tarnishing their own image. The study also revealed that if people liked or disliked the candidate at the first encounter, their opinion was difficult to change later on. In fact, Krosnick's studies show that people become more resistant to changing their views as they learn more and more about a candidate. At the start of a campaign, most candidates are viewed in a mildly positive light. After presenting their positions, impressions of candidates solidify and information gained earlier in the campaign tends to have a greater impact. Krosnick calls this model the "asymmetrical" model of voting behavior. This suggests that the current marketing strategy for campaigning - saving money for advertising more at the end of a campaign - is completely wrong.

Ballot-order studies
Krosnick and a colleague, analyzing data from an Ohio election closely, concluded the first candidate on a ballot received roughly 2% votes more in half of the races they studied. The effect was stronger in races where the voters had no clear a priori choice. While this effect has been known for more than a century, the study produced statistical evidence, significant especially because it is more common to place names in alphabetical order, at times with the start point varied across districts, than in random order. His testimony to this effect helped unseat a mayor in Compton, California, who had won after illegally placing himself at the top of the ballot. The effect carried over to other areas, with people preferring earlier options to later ones in general. However this preference held only when subjects saw choices shown to them, not when they heard choices read out to them, directly or over the phone. The last item heard was then preferred.

Krosnick and others repeated the study for the 2000 U.S. Presidential elections for Ohio, California and North Dakota and found Bush, but not other candidates, gaining votes when listed first on the ballot as opposed to when listed later. For elections, Krosnick hypothesizes the effect may be from voters, feeling compelled to cast a vote, choosing the first on the list non-randomly. He believes Bush benefited from this effect in the 2000 presidential election in Florida, and that the exit poll of the 2004 U.S. Presidential election was skewed toward the Democratic candidate, John Kerry, because he was listed on the questionnaire first. Krosnick's research resurfaced once again during the 2012 presidential primary when New Hampshire listed Romney third from the bottom of a list of 30 candidates. Romney did win the primary.

Patient Protection and Affordable Care Act
In 2010 and 2012, Krosnick conducted national surveys to explore American's understanding of the Patient Protection and Affordable Care Act, better known as Obamacare. Over 2,600 participants in the survey were asked to answer 18 questions about whether a certain provision was in the bill, and how certain they were of their answer. 0% of the participants answered all the questions correctly, and only 14% answered a majority of questions correctly with high certainty. Besides not knowing about provisions that were in the bill, the participants also had trouble identifying provisions that weren't in the bill at all. For instance, only 17% of survey-takers were confident that the bill did not contain death panels, 11% recognized that there was no provision for illegal immigrants to get free healthcare, and all but 14% thought that the bill required smokers to pay $1000 per year.

Krosnick also went further in his study to discover that the more accurately one understood the bill, the more likely he or she was to be in support of it. In fact, the majority of respondents favored nine of 12 provisions in the legislation. The only three components not supported by the American majority were: "U.S. citizens without health insurance have to pay fines if they don't have specific reasons," "New fees for companies that make drugs," and "New fees for health insurance companies." The research team concluded that if everyone in America knew enough to answer all the questions correctly, the approval rating of Obamacare would rise from 32% to 70%.

Attitude research
Krosnick has investigated in detail how attitudes, in general, are formed and how they relate to responses to surveys. He has modeled the emotional aspect, affect, that influences attitudes in a framework for long-term memory drawn on the computer model of short-term random access memory and longer-term disk storage. Long-term memory is posited to be made of interconnected nodes, and Krosnick models affect as tags attaching to the node for say a political candidate, weighting it and influencing other nodes through connections. The well-informed and politically savvy are expected to have more well-developed network structures of such nodes.

Krosnick has also researched attitude strength, which per him is a subjective element, with one possible measure being the attachment to a topic a respondent expresses in a self-report survey. He showed this form of attitude strength has four disparate dimensions, revealed by the statistical technique of factor analysis. The four dimensions found were polarized and positive or negative intensity (valence) of attitudes, ease of retrieval of the associated memories (accessibility), personal beliefs driving attitudes, and degree of thinking done on the subject.

On the practical issue of how attitudes affect survey results, in line with other studies, Krosnick has looked separately at well-informed subjects aware of political issues and ill-informed or unmotivated respondents. In his research jointly with colleagues he found knowledgeable subjects used different cognitive organized patterns of thought (schemas) and knowledge-churning strategies from the naïve or undermotivated subjects. Non-intuitively, in certain circumstances the experts were easier to prime with specific appeals or political advertisements. The other group tended to generate more evasive answers avoiding the question, especially when the issue was not considered relevant. Some biases arising from this were a tendency to settle on the midpoint of a scale with an odd number of divisions, being more influenced by leading questions, and answering most questions with the same number on a scale, especially toward the end of the survey, a form of satisficing. These combined increased the chance and amount of measurement error for such responders.

Studies in racism
Between 2008 and 2012, Krosnick helped develop surveys with AP Poll to measure sensitive racial views in America. Their surveys revealed that both implicit and explicit racism actually has increased within America since Obama's election in 2008. When tested on explicit anti-black attitudes, 51% of Americans were found to express them compared to the 48% of Americans who expressed them in 2008. On an implicit scale, the number of Americans with anti-black attitudes jumped to 56% from 49%. Many black Americans have also reported on perceived antagonism since Obama has taken office. The events reported on range from police brutality to protest posters against Obama himself that portray him as a lion or a monkey, or lynch him in effigy.

Besides anti-black sentiments, the surveys indicated that there was an additional increase in anti-Hispanic sentiments between 2011 and 2012, when the percentage of non-Hispanic whites who expressed anti-Hispanic attitudes rose from 52% to 57%. The survey revealed that Republicans expressed both more explicit and implicit racial prejudice compared to Democrats. Overall, these results on racial prejudice indicate that Obama could suffer a net loss of 2% of the popular vote against Mitt Romney during the upcoming 2012 elections.

The survey was conducted through online means in which respondents were shown a picture of a black, Hispanic, or white male before a neutral image of a Chinese character. They were then asked to rate their feelings towards the Chinese character. Their feelings about this photo allowed researchers to measure racist feelings even if the respondent did not acknowledge them. Their responses were then analyzed with factors such as respondents' ages, partisan beliefs, and their views on Obama and Romney. Overall, each survey has had a margin of sampling error of approximately 4 percentage points.

Climate change
Krosnick has both conducted surveys and analyzed previous ones on global warming, some as part of his work at Stanford's Woods Institute for the Environment. His survey found, in 2007, that most Americans accepted global warming, but by a two-thirds majority were not convinced significant efforts were needed to stop it. Krosnick's view was that scientists were finding this lack of public concern a problem. Krosnick considered the media providing equal coverage to both sides of the debate, not in proportion to how strongly the views were represented among experts, a prime reason for the public's disbelieving scientists were united on the issue. He has also analyzed a 2006 poll by ABC News, TIME and Stanford, which showed the public has grown more concerned about global warming over the previous decade, with more than two thirds believing in unsettled weather patterns caused by human activity. Krosnick believes not acting now will cost the world more in the future.

Studies in public belief and trust
Starting in 2008, polls began to show decline in the percentage of Americans that believed there was solid evidence for global warming and believed it to be a serious problem, specifically from 80% in 2008 to 75% in late 2009. In response, Krosnick conducted surveys and drew his own conclusions about this supposed dip in public belief.

Krosnick, who has run polls on public attitudes towards global warming since 2006, conducted a 2010 survey among 1000 Americans with the same questions as previous years in addition to new inquiries about recent and relevant controversies. One of which was a controversy in which the email archive of the Climate Research Unit of the University of East Anglia was hacked in 2009. The emails retrieved from the hacking supposedly revealed extensive data manipulation in studies on climate research. Krosnick's surveys revealed that 9% of the 32% of subjects who were aware of this controversy believed that it indicated that climate scientists should not be trusted. There was a subsequent controversy with the fourth report on Climate Change from the IPCC. 54% of the 13% of subjects who knew about this controversy believed it indicated that climate scientists were untrustworthy.

As for the apparent public skepticism among Americans towards global warming, Krosnick believed that the apparent dip wasn't actually a result of decline in public belief in global warming, but the result of the questions on the surveys themselves. For instance, one of the integral questions of the survey conducted by the Pew Research Group was, “From what you’ve read and heard, is there solid evidence that the average temperature on earth has been getting warmer over the past few decades, or not?” Krosnick in particular argued that the question's wording taints its intent and results. The question doesn't ask for one's personal beliefs concerning global warming, but instead asks the respondent about what they've heard or read about global warming instead. Krosnick also critiqued another question used in repeated Gallup surveys: "Thinking about what is said in the news, in your view, is the seriousness of global warming generally exaggerated, generally correct, or generally underestimated?" In response to this question, the amount of respondents who answered with "generally exaggerated" rose from 30% to 48% between 2006 to 2010. However, Krosnick noted that, based on the wording of the question, this increase could be a result of either a change in views on global warming or a change in the media.

Since 2009, Krosnick's findings have diverged from those of other organizations. Currently in 2012, Gallup and Pew polls report the amount of Americans that believe in global warming hovers around 50%, whereas Krosnick's latest poll suggests a percentage of 83%. His poll also indicated that, among believers, the majority reported thinking that fossil fuels and human activities are factors in the phenomenon. Krosnick also asked two questions: "What is the most important problem facing this country today?" and "What will be the most important problem facing the world in the future if nothing is done to stop it?" In the response to the first, respondents ranked the economy first with global warming dead last. For the latter, the results were reversed. His surveys also have indicated that 85% of Americans accept the idea of global warming and endorse steps to address it, even if higher costs are necessary to do so. Krosnick has acknowledged that such high levels of agreement are rare on major questions of foreign policy, but the key division among the public lies in public trust of scientists who study climate change.

+graphs to supplement this section

Advocacy and climate change
In 2012, Krosnick conducted another study based on a recent small dip in public belief in climate change. A national survey revealed that low-income and low education students were more willing to trust a scientist who presented evidence for global warming, until that same scientist began to urge their listeners to pressure their government into greener policies. At that point, viewers immediately became suspicious of that scientist's motives and the science they'd presented by extension.

To come to this conclusion, Krosnick recruited a national sample of 793 Americans and split them into three groups to view three videos: a video of a scientist talking about the science of climate change, that same video with an added appeal to demand action from political representatives, and a video about making meatloaf as a control. After each group viewed their respective video, they filled out a survey on their attitudes toward global warming.

Krosnick discovered that subjects who'd watched the scientist discuss climate change gave them the same results as the group that had watched the video on meatloaf. But the group that had seen the scientist make a political appeal after his discussion trusted the scientist 16% less (from 48% to 32%). Their belief in the scientist's accuracy fell from 47 to 36 percent. Overall trust in all scientists went from 60 to 52 percent. Their belief that government should "do a lot" to stop climate change fell from 62 to 49 percent. Finally, their belief that humans caused climate change fell from 81 to 67 percent.

However, it should be noted that these changes only occurred in a cohort of 548 respondents who either had an income below $50,000 or no more than a high school diploma. Educated or wealthy respondents had no significant reaction.

Climate change and voting
Krosnick has also combined his studies in global warming and voter choice through two studies. The first was based data collected from randomly selected households before and after the 2008 Election. These surveys asked on voter's opinions on McCain and Obama's policies on climate change before the election, and then asked who they voted for after the election process. He then conducted a study based on climate change and the 2010 Congressional Election. The results of both of these studies implied that Democrats who vehemently pursued green goals garnered more votes than Democrats who remained silent, and that Republicans who took "not-green" positions won less than Republicans that stayed silent. The study reflects the growing concern over climate change in America and the ways those concerns affect political elections.

Krosnick also authored a study that revealed a subset of voters that focus in on a single issue that could be compelled to turn out if candidates appeal to them on climate change. Essentially Krosnick argued that, by speaking on climate change, candidates could actually enhance turnout and attract voters, especially in the current political climate, where neither candidate is a clear winner on significant issues.

Academic programs
Among the academic programs Krosnick directs at Stanford are the Political Psychology Research Group, which focuses on the study of public and political issues such as global warming, and the Summer Institute in Political Psychology. The Summer Institute in Political Psychology is a program that began as an annual tradition at Ohio State University in 1991 under the direction of Margaret Hermann. In 2005, it was moved to Stanford's campus. Today the program offers a three week training experience in for up to 60 participants.