Hockey stick controversy: Difference between revisions

[[Image:hockey stick chart ipcc large.jpg|thumb|right|300px|The hockey stick graph as shown in the 2001 IPCC report. This chart shows the data from Mann ''et al.'' 1999. The colored lines are the reconstructed temperatures (based on thermometer readings and [[Dendroclimatology|width of tree rings]]), and the gray shaded region represents estimated error bars.]]

The '''hockey stick controversy''' was a dispute started in 2003 by [[Stephen McIntyre]] and [[Ross McKitrick]]<ref name=MM2003>{{citation

| title=CORRECTIONS TO THE MANN et. al. (1998) PROXY DATA BASE AND NORTHERN HEMISPHERIC AVERAGE TEMPERATURE SERIES

| first1=Stephen | last1=McIntyre

| first2=Ross | last2=McKitrick

| author1-link=Stephen McIntyre

| author2-link=Ross McKitrick

| journal=Energy & Environment

| volume=14 | number = 6 | year=2003

| url=http://www.uoguelph.ca/~rmckitri/research/MM03.pdf <!-- http://climateaudit.org/pdf/mcintyre.mckitrick.2003.pdf seems to be gone -->

| format=PDF

}}</ref> over the reconstructed estimates of [[temperature record of the past 1000 years|Northern Hemisphere mean temperature changes over the past millennium]],<ref>{{cite web | publisher=[[Realclimate]] | title=Hockey Stick | date=2004-11-28 | url=http://www.realclimate.org/index.php?p=16 | accessdate=2007-05-08}}</ref>

especially the particular reconstruction of [[Michael E. Mann]], [[Raymond S. Bradley]] and [[Malcolm K. Hughes]].<ref name=MBH98>{{citation

| title=Global-scale temperature patterns and climate forcing over the past six centuries

| first1=Michael E. | last1=Mann

| first2=Raymond S. | last2=Bradley

| first3=Malcolm K. | last3=Hughes

| author1-link=Michael E. Mann

| author2-link=Raymond S. Bradley

| journal=[[Nature (journal)|Nature]]

| volume=392 | pages=779–787 | year=1998

| url=http://www.caenvirothon.com/Resources/Mann,%20et%20al.%20Global%20scale%20temp%20patterns.pdf

| format=PDF

| doi=10.1038/33859

}}</ref> The authors are frequently referred to by their initials MBH, and this work is often called the MBH98 reconstruction.

The term ''[[Ice hockey stick|hockey stick]]'' was coined by the head of [[National Oceanic and Atmospheric Administration]]'s (NOAA) [[Geophysical Fluid Dynamics Laboratory]], [[Jerry Mahlman]], to describe the pattern, referring to a graph that is relatively flat to 1900, forming the hockey stick's "shaft", followed by a sharp increase, corresponding to the "blade".<ref name="bbc"/>

== Nature of the dispute ==

[[Image:1000 Year Temperature Comparison.png|thumb|right|300px|Reconstructions of [[Northern Hemisphere]] temperatures for the last 1,000 years according to various older articles (bluish lines), newer articles (reddish lines), and instrumental record (black line).]]

A quasi-global instrumental temperature record exists from approximately 1850. However, to construct a millennial-scale record, [[proxy (climate)|proxies]] for temperature are required. Consequently, there are issues concerning the accuracy with which these proxies reflect actual temperature change, their geographical coverage, and the statistical methods used to combine them.

Additionally, the raw data used in the analysis allegedly yielding the hockey stick result has been refused to other researchers seeking to provide peer review reconstruction. Despite repeated requests under the Freedom of Information Act, the data has not been provided by the data repository, the University of East Anglia’s [[Climatic Research Unit]] - an official arm of the government of the [[United Kingdom]]. The unit's director [[Phil Jones (climatologist)|Phil Jones]] resigned in fallout of the [[Climategate]] scandal. Colleagues of Jones have reported the raw data has been "lost" resulting in the Unit's refusal to comply with the law. <ref>[http://www.dailymail.co.uk/news/article-1250872/Climategate-U-turn-Astonishment-scientist-centre-global-warming-email-row-admits-data-organised.html?ITO=1490 Climategate U-turn as scientist at centre of row admits: There has been no global warming since 1995]</ref> According to the [[Times of London]] "[[Graham Smith]], the deputy information commissioner, ruled that by failing to release requested data Jones and his colleagues breached FoI regulations. The affair is now the subject of a review led by [[Sir Muir Russell]], former vice-chancellor of Glasgow University." <ref> [http://www.timesonline.co.uk/tol/news/environment/article7017922.ece I thought of killing myself, says climate scandal professor Phil Jones]</ref>

The political significance of the scientific controversy over the graph centers on its use as part of the evidence for [[anthropogenic global warming]]. The MBH98 reconstruction was prominently featured in the 2001 [[United Nations]] [[Intergovernmental Panel on Climate Change]] (IPCC) [[Third Assessment Report]] (TAR) and as a result has been widely published in the media.

This dispute centered on technical aspects of the methodology and data sets used in creating the MBH98 reconstruction, originally raised by [[Stephen McIntyre]] and [[Ross McKitrick]].<ref name=MM2003 /> Their criticisms were that Mann ''et al.'''s reconstructed millennial temperature graph (the hockey stick) was an artifact of flawed calculations and serious data defects; in turn, MBH replied that these criticisms were spurious.

The dispute eventually led to an investigation at the behest of U.S. Congress by a panel of scientists convened by the [[United States National Research Council|National Research Council]] (NRC) of the [[United States National Academy of Sciences]] (NAS) to consider reconstructions of the last 2000 years in general; in addition, an investigation was performed at the behest of Congressman [[Joe Barton]] by a panel of three statisticians, chaired by [[Edward Wegman]] specifically addressing the MBH work. Both the NRC and Wegman teams issued reports in 2006.

The second graph on the right shows the data from MBH98 and from several other climate reconstructions, subsequent to the 1998 reconstruction. Two of the other temperature reconstructions included on the graph are by Mann and co-authors.

There is an ongoing debate about the details of the temperature record and the means of its reconstruction. The "Hockey stick" graph has a weaker medieval warm period and little ice age from previous "reconstructions", though as the first fully-quantitive reconstruction it has no real precedent; the earlier versions were schematics based on historical and other information. The debate centers on several discussion points:

* How well can past temperatures be reconstructed from the data we have?

* Was the late 20th century the warmest period during the last 1,000 years?

* Was the [[Medieval Warm Period]] that was observed in the North Atlantic region part of a broader global or hemispheric warming?

* Are [[Bristlecone pine|Bristlecone]] and [[Foxtail Pine]] tree rings valid temperature [[Proxy (climate)|proxies]]?

* Without using the Bristlecone and Foxtail proxies in the reconstruction, does a hockey stick even exist?

== Discussion of the MBH reconstruction ==

The hockey stick controversy has to a large extent been focused on Mann and on the MBH98 reconstruction on which he was the lead author. ''Scientific American'' magazine described him as the "Man behind the Hockey Stick," referring to this reconstruction of temperatures. The BBC described the "hockey stick" as a term coined for the chart of temperature variation over the last 1,000 years.<ref name="bbc">{{cite web | publisher=[[BBC]] | title=Climate legacy of 'hockey stick' | url=http://news.bbc.co.uk/1/hi/sci/tech/3569604.stm | date=2004-08-16 | accessdate=2007-05-08}}</ref> The chart (which begins in 1400 AD in the original MBH98, and is extended to 1000 AD then 0 AD subsequently) is relatively flat to 1900, indicating that temperatures were relatively stable for this period of time. The flat part forms the stick's "shaft." After 1900, however, temperatures appear to shoot up, forming the hockey stick's "blade." The combination of the two in the chart suggests a recent sharp rise in temperature caused by human activities. The BBC further stated that "The high-profile publication of the data led to the "hockey stick" being used as a key piece of supporting evidence in the [[IPCC Third Assessment Report|Third Assessment Report]] by the United Nations' [[Intergovernmental Panel on Climate Change]] (IPCC) in 2001."<ref name="bbc"/>

In 2003, [[Stephen McIntyre]] and [[Ross McKitrick]] published "Corrections to the Mann ''et al.'' (1998) Proxy Data Base and Northern Hemisphere Average Temperature Series" in the journal ''[[Energy and Environment]]'' 14(6) 751-772, raising concerns about their ability to reproduce the results of MBH. The [[IPCC Fourth Assessment Report|IPCC AR4]] reports that "Wahl and Ammann (2007) showed that this was a consequence of differences in the way McIntyre and McKitrick (2003) had implemented the method of Mann et al. (1998) and that the original reconstruction could be closely duplicated using the original proxy data." <ref name=ar4-ch6>{{Citation

|contribution-url=http://ipcc-wg1.ucar.edu/wg1/Report/AR4WG1_Print_Ch06.pdf

| contribution=Chapter 6: Paleoclimate

| url=http://ipcc-wg1.ucar.edu/wg1/wg1-report.html

| title=Working Group I: The Physical Basis of Climate Change

| publisher=[[Intergovernmental Panel on Climate Change|IPCC]]

| year=2007

| first1=Keith R.

| last1=Briffa

| first2=Jean-Claude

| last2=Duplessy

| first3=Fortunat

|last3=Joos

| first4=Valérie

| last4=Masson-Delmotte

| editor1-first=Rajendra K.

| editor1-last=Pachauri

| editor1-link=Rajendra Pachauri

| editor2-first=Susan

| editor2-last=Solomon

| editor2-link=Susan Solomon

| editor3-first=Dahe

| editor3-last=Qin

| editor4-first=Martin

| editor4-last=Manning}}</ref> In 2004 Mann, Bradley, and Hughes published a [[corrigendum]] to their 1998 article, correcting a number of mistakes in the online supplementary information that accompanied their article but leaving the actual results unchanged.<ref>[http://www.nature.com/nature/journal/v430/n6995/suppinfo/nature02478.html Supplementary information] for Mann, M. E. ''et al.'' corrigendum: Global-scale temperature patterns and climate forcing over the past six centuries Nature 430, 105(2004) Letters to Nature. http://www.nature.com/nature/journal/v430/n6995/suppinfo/nature02478.html</ref>

[[Hans von Storch]] and colleagues claimed that the method used by Mann ''et al.'' probably underestimates the temperature fluctuations in the past by a factor of two or more.<ref name=vStorch04>{{citation

| first1=Hans | last1=von Storch

| first2=Eduardo | last2=Zorita

| first3=Julie M.| last3=Jones

| first4=Yegor | last4=Dimitriev

| first5=Fidel | last5=González-Rouco

| first6=Simon F. B. | last6=Tett

| author1-link=Hans von Storch

| title=Reconstructing Past Climate from Noisy Data

| journal=[[Science (journal)|Science]]

| volume=306 | issue=5696 | pages=679–682 | year=2004

| doi=10.1126/science.1096109

| url=http://w3g.gkss.de/staff/storch/pdf/vonStorch2004science.pdf

}}</ref> However, this conclusion rests at least in part on the reasonableness of the [[global climate model]] (GCM) simulation used, which has been questioned;<ref>{{cite web | publisher=[[Realclimate]] | title=A Mistake with Repercussions | date=2006-04-27 | url=http://www.realclimate.org/index.php/archives/2006/04/a-correction-with-repercussions/ | accessdate=2007-05-08}}</ref><ref>{{citation

| title=Testing the Fidelity of Methods Used in Proxy-Based Reconstructions of Past Climate

| first1=Michael E. | last1=Mann

| first2=Scott | last2=Rutherford

| first3=Eugene | last3=Wahl

| first4=Caspar | last4=Amman

| author1-link=Michael E. Mann

| journal=[[Journal of Climate]]

| volume=18 | issue=20 | pages=4097–4105| year=2005

| url=http://www.meteo.psu.edu/~mann/shared/articles/MRWA-JClimate05.pdf

| doi=10.1175/JCLI3564.1

}}</ref> Wahl ''et al.'' assert errors in the reconstruction technique that von Storch used.<ref name=Wahl_etal06>{{citation

| first1=Eugene R. | last1=Wahl

| first2=David M. | last2=Ritson

| first3=Caspar M. | last3=Ammann

| title=Comment on "Reconstructing Past Climate from Noisy Data"

| journal=[[Science (journal)|Science]] | year=2006

| volume=312 | issue=5773 | pages=529

| doi=10.1126/science.1120866

| url=http://w3g.gkss.de/staff/storch/pdf/wahl_060428.pdf

}}</ref> Von Storch's claim implied that MBH98 was less accurate because if there was more variability than originally shown, then Mann's "hockey stick" would look less like a hockey stick and therefore be weaker argument for recent dramatic climate change.

The IPCC AR4 reports that ''the extent of any such biases in specific reconstructions... is uncertain ... It is very unlikely, however, that any bias would be as large as the factor of two suggested''.

Anders Moberg and his Swedish and Russian collaborators have also generated reconstructions with significantly more variability than the reconstructions of Mann ''et al.''<ref name=Mobergetal05>{{citation

| first1=Anders | last1=Moberg

| first2=Dmitry M. | last2=Sonechkin

| first3=Wibjörn | last3=Karlén

| title=Highly variable Northern Hemisphere temperatures reconstructed from low- and high-resolution proxy data

| journal=[[Nature (journal)|Nature]] | year=2005

| volume=433 | pages=612–617

| doi=10.1038/nature03265

| url=http://www.nature.com/nature/journal/v433/n7026/pdf/nature03265.pdf

}}</ref><ref>{{cite web | title=Moberg et al.: Highly variable Northern Hemisphere temperatures? | first=William M. | last=Connolley | authorlink=William Connolley | publisher=[[Realclimate]] | date=2005-02-15 | accessdate=2007-05-08 | url=http://www.realclimate.org/index.php?p=122}}</ref>

After testing the work of Mann ''et al.'' (1998), McKitrick commented

:"The Mann multiproxy data, when correctly handled, shows the 20th century climate to be unexceptional compared to earlier centuries. This result is fully in line with the borehole evidence. (As an aside, it also turns out to be in line with other studies that are sometimes trotted out in support of the hockey stick, but which, on close inspection, actually imply a [[Medieval Warm Period|MWP]] as well.)"<ref name = "what-about">{{PDFlink|[http://www.uoguelph.ca/~rmckitri/research/McKitrick-hockeystick.pdf What is the 'Hockey stick' debate about?, by Ross McKitrick']|0.5&nbsp;[[Mebibyte|MiB]] ([http://www.webcitation.org/5lgOiAGz9 Archived 2009-12-01])<!-- application/pdf, 493406 bytes -->}}</ref>

In turn, Mann (supported by [[Tim Osborn]], [[Keith Briffa]] and [[Phil Jones (climatologist)|Phil Jones]] of the [[Climatic Research Unit]]) has disputed the claims made by McIntyre and McKitrick,<ref>http://holocene.meteo.psu.edu/Mann/EEReply.html</ref><ref name=MBH03a>{{citation

| title=Note on paper by McIntyre and McKitrick in Energy and Environment

| first1=Michael E. | last1=Mann

| first2=Raymond S. | last2=Bradley

| first3=Malcolm K. | last3=Hughes

| author1-link=Michael E. Mann

| author2-link=Raymond S. Bradley

| year=2003

| url=http://holocene.meteo.psu.edu/Mann/EandEPaperProblem.pdf

}}</ref> saying the

:"...so-called 'correction' was nothing more than a botched application of the MBH98 procedure, where the authors (MM) removed 80% of the proxy data actually used by MBH98 during the 15th century period... Indeed, the bizarre resulting claim by MM of anomalous 15th century warmth (which falls within the heart of the "Little Ice Age") is at odds with not only the MBH98 reconstruction, but, in fact the roughly dozen other estimates now published that agree with MBH98 within estimated uncertainties...".<ref>[http://www.realclimate.org/index.php/archives/2005/01/peer-review-ii/ Michael Mann and Gavin Schmidt on peer reviewing]</ref>

On February 12, 2005, Stephen McIntyre and Ross McKitrick published a paper in ''[[Geophysical Research Letters]]'' that claimed various errors in the methodology of Mann ''et al.'' (1998). The paper claimed that the "Hockey Stick" shape was the result of an invalid [[principal component analysis|principal component]] method.<ref name=MM05a>{{citation

| title=Hockey sticks, principal components, and spurious significance

| first1=Stephen | last1=McIntyre

| first2=Ross | last2=McKitrick

| author1-link=Stephen McIntyre

| author2-link=Ross McKitrick

| journal=[[Geophysical Research Letters]]

| volume=32 | year=2005

| url=http://www.climateaudit.org/pdf/mcintyre.grl.2005.pdf

| doi=10.1029/2004GL021750

| format=PDF

| pages=L03710

}}</ref> They claimed that using the same steps as Mann ''et al.'', they were able to obtain a hockey stick shape as the first principal component in 99 percent of cases (counting both upwards and downwards-pointing "blades") even if simulated [[red noise]] without any inherent trends was used as input.<ref>{{cite web | first=Steven | last=McIntyre | authorlink=Stephen McIntyre | coauthors=[[Ross McKitrick]] | title=The M&M Project: Replication Analysis of the Mann et al. Hockey Stick | accessdate=2007-05-08 | url=http://www.uoguelph.ca/~rmckitri/research/trc.html }}</ref>

This paper was nominated as a journal highlight by the [[American Geophysical Union]],<ref>[http://www.agu.org/sci_soc/prrl/jh050309.html AGU Journal Highlights 9 March 2005<!-- Bot generated title -->]</ref> which publishes GRL, and attracted international attention for its claims to expose flaws in the reconstructions of past climate.<ref>[http://online.wsj.com/public/article/SB110834031507653590-DUadAZBzxH0SiuYH3tOdgUmKXPo_20060207.html?mod=blogs Wall Street Journal blog]</ref> The IPCC AR4 says this paper ''may have some theoretical foundation, but Wahl and Amman (2006) also show that the impact on the amplitude of the final reconstruction is very small''.<ref name=ar4-ch6 />

Mann has been personally involved in the debate over climate change. In testimony before the [[United States Senate|U.S. Senate]] in 2003, he stated:

:"It is the consensus of the climate research community that the anomalous warmth of the late 20th century cannot be explained by natural factors, but instead indicates significant anthropogenic, that is human influences... More than a dozen independent research groups have now reconstructed the average temperature of the northern hemisphere in past centuries... The proxy reconstructions, taking into account these uncertainties, indicate that the warming of the northern hemisphere during the late 20th century... is unprecedented over at least the past millennium and it now appears based on peer-reviewed research, probably the past two millennia."

More recently, the National Academy of Sciences considered the matter. On June 22, 2006, the Academy released a pre-publication version of its report Report-Surface Temperature Reconstructions for the Last 2,000 Years,[27] supporting Mann's more general assertion regarding the last decades of the Twentieth Century, but showing less confidence in his assertions regarding individual decades or years, due to the greater uncertainty at that level of precision.

:"The basic conclusion of Mann et al. (1998, 1999) was that the late 20th century warmth in the Northern Hemisphere was unprecedented during at least the last 1,000 years. This conclusion has subsequently been supported by an array of evidence that includes ...<br />&nbsp;&nbsp;&nbsp;&nbsp;Based on the analyses presented in the original papers by Mann et al. and this newer supporting evidence, the committee finds it plausible that the Northern Hemisphere was warmer during the last few decades of the 20th century than during any comparable period over the preceding millennium. The substantial uncertainties currently present in the quantitative assessment of large-scale surface temperature changes prior to about A.D. 1600 lower our confidence in this conclusion compared to the high level of confidence we place in the Little Ice Age cooling and 20th century warming. Even less confidence can be placed in the original conclusions by Mann et al. (1999) that "the 1990s are likely the warmest decade, and 1998 the warmest year, in at least a millennium" because the uncertainties inherent in temperature reconstructions for individual years and decades are larger than those for longer time periods, and because not all of the available proxies record temperature information on such short timescales." [28]

One point of contention relates to McIntyre's requests for Mann to provide him with the [[Data sharing|data]], methods and source code McIntyre needed to audit MBH98.<ref>[http://www.climateaudit.org/?p=116 "Mann on Source Code" by Stephen McIntyre]</ref> Mann provided some data and then stopped. After a long process - in which the [[National Science Foundation]] supported Mann - the code was made publicly available <ref>[http://www.climateaudit.org/?p=266 "Title to MBH98 Source Code" by Stephen McIntyre]</ref>. It happened because Congress investigated after an article in the ''Wall Street Journal'' <ref name=autogenerated1>[http://republicans.energycommerce.house.gov/108/Letters/062305_Mann.pdf "Letter from Congress to Dr. Mann dated June 23, 2005"]</ref> detailed criticisms raised by McIntyre.<ref>{{cite web|url=http://online.wsj.com/public/article/SB110834031507653590-DUadAZBzxH0SiuYH3tOdgUmKXPo_20060207.html?mod=blogs|title=In Climate Debate, the 'Hockey Stick' Leads to a Face-Off|accessdate=2007-04-29}}</ref> Congress was especially concerned about Mann’s reported refusal to provide data. In June 2005, Congress asked Mann to testify before a special subcommittee. The chairman of the committee ([[Joe Barton]], a prominent global warming denialist) wrote a letter to Mann requesting he provide his data, including his source code, archives of all data for all of Mann's scientific publications, identities of his present and past scientific collaborators, and details of all funding for any of Mann's ongoing or prior research, including all of the supporting forms and agreements.<ref name=autogenerated1 /> The [[American Association for the Advancement of Science]] viewed this as "a search for some basis on which to discredit these particular scientists and findings, rather than a search for understanding."<ref>[http://www.aaas.org/news/releases/2005/0714letter.pdf Dear Mr<!-- Bot generated title -->]</ref> When Mann complied, all of the data was available for McIntyre. Congress also requested that third party science panels review the criticisms by McIntyre and McKitrick. The Wegman Panel <ref>[http://republicans.energycommerce.house.gov/108/home/07142006_Wegman_Report.pdf "The Wegman Report"]</ref> and the National Academy of Sciences <ref>"Surface Temperature Reconstructions for the last 2,000 years" by National Academy of Science [http://books.nap.edu/catalog.php?record_id=11676#toc]</ref> both published reports. McIntyre and McKitrick (2005) claim that 7 of their 10 findings in 2003 have been largely confirmed by these reviews.<ref>[http://www.climateaudit.org/index.php?p=22 "A Scorecard on MM03" by McIntyre and McKitrick]</ref> ''Nature'' reported it as "Academy affirms hockey-stick graph - But it criticizes the way the controversial climate result was used." <ref>[http://www.nature.com/nature/journal/v441/n7097/full/4411032a.html Academy affirms hockey-stick graph.]</ref>

== National Research Council Report ==

At the request of the U.S. Congress, a special "Committee on Surface Temperature Reconstructions for the Past 2,000 Years" was assembled by the [[United States National Research Council|National Research Council's]] Board on Atmospheric Sciences and Climate. The Committee consisted of 12 scientists from different disciplines and was tasked with explaining the current scientific information on the temperature record for the past two millennia, and identifying the main areas of uncertainty, the principal methodologies used, any problems with these approaches, and how central the debate is to the state of scientific knowledge on global climate change.

The panel published its report in 2006.<ref name="nasreport">Committee on Surface Temperature Reconstructions for the Past 2,000 Years. [http://books.nap.edu/openbook.php?record_id=11676&page=R1 ''Surface Temperature Reconstructions for the Past 2,000 Years'']. The National Academies Press, Washington, D.C. 2006.</ref> The report agreed that there were statistical shortcomings in the MBH analysis, but concluded that they were small in effect. The report summarizes its main findings as follows:<ref>[http://fermat.nap.edu/books/0309102251/html/2.html Surface Temperature Reconstructions for the Last 2,000 Years<!-- Bot generated title -->]</ref>

* The instrumentally measured warming of about 0.6&nbsp;°C (1.1&nbsp;°F) during the 20th century is also reflected in borehole temperature measurements, the retreat of glaciers, and other observational evidence, and can be simulated with climate models.

* Large-scale surface temperature reconstructions yield a generally consistent picture of temperature trends during the preceding millennium, including relatively warm conditions centered around A.D. 1000 (identified by some as the “[[Medieval Warm Period]]”) and a relatively cold period (or “[[Little Ice Age]]”) centered around 1700. The existence and extent of a Little Ice Age from roughly 1500 to 1850 is supported by a wide variety of evidence including ice cores, tree rings, borehole temperatures, glacier length records, and historical documents. Evidence for regional warmth during medieval times can be found in a diverse but more limited set of records including ice cores, tree rings, marine sediments, and historical sources from Europe and Asia, but the exact timing and duration of warm periods may have varied from region to region, and the magnitude and geographic extent of the warmth are uncertain.

* It can be said with a high level of confidence that global mean surface temperature was higher during the last few decades of the 20th century than during any comparable period during the preceding four centuries. This statement is justified by the consistency of the evidence from a wide variety of geographically diverse proxies.

* Less confidence can be placed in large-scale surface temperature reconstructions for the period from A.D. 900 to 1600. Presently available proxy evidence indicates that temperatures at many, but not all, individual locations were higher during the past 25 years than during any period of comparable length since A.D. 900. The uncertainties associated with reconstructing hemispheric mean or global mean temperatures from these data increase substantially backward in time through this period and are not yet fully quantified.

* Very little confidence can be assigned to statements concerning the hemispheric mean or global mean surface temperature prior to about A.D. 900 because of sparse data coverage and because the uncertainties associated with proxy data and the methods used to analyze and combine them are larger than during more recent time periods.

In response, a group-authored post on [[RealClimate]], of which Mann is one of the contributors, stated, "the panel has found reason to support the key mainstream findings of past research, including points that we have highlighted previously."<ref>[http://www.realclimate.org/index.php/archives/2006/06/national-academies-synthesis-report/ RealClimate<!-- Bot generated title -->]</ref> Similarly, according to [[Roger A. Pielke (Jr)|Roger A. Pielke, Jr.]], the National Research Council publication constituted a "near-complete vindication for the work of Mann ''et al.''";<ref>R. Pielke Jr.: [http://sciencepolicy.colorado.edu/prometheus/archives/climate_change/000859quick_reaction_to_th.html Quick Reaction to the NRC Hockey Stick Report], ''Prometheus'' 22 June 2006</ref> ''[[Nature (journal)|Nature]]'' reported it as "Academy affirms hockey-stick graph."<ref> [http://www.nature.com/nature/journal/v441/n7097/full/4411032a.html Academy affirms hockey-stick graph] (paid archive); ''Nature'' Volume 441 Number 7097 p. 1032, 28 June 2006. {{doi|10.1038/4411032a}}</ref>

According to [[Hans von Storch]], [[Eduardo Zorita]]<ref>http://w3g.gkss.de/staff/zorita/</ref> and [[Jesus Rouco]],<ref>[http://chubasco.fis.ucm.es/~fi/right.htm Jesus Fidel Gonzalez Rouco Home Page<!-- Bot generated title -->]</ref> reviewing the NAS report on McIntyre's blog [[Climate Audit]], "With respect to methods, the committee is showing reservations concerning the methodology of Mann ''et al.'' The committee notes explicitly on pages 91 and 111 that the method has no validation (CE) skill significantly different from zero. In the past, however, it has always been claimed that the method has a significant nonzero validation skill. Methods without a validation skill are usually considered useless."<ref>Hans von Storch, Eduardo Zorita, Fidel González-Rouco: [http://meteo.lcd.lu/globalwarming/von_Storch/pressrelease_vonStorch_NAS_report.html Press release and comment on the NAS report "Surface Temperature Reconstructions for the last 200 Years"]; 22 June 2006</ref> It was noted by their critics, however, that no such statement, explicit or implicit, is present on the two pages cited<ref>[http://orsted.nap.edu/openbook.php?page=91&record_id=11676 91] and [http://orsted.nap.edu/openbook.php?page=111&record_id=11676 111]</ref>; the closest the report comes being a statement that "Some recent results reported in Table 1S of Wahl and Ammann (in press) indicate that their reconstruction, which uses the same procedure and full set of proxies used by Mann ''et al.'' (1999), gives CE values ranging from 0.103 to -0.215, depending on how far back in time the reconstruction is carried."<ref>[http://orsted.nap.edu/openbook.php?page=95&record_id=11676 page 95]</ref>

However, CE is not the only measure of skill; Mann ''et al.'' (1998) used the more traditional "RE" score, which, unlike CE, accounts for the fact that time series change their mean value over time. The statistically significant reconstruction skill in the Mann et al. reconstruction is independently supported in the peer-reviewed literature.<ref> [http://web.mit.edu/~phuybers/www/Hockey/Huybers_Comment.pdf Huybers (2005)]</ref><ref> [http://www.cgd.ucar.edu/ccr/ammann/millennium/refs/WahlAmmann_ClimChange2006.html Wahl and Ammann (2006)]</ref>

== Committee on Energy and Commerce Report (Wegman report) ==

In 2006 a team of statisticians led by [[Edward Wegman]], chair of the National Academy of Sciences’ (NAS) Committee on Applied and Theoretical Statistics, was assembled at the request of [[Joe Barton|U.S. Rep. Joe Barton]] and [[Ed Whitfield|U.S. Rep. Ed Whitfield]].<ref>[http://blogs.chron.com/sciguy/archives/2006/07/the_climate_cha.html Blog by Eric Berger]</ref> The report primarily focused on the statistical analysis used in the MBH paper, and also considered the personal and professional relationships between Mann ''et al.'' and other members of the paleoclimate community. Findings presented in this report (commonly known as the "Wegman Report"<ref name="wegmanreport">[http://www.uoguelph.ca/~rmckitri/research/WegmanReport.pdf full report]</ref><ref>[http://republicans.energycommerce.house.gov/108/home/07142006_Wegman_fact_sheet.pdf fact-sheet]</ref>) at a hearing of the subcommittee on oversight and investigations, chaired by Whitfield, included the following:

* MBH98 and MBH99 were found to be "somewhat obscure and incomplete" and the criticisms by McIntyre and McKitrick were found to be "valid and compelling."

* The report claimed that the MBH method creates a hockey-stick shape even when supplied with random input data (Figure 4.4), and argues that the MBH method uses weather station data from 1902 to 1995 as a basis for calibrating other input data. "It is not clear that Dr. Mann and his associates even realized that their methodology was faulty at the time of writing the MBH paper. The net effect of the decentering is to preferentially choose the so-called hockey stick shapes." (Section 4)

* The report found that MBH method creates a PC1 statistic dominated by bristlecone and foxtail pine tree ring series (closely related species). However there is evidence in the literature, that the use of the bristlecone pine series as a temperature proxy may not be valid (suppressing "warm period" in the hockey stick handle); and that bristlecones do exhibit CO₂-fertilized growth over the last 150 years (enhancing warming in the hockey stick blade).

* It is noted that there is no evidence that Mann or any of the other authors in paleoclimatology studies have had significant interactions with mainstream statisticians.

* A social network of authorships in temperature reconstruction is described of at least 43 authors with direct ties to Mann by virtue of having coauthored papers with him. The findings from this analysis suggest that authors in the area of paleoclimate studies are closely connected and thus ‘independent studies’ may not be as independent as they might appear on the surface. Dr. Wegman stated this was a "hypothesis", and "should be taken with a grain of salt."<ref name=transcript> [http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=109_house_hearings&docid=f:31362.wais subcommittee transcript of hearing]</ref>

* Many of the same proxies are reused in most of the "independent studies" so these "cannot really claim to be independent verifications."<ref>[http://www.uoguelph.ca/~rmckitri/research/WegmanReport.pdf Wegman Report, figure 5.8 and discussion]</ref>

* It is important to note the isolation of the paleoclimate community; even though its members rely heavily on statistical methods they do not seem to interact with the statistical community. Additionally, the Wegman team judged that the sharing of research materials, data, and results was done haphazardly and begrudgingly.

* Overall, the committee believes that Mann’s assessments, that the decade of the 1990s was the hottest decade of the millennium and that 1998 was the hottest year of the millennium, cannot be supported by his analysis.

The Wegman report has itself been criticized on several grounds:

* The report was not subject to formal [[peer review]] by paleoclimatologists.<ref name="northinterview">{{cite web|url=http://chronicle.com/live/2006/09/hockey_stick/|title=A Scientific Graph Stands Trial|archiveurl=http://web.archive.org/web/20070930190824/http://chronicle.com/live/2006/09/hockey_stick/|archivedate=2007-09-30|publisher=[[The Chronicle of Higher Education]]}}</ref><ref>[http://www.tcsdaily.com/article.aspx?id=072606G Duane D. Freese]</ref> At the hearing, Wegman listed 6 people that participated in his own informal peer review process via email after the report was finalized and said they had no objection to the subcommittee submitting it.<ref name=transcript/>

* The result of fixing some of the alleged errors in the overall reconstruction does not change the general shape of the most recent part of the reconstruction.<ref name="rcweg1">[http://www.realclimate.org/index.php/archives/2006/07/the-missing-piece-at-the-wegman-hearing/ The missing piece at the Wegman hearing]</ref>

* Similarly, studies that use completely different methodologies also yield very similar reconstructions<ref name="rcweg1"/>.

* The social network analysis is not based on meaningful criteria, does not prove a conflict of interest and did not apply at the time of the 1998 and 1999 publications. Such a network of co-authorship is not unusual in narrowly defined areas of science.<ref>[http://crookedtimber.org/2006/07/15/adventures-in-social-network-analysis Adventures in social network analysis]</ref> During the hearing, Wegman defined the social network as peer reviewers that had "actively collaborated with him in writing research papers" and answered that none of his peer reviewers had.<ref name=transcript/>

* [[Gerald North]], chairman of the National Research Council panel that studied the hockey-stick issue and produced the report ''Surface Temperature Reconstructions for the Last 2,000 Years'', stated the politicians at the hearing at which the Wegman report was presented "were twisting the scientific information for their own propaganda purposes. The hearing was not an information gathering operation, but rather a spin machine."<ref name="northinterview"/> In testimony when asked if he disputed the methodology conclusions of Wegman's report, he stated that "No, we don’t. We don’t disagree with their criticism. In fact, pretty much the same thing is said in our report. But again, just because the claims are made, doesn’t mean they are false."<ref name=transcript/>

* Mann has himself said that the report "uncritically parrots claims by two Canadians (an economist and a mineral-exploration consultant) that have already been refuted by several papers in the peer-reviewed literature inexplicably neglected by Barton's 'panel'. These claims were specifically dismissed by the National Academy in their report just weeks ago."<ref>[http://www.realclimate.org/index.php/archives/2006/07/the-discovery-of-global-warming-update/#comment-15618 ‘The Discovery of Global Warming’ update]</ref>

== Updates ==

In a letter to ''[[Nature (journal)|Nature]]'' on August 10, 2006, Bradley, Hughes and Mann pointed at the original title of their 1998 article: "''Northern Hemisphere temperatures during the past millennium: inferences, uncertainties, and limitations''"<ref>Geophys. Res. Lett. 26, 759–762; 1999</ref><ref>{{Citation | url=http://www.nature.com/doifinder/10.1038/442627b | title=Authors were clear about hockey-stick uncertainties | first1=Raymond S. | last1=Bradley | first2=Malcolm K. | last2=Hughes | first3=Michael E. | last3=Mann | author1-link=Raymond S. Bradley | author3-link=Michael E. Mann |publisher=[[Nature (journal)|Nature]] | volume=442 | issue=7103 | pages=627 | year=2006 | doi=10.1038/442627b | journal=Nature }}</ref> and pointed out "more widespread high-resolution data are needed before more confident conclusions can be reached'' and that the uncertainties were ''the point of the article."

Mann and his colleagues said that it was "hard to imagine how much more explicit" they could have been about the uncertainties surrounding their work and blaming "poor communication by others" for the "subsequent confusion." He has further suggested that the criticisms directed at his statistical methodology are purely political and add nothing new to the scientific debate.<ref>[http://news.mongabay.com/2006/0716-climate.html War of words over new climate change report, 'hockey stick' model<!-- Bot generated title -->]</ref>

Paleoclimate findings by the IPCC before and after the Hockey Stick Controversy:

Before: 2001 (page 2)<ref>http://www.ipcc.ch/pub/spm22-01.pdf</ref>

:" proxy data for the Northern Hemisphere indicate that the increase in temperature in the 20th century is likely to have been the largest of any century during the past 1,000 years. It is also likely that, in the Northern Hemisphere, the 1990s was the warmest decade and 1998 the warmest year."

After:

Current SPM statement from 2007 (page 10)<ref>[http://ipcc-wg1.ucar.edu/wg1/docs/WG1AR4_SPM_Approved_05Feb.pdf IPCC Summary for Policymakers]</ref>

:"“Average Northern Hemisphere temperatures during the second half of the 20th century were very likely higher than during any other 50-year period in the last 500 years and likely the highest in at least the past 1300 years. Some recent studies indicate greater variability in Northern Hemisphere temperatures than suggested in the TAR, particularly finding that cooler periods existed in the 12 to 14th, 17th, and 19th centuries. Warmer periods prior to the 20th century are within the uncertainty range given in the TAR.”

In May 2007, [[Hans von Storch]] reviewed the changes in thought caused by the hockey stick controversy writing:

:''In October 2004 we were lucky to publish in Science our critique of the ‘hockey-stick’ reconstruction of the temperature of the last 1000 years. Now, two and half years later, it may be worth reviewing what has happened since then.''

:''At the EGU General Assembly a few weeks ago there were no less than three papers from groups in Copenhagen and Bern assessing critically the merits of methods used to reconstruct historical climate variable from proxies; Bürger’s papers in 2005; Moberg’s paper in Nature in 2005; various papers on borehole temperature; The National Academy of Science Report from 2006 – all of which have helped to clarify that the hockey-stick methodologies lead indeed to questionable historical reconstructions. The 4th Assessment Report of the IPCC now presents a whole range of historical reconstructions instead of favoring prematurely just one hypothesis as reliable.''<ref>[http://blogs.nature.com/climatefeedback/2007/05/the_decay_of_the_hockey_stick.html Hans von Storch and Eduardo Zorita on the Hocky stick effect]</ref>

McIntyre was critical of this ''Nature'' blog entry because von Storch did not acknowledge the role of McIntyre and McKitrick:

:''They then proceed to discuss various articles on the Hockey Stick mentioning Bürger, Moberg, borehole papers, the NAS report, but failing to mention McIntyre and McKitrick. Pretty annoying.''<ref>[http://www.climateaudit.org/?p=1518 Climate Audit - by Steve McIntyre » von Storch and Zorita blog on the Hockey Stick<!-- Bot generated title -->]</ref>

However von Storch replied<ref>[http://blogs.nature.com/climatefeedback/2007/05/the_decay_of_the_hockey_stick.html#comment-86863 Hans von Storch]</ref> that:

:''This was on purpose, as we do not think that McIntyre has substantially contributed in the published peer-reviewed literature to the debate about the statistical merits of the MBH and related method. They have published one peer-reviewed article on a statistical aspect, and we have published a response – acknowledging that they would have a valid point in principle, but the critique would not matter in the case of the hockey-stick ... we see in principle two scientific inputs of McIntyre into the general debate – one valid point, which is however probably not relevant in this context, and another which has not been properly documented''.

As a lot of claims regarding the hockey stick revolve around statistical aspects, the [[American Statistical Association]] held a session<ref>[http://www.amstat.org/meetings/jsm/2006/OnlineProgram/index.cfm?fuseaction=activity_details&activityid=354&sessionid=201322 2006 [[Joint Statistical Meetings]] online program]</ref> at the 2006 [[Joint Statistical Meetings]], on climate change with [[Edward Wegman]], [[John Michael Wallace]], and Richard L. Smith<ref>[http://www.stat.unc.edu/faculty/rsmith.html Richard L. Smith]</ref>. E. Wegman presented the discussion of the methodological aspects of PC analysis by MBH98, and his view that ''Method Wrong + Answer Correct = Bad Science''. J. M. Wallace outlined the NRC report and its cautious conclusion that the claims of unprecedented temperatures in the last decades can be considered as plausible (2:1 odds in favor). R. L. Smith (U. of North Carolina, Statistics) analyzed statistical methodology behind the [[Climate Change Science Program|CCSP]] "Report on Temperature Trends in the Lower Atmosphere”<ref>[http://www.climatescience.gov/Library/sap/sap1-1/finalreport/default.htm Temperature Trends in the Lower Atmosphere: Steps for Understanding and Reconciling Differences. Thomas R. Karl, Susan J. Hassol, Christopher D. Miller, and William L. Murray, editors, 2006. A Report by the Climate Change Science Program and the Subcommittee on Global Change Research, Washington, DC.]</ref> and shared his vision of the role of statisticians in the process. The session was summarized by R. L. Smith in ASA Section on Statistics and the Environment newsletter<ref>[http://www.amstat-online.org/sections/envr/ssenews/ENVR_9_1.pdf ASA Section on Statistics and the Environment Newsletter, Spring 2007]</ref>.

In a paper on 9 September 2008, Mann and colleagues published an updated reconstruction of Earth surface temperature for the past two millennia.<ref name=mann08>{{cite journal | last=Mann | first=M.E. | coauthors=Zhang, Z., Hughes, M.K., Bradley, R.S., Miller, S.K., Rutherford, S. and Ni, F. | year=2008 | title=Proxy-based reconstructions of hemispheric and global surface temperature variations over the past two millennia | journal=[[Proceedings of the National Academy of Sciences|PNAS]] | volume=105 | pages=132520–13257 | doi=10.1073/pnas.0805721105 }}</ref> This reconstruction used a more diverse dataset that was significantly larger than the original tree-ring study. In this work, they again claimed that recent increases in northern hemisphere surface temperature are anomalous relative to at least the past 1300 years, and that this result is robust to the inclusion or exclusion of the tree-ring dataset. In a PNAS response <ref name=PNASMM>[http://www.pnas.org/content/106/6/E10.full Proxy inconsistency and other problems in millennial paleoclimate reconstructions. Stephen McIntyre and Ross McKitrick]</ref>, McIntyre and McKitrick point out a number of perceived problems, including that Mann et al. used some data with the axes upside down.<ref name=PNASMM/> Mann et al. in reply assert that McIntyre and McKitrick "raise no valid issues regarding our paper" and the "claim that “upside down” data were used is bizarre".<ref>{{cite journal |title=Reply to McIntyre and McKitrick: Proxy-based temperature reconstructions are robust |first1=M.E. |last1=Mann |first2=R.S. |last2=Bradley |first3=M.K. |last3=Hughes |journal=PNAS |doi=10.1073/pnas.0812936106 |year=2009 |volume=106 |number=6 |page=E11 }}</ref>

==See also==

*[[Description of the Medieval Warm Period and Little Ice Age in IPCC reports]]

*[[Global warming controversy]]

== References ==

{{Reflist|2}}

{{Global warming}}

{{DEFAULTSORT:Hockey Stick Controversy}}

[[Category:Climate change]]

[[Category:History of climate]]

[[Category:Environmental controversies]]

[[de:Hockeyschläger-Kontroverse]]

[[es:Controversia del gráfico de hockey]]

[[fr:Graphique en crosse de hockey]]

[[ja:ホッケースティック論争]]

[[pl:Kontrowersja kija hokejowego]]

[[sk:Hokejková kontroverzia]]

[[sv:Hockeyklubbskurvan]]