Showing posts with label weeding sources. Show all posts
Showing posts with label weeding sources. Show all posts

25 March 2015

How to pick cherries

The not-so fine art of contriving to support the conclusion you predetermined is cherry picking.  Really not a good thing for a scientist to do or condone, but pretty common in politics.  The latest example comes from politician (now presidential candidate) Ted Cruz, being condoned/defended (even praised) by scientist Judy Curry.

Suppose you're interested in global warming, just in understanding what's going on -- not in 'proving' that there is warming, or cooling, or that temperatures are unchanged.  You're an actual skeptic -- looking for evidence and where the evidence leads.  One thing you learn pretty quickly in your skeptical explorations is that you need 20-30 years of data to define a global climate temperature.  Shorter than that, and your answer depends sensitively on your averaging period.  As a skeptic, you don't want such unreliable methods.  Apply the 30 years to a number of data records (below), and you get the answer that climate has been warming, 1.3-1.7 K/century (2.3-3.1 F).

As a cherry-picker, committed to finding a particular answer, however, you go straight for the option of using short spans -- look for a record length that will give you the answer you want, then ignore the fact that your answer changes if a couple years are added or subtracted.

17 July 2011

How large a conspiracy?

Did you know that the observed decline in Arctic sea ice cover is all just a fake?  I didn't, but encountered folks who thought so.  Since I'm one of the people who would have to be involved in the conspiracy or at least being duped by the masterminds, I'll take a minute to ponder the matter and how someone who does not personally know many of the people involved could go about deciding whether there was indeed such a conspiracy.

One of the tools I find useful in considering issues is to follow a common mathematician's approach -- called the reductio ad absurdum.  That means reduction to absurdity.  What you do is assume the thing at hand to be true, and then pursue it logically to see where you go -- whether it leads you to absurdity.  This is also the starting point for a proof by contradiction.  Again, assume the thing to be true and see if it leads logically to a conclusion that contradicts what you know to be true.

So let's assume that there is indeed a fake involved in the decline in Arctic sea ice.  The people involved were a little particular -- the passive microwave sea ice record.

Some questions to pursue, then:
  • How long would the conspiracy have to have lasted?
  • How much data would have to be faked?
  • Who all would have to be involved in the fakery?
  • Are there other sources of data to confirm or refute the passive microwave observations?

01 April 2011

Says who?

I think citations are a greatly underappreciated part of scientific works.  They also, for some of the same reasons, provide a way of assessing the strength of a source even if you don't know the topic that's involved.

My first real introduction to citations as being important was when a history teacher of mine in college was concerned that I'd committed academic dishonesty -- failed to cite a source for something she felt was obscure.  After a nervous couple of minutes for me, we had a nice chat.  What I'd done was to mention, without citation, Newton's prism experiment.  I hadn't cited it because it was something I'd been seeing mentioned for years without citation, so figured counted as 'common knowledge' and not in need of a citation.  My history teacher, on the other hand, had never heard of it before, so was looking for the citation to the person who had discovered the experiment (perhaps a citation to Newton himself; I now have the right book -- Newton's Opticks).

So that's one use of citations -- avoid annoying your teacher.  Somewhat more generally, credit people for the work they do.  That's an important thing in being a scientist, as the people you're giving credit to are your colleagues.  Conversely, your colleagues will be peeved, to put it mildly, if you fail to credit them for their work.

The use at hand, as the title suggests, is to provide the backup for your claims.  You could avoid some of that by providing full descriptions yourself, but then your article becomes impossibly long.  Instead you can write something like "The earth is round[1] and rotates[2].", where you then give the full address to 1 and 2 somewhere later in the document (in print media days) or hyperlink the words directly.  An alternate that I prefer is to provide the direct 'who' and 'when', such as "The earth is round [c.f. e.g. Aristotle, ca. 322 BC*] and rotates [Foucault, 1851]."  In this way the reader immediately sees something about who your source is, and how old it is, and retains some merit even in a hyperlinking medium.

If you could read infinitely fast, it might be doable to simply read everything from everywhere.  But for us humans, some means of trimming the candidates to manageable volumes is needed.  So, for myself at least, if I'm trying to learn about a scientific topic, I head for scientific sources, or as close to the original as I can understand.

The bibliography/citation list is a quick way to figure this out.  Places that are citing wikipedia articles, newspaper editorials, and so forth, for most of what they have to say are not strong sources.  If the topic has scientific merit, there will be scientific papers on it.  If I couldn't read, or would have a hard time finding and reading, the original scientific papers (which is true in most fields), then I want to be learning from someone who could and did.  The strong source is one which is providing me the ability to go in to the literature and start learning about the particular part of the article which caught my attention.

This last is another important purpose of citation: It helps readers learn more.  I would rather be learning the science from an author who is trying to help me learn it.

Now for the mirror test: How do my own postings hold up to that standard?  In this post, it does ok, in the sense that this isn't about the content of science; it's my opinion of some things to consider in looking for sources from which to learn the science.  In the science posts, not always as well as I'd like.  So I'll take this post as a reminder to myself to include more references and links.

In my blogroll, two that are particularly good with their citations are Skeptical Science and RealClimate, though I think almost all are pretty good -- at least better than I.

*
c.f., I translate to myself as meaning 'See, for example'.  It means that there's more than one source, and this is either the one that I used (though I know there are more), or that for some reason I prefer it.
Update: my self-translation is incorrect, see Nick and Peter's comments.  What I really want is 'e.g.', for exempli gratia  (free example is my translation here, unfortunately, it's my son who is the latinist.)

ca means 'about' (circa).

29 November 2010

Verifying forecasts 2

As I said last week, verifying predictions is difficult, and was prompted in to looking again at the matter by someone doing it wrong.  Of course the standard of 'wrongness' involved is mine.  Forecast verification is something of an art as well as mathematics and science.  But some points I think I'll get little argument from Allan Murphy* and his intellectual colleagues and descendants for are:
  • You have to be clear what you're forecasting
    • what variable
    • at what time (or time span)
    • for what place or area
  • You have to be clear how the forecast is going to be evaluated
  • You should evaluate all forecasts
  • Forecast must be public
  • Forecasts must be verifiable
That last might seem a little strange.  I hope not.  Suppose I said next July 20th at 3:34 PM at Washington National Airport the official temperature would be hot.  Very specific about what I'm forecasting and what it will be evaluated against.  But what is 'hot'?  To me, anything over 80 F (27 C).  As such, it's a near certainty that my forecast will be correct.  It's also awfully easy for me, on July 21st, to say, regardless of the temperature, that it was 'hot'.  This is one reason that we prefer numbers in science.  You can, and we do, work with qualitative predictions.  But it takes more work, as you have to find some way of making 'hot' objective, so that we can all agree that such a forecast was correct or not.

In general, if not as universal, we add a couple more items, at least desirable if not mandatory:

21 July 2010

I am John Abraham

Those of you of a certain age, or a certain other age, will remember the scene from the movie Spartacus where everyone steps forward and declares himself or herself to be Spartacus.  So it goes now.  Fortunately, it is only threats against jobs and not, yet, lives which are at hand. 

Still, someone's job is indeed being threatened, and the 'transgression' involved is to address the scientific content, or lack thereof, in the whiner's threatener's presentations.  That would be no matter for concern if the threatener were some nonentity.  But it is a person who has testified to the US Senate regarding the science of climate change.  That makes it rather a serious issue -- this is not a marginal person whining from the distant reaches of the auditorium.  This is a person with the ear of US Senators.

The person being threatened is John Abraham.  He's a scientist at a small university in Minnesota who took the time to address the scientific claims of the person who styles himself as Lord Monckton, and, among other things, who recently was invited to address the US Senate on climate change.  Abraham's response is at his University of St. Thomas web page.  I encourage you to view/listen to the presentation Abraham made.  And, of course, to examine yourself the original comments of Monckton's.  And then to hit the scientific literature yourself to see who represented the science most accurately.

I'll include a raft more links below the fold, as many comments are already out there.

The thing which has me writing is the fact that this is such an absurd response from Monckton -- if he were at all interested in the science.  That places this in to the 'weeding sources' category.  If you're interested in the science, you, first, try to get it right yourself.  Then, if someone else points to places where you might have gotten your science wrong (and, in fact, spectacularly wrong), your response is to correct your errors.  You don't have to like it.  Scientists are human, after all, and nobody likes to have it shown that they're wrong.  Still, you do it.  What you don't do is try to get fired the person who showed that you were wrong.  But Monckton indeed responds to correction by trying to get his corrector fired. 

So I encourage you to send your support to Abraham, by facebook group, to email his university, or the like (see, for instance, Hot Topic's petition to sign).  We need more people who are willing to address the scientific content of public statements about climate.  And they need to be reasonably confident that they're not going to lose their jobs for trying to speak honestly about the science.

22 February 2010

Which sources to trust?

Weeding sources is my tag for articles about deciding which sources to trust.  I'm far from the only person who considers this an important topic, of course.  The articles I prefer are, like mine, ones where there's some detailed effort to look at what a source doing and what is dishonest.

Lately Tim Lambert at Deltoid has been taking up the question of a journalist -- Jonathan Leake -- and paper (The Times, in the UK) and their reporting on climate.  The Rabett has written up a nice summary of Tim's posts on this theme.  The upshot being, Leake and The Times are unreliable sources, both for making up things and for not correcting their errors.  But see Tim's researches that establish those points.  Much more work there than Leake is putting in to his artifices.

13 January 2010

Successive approximations

The other title for this would be 'the relativity of wrong', if I were to steal the title that Isaac Asimov used for an essay on a related topic.  It's a common issue in science, and successive approximations is both a common and a powerful tool.  In the comment section for 800,000 years of CO2 we had a local introduction to the issue.  But I'll start with the example that Asimov used, and that I have a number of times myself.  (It's entirely possible that I used it because he did -- I've read most of his science and science fiction writing.)

Let's start with the shape of the earth.  At some distant time in the past (probably more distant than you're thinking) we start with the thought that the earth is flat.  A different version of thinking about this is that the radius of a spheroidal earth would be infinite.  Clearly there are local variations, as any runner, hiker, or biker can tell you.  But basically a flat surface.  Get out to the Great Plains, some of the major deserts, or, especially, the coasts, and it's obvious that the earth is flat.  Just look!

19 October 2009

Sound and Fury at WUWT

From the question place, where a reader noted a high traffic item at Watt's Up With That  and asked for a science response.  Where to begin?  First, I guess I'll note that most of the post is bluster and personal attack.  Once you cross out those parts, it's a much shorter article.

Second, as always, go back to the original source.  In this case, it is a Mann et al. 2008 paper Proxy-based reconstructions of hemispheric and global surface temperature variations over the past two millennia, with supplementary material.

Then, consider exactly what the claims (in this case, at WUWT) are, and just what evidence is produced for it. 

The fundamental claim at WUWT is that the entire reconstruction is upside down.  (We're treated to pictures of other things that are upside down.)  Right off, we know WUWT is wrong. 

08 September 2009

What fields are relevant?

I've never met someone who knew everything. Certainly I've met some very bright people, and people who knew quite a lot. But nobody has known everything. Conversely, I'm a bright guy, and know a lot of stuff, but I've never met anybody who didn't know things that I didn't. That including an 8 year old who was pointing out to me how to identify some animal tracks (they'd talked about this in her science class recently).

People know best what they've studied the most is my rule of thumb. That's why I go to a medical doctor when I'm sick, but take the dogs to a veterinarian when they're sick. I call up a plumber when the water heater needs replacing, and take my car to an auto mechanic when it needs work. And not vice versa on any of them. It might be true that the auto mechanic is also a good plumber. But, odds are, the person who focused on learning plumbing is the better plumber.

None of this should be a surprise to anybody, yet it seems in practice that it is once we come to climate. Let's be a little more specific in that -- make it the question of whether and how much human activity is affecting climate. There are many other climate questions, but it's this one that attracts the attention, and lists of people on declarations and petitions. If you look only at the people who have professionally studied the matter and contributed to our knowledge of the matter, then the answer to the question is an overwhelming 'yes', and a less overwhelming but substantial 'about half the warming of the last 50 years'.

I've tried to set up a graphic (you folks who have actual skills in graphics are invited to submit improved versions!) of 'the way to bet'. The idea is to provide a loose relative guide as to which fields most commonly have people who you can have the greatest expectations that they have studied material relevant to the question of global warming and human contributions to it from a standpoint of the natural science of the climate system.

Climatology, naturally, is on the top tier -- many people in that field will have relevant background. Not all, remember. Some climatologists look no further than their own forest (microclimatology of forests -- how the conditions in the forest differ locally from the larger scale averages) or other small area, or small time scale. Still, many will be relevant.

Second tier, fewer of the people will be climate-relevant, but still many. Oceanography, meteorology, glaciology.

Third tier, most people will not be climate-relevant. But some have made their way, at least, from those fields over to studying climate. That includes areas like Geomorphology (study of the shape of the surface of the earth) and quantum physics (the ones who come to climate were studying absorption of radiation).

Fourth tier, almost nobody is studying things relevant to the question I posed. The extremely rare exception does exist -- Judith Lean has come from astrophysics and done some good work (with David Rind, a more classically obvious climate scientist) regarding solar influence on climate. Milankovitch was an astronomer/mathematical analyst who developed an important theory of the ice ages.

Fifth tier, I don't think anybody has studied the question I posed directly. I do know a couple of nuclear physicists who have moved to climate-relevant studies. But they essentially started their careers over with some years of study to make the migration. In this, it's more a matter that they once were nuclear physicists. After some years of retraining, they finally were able to make contributions to weather and climate. At which point, really, they were meteorologists who happened to know surprisingly large amounts about nuclear physics.

Sixth tier, I wouldn't include at all except that they show up sometimes on the lists. My doctor is a good guy, bright, interested, and so on. But it takes a lot of work studying things other than climate to become a doctor, and more work after the degree is awarded to stay knowledgeable in that field. That doesn't leave a lot of time to become expert in some other highly unrelated field.

[Figure removed 14 September 2009 -- See Intro to Peer Review for details]


Suggestions of areas to add, or to move up or down, are welcome. I'm sure I have missed many fields and others are probably too high or low.

For now, though, if you're not an expert on climate yourself, I'll suggest that if the source is in the first two tiers, there's a fair chance that they've got some relevant background. If they're in the bottom 3, almost certainly not -- skip these. And the third level, is probably to skip but maybe pencil them in for later study, after you've developed more knowledge yourself from studying sources on the first two levels.

This ranking, of course, applies to the particular question asked. If the question is different, say "What are the medical effects of a warmer climate?", the pyramid would be quite different and MD's would be the top tier. Meteorology would move down one or two levels. Expertise exists only within some area. As I said, nobody knows everything.

Update:
frequent commenter jg has contributed the following graphic:


A general good change he's made is to split between general skills, that can transfer to studying climate, as well as what particular sorts of detailed skills or knowledge one might have. Almost everyone, for instance, involved in studying climate knows some statistics and mathematical analysis. Many fields also require such knowledge, so those would find it easier to move over to climate.

Different good change he made was to put the question directly into the graphic. This is important. As I said, but didn't illustrate, the priority list depends on exactly what question is at hand.

27 July 2009

How not to analyze climate data

Preface
The paper that prompts this post (and the preceding Introduction to time series analysis is McLean, de Freitas, and Carter, 2009. A reader suggested, in email, that I take a look. I'll recommend that to others as well. I won't carry out all suggestions, not least because I don't know all areas well enough to comment, but they are indeed welcome. And do at times result in a post here. There'll be some following notes as this paper opens several issues. For now, I'll stay with just the paper.

Comments have already appeared at OpenMind, Initforthegold, and Realclimate. In a fundamental sense, I won't be adding anything new. But the approach will differ and might show some features in ways that you might have missed in the comments over there. For instance, I mentioned the crucial bit that I'll be exploring here in a comment at Initforthegold, and Michael missed its significance on first reading. The fundamental was staring him in the face, but fundamentals aren't always easy to notice. When he did, it was 'forehead slap' time.

I've tagged this 'doing science' and 'weeding sources', as well as 'climate change'. Some issues of peer review will show up, as will a flag or two of mine which I find useful in weeding sources. The nominal topic of the paper "Influence of the Southern Oscillation on tropospheric temperature" is climate change. Recently I posted about scientific specificity. While it's entirely true that it doesn't work well to take that line in daily life, it's exactly what one should do with a scientific paper. One thing it means is that we keep an eye on whether the data used, or are used, support the argument that is made.

Begin
We start by reading the abstract. As a matter of doing science, the abstract usually makes the most eye-catching statements in the paper. It is the advertising section of the paper, so to speak. You want to say something here that will interest other scientists and get them to read your brilliant work. In this case, "That mean global tropospheric temperature has for the last 50 years fallen and risen in close accord with the SOI of 5–7 months earlier shows the potential of natural forcing mechanisms to account for most of the temperature variation."

SOI is the Southern Oscillation Index. It provides a number that is connected to the El Nino-Southern Oscillation (ENSO), which can then be used for further research, such as this paper. There are different ways of defining an SOI, which might be an issue if the effects the authors were working with were fairly subtle. But, as they are referring to explaining 68-81% of the variance (figure depends on which records are matched, and how large the domain examined is), we've left the realm of subtle. As the authors duly cite, there's nothing new in seeing a correlation between SOI and global mean temperatures. This is well-known. What is new is the extraordinarily high correlations they find, and that eye-catching conclusion that most of temperature variation for the last 50 years is driven by SOI.

For atmospheric temperatures, they use the UAH lower tropospheric sounding temperatures (paragraph 5) and for SOI, they use the Australian Bureau of Meteorology's index (para 7). If the abstract were an accurate guide, we'd expect that with those two time series in hand, they computed the correlations and found those very high percentages of variance explained. Or at least that they were that high with the noted 5-7 month lag. And here's where we get to the time series analysis issue that I was introducing Friday.

Three different things are done to the data sets before computing the correlations. One is to exclude certain time spans for being contaminated by volcanic effects on the temperatures. No particular time series analysis issue here. But the other two both have marked effects on time series. First (para 10) is to perform a 12 month running average. This, as I discussed Friday, mostly suppresses effects that are 1 year and shorter in period. Second is to take the difference between those means, 12 months apart (paragraph 14). As I described on Friday, this suppresses long term variation, and enhances short term variation. They assert that this removes noise, while, in fact, it amplifies noise (high frequency/short period components of the record). Alternately, they are defining 'noise' to be the long period part of the records -- the climate portion of the record.

The combined effect of the two filters is that both the high frequency and the low frequency parts of the records are suppressed. What is left is whatever portion of the two records lie in the mid-range frequencies. To return to my music analogies, what has been done is to set your equalizer in a V shape, with the highest amplitudes in mid-range. While the result has a connection to the original data, it is certainly no longer fair to say, as the authors do in the abstract, that their correlations are between SOI and temperatures.

Demonstration of filter effects -- sample series
The next 4 figures show k) the original time series, which I constructed by adding up some simple periodic functions l) the 12 month running average version m) the 12 month differencing of the original data and n) applying both filters as the authors did (minus volcanoes).

Original



12 Month Smoothing



12 Month Differencing



Both Filters



As expected, the running average smoothed out the series. In music terms, it suppressed the treble. That's the job of an averaging filter. The differencing made for a much choppier series than the original. That, too, can be desirable. But certainly the authors' comment about 'removing noise' is ill-founded. If we look at the variance in the time series, the original has a variance of 4.25. The running average decreased that to 2.69 (eliminating 37% of the variance). The differencing increased the variance 50%, to 6.47 (again, increased variance means more noise). Applying both filters produces the final figure, which has little resemblance to the original series. Not least, while the original looks to have a substantial amplitude at a period of 30 years (that appearance is entirely correct, I put in a 30 year period), the final product shows no sign whatever of the 30 year period. That is one of the jobs of a differencing filter -- remove the long period contributions. The filters have also suppressed the 15 year period that I put in, and, in general, turned my original series, which had equal contributions at 5 months, 1, 2, 3, 5, 7, 10, 15, 30 years into something that looks mostly like a 3 year period (count the peaks and divide that in to the time span for them) with a bit of noise.

Filter effects on SOI series
That was a warm up with a test series, where we know that there are no data problems of any sort, and we know exactly what went in. The real data of course have problems (this is always true, and one of the aspects of doing science), but they may not have problems that affect our conclusions. The next figure shows the smoothed (12 month running averages again) and then differenced (as in the paper) Australian SOI (labelled 'both' -- both the averaging and the differencing applied to the original data) (Note that I'm not showing the full curve, only 1950 to present, instead of 1879 to present -- the paper's analyses only covered, at most, 1958-2008).



You see that with both filters applied there are new peaks, missing peaks, and even the sign of the index can change (positive for negative, or vice versa). These are all signs that the filters have fundamentally altered the data set, so that whatever conclusion is drawn can only be drawn about 'data as processed by this filter', not the original data -- in contradiction to the statements in the paper and elsewhere by the authors that it is SOI that explains an extremely high portion of the variation in global mean temperature. Further, since the correlation is largely driven by the peaks, the high correlations can by largely a matter of how the filter creates or destroys peaks rather than the underlying data.

Response function
I mentioned Friday the amplitude spectrum -- show the amplitudes of the contributions from each period. Filters change the amplitude spectrum. That's their job. One thing, then, that you do to describe the filter is divide the amplitude at a period after processing with the amplitude before hand (this is known as the response function). An ideal filter will show a 1 for all periods except the ones you're trying to get rid of, where it will be 0. Real filters don't accomplish this, but that's the goal. So, to see the performance of the author's filter, I took their original SOI series, processed it through their filter, and then found the response function in this way. Those are the next figures. First is looking at cycles per year (frequency), letting us see well what happens at high frequencies. Second looks at the period (from 1-15 years).

Frequency Response Function



Period Response Function





There are some spikes in the curves, which have nothing to do with the filter. All that is happening there is the these are periods/frequencies which have little signal in the original series, so numerical processing issues can have large effects there (dividing by small numbers is hazardous). But the smooth curve is a fair description. The averaging filter suppresses the signal (response is close to 0) for frequencies of 1, 2, 3, 4, 5, 6 cycles per year. (With monthly data, 6 cycles per year is the highest that can be analyzed -- 2 months period.). The differencing filter also suppresses the very low frequencies (long periods), as we expected even with just the basic introduction from Friday. But take a look between 1.5 and 7 years. The response is greater than the input! Look, too, at the periods which are being amplified. A usual description of ENSO is 'an oscillation with a period of 3-7 years'.

Summary
So what do we really have? It isn't a correlation between SOI and global mean temperatures. Both were heavily filtered. What the authors actually compute is the correlation between the SOI time series and global mean temperature -- if you over-weight (response function is greater than 1, so it's an over-weighting) both series towards what is happening in the ENSO periods. The conclusion should really be "If you look only in the ENSO window, you see that ENSO accounts for a lot of variation in global mean temperature." One problem is, that isn't a new result. We already knew that ENSO was important in the ENSO periods. More important to the paper, in so doing, the authors cannot make any conclusion about explaining "most of the temperature variation". They've filtered out much of it, and never examined either the response function nor the effects of their filter on the inputs.

If what was desired was an analysis of global mean temperature response to SOI at ENSO periods, then both the authors should have been clear that this was their window, and they should have used a more suitable filtering process. When one goes back to the paper, it's also clear that no justification was ever made for using either filter, much less both. The filters were arbitrary, and as I've mentioned, we prefer to avoid arbitrary decisions in our papers. If no objective basis for setting up the filters could be found, the authors should have demonstrated that alternate choices did not affect their conclusions.

So, some 'weeding sources', or 'scientific specificity' signs:
* When a paper makes a conclusion about the correlation between A and B, verify that it is A and B that they are correlating.
* If a filter is applied, look for the authors to discuss a) why a filter is being applied at all, and b) why the particular filter they chose was used.




As is my custom, I've sent an email to one of the authors (de Freitas, the only one whose email was given in the paper) about this comment.

Some of the following blog posts will talk about the peer-review aspects that let this paper through. For now, see my old article peer review. One of the other notes (no idea when) will be about how the process continues after a bad paper gets through the peer review process. That is the comment and reply process, and I'll be writing Tamino about that (he's said in his comments that he's preparing a comment for the journal).

20 July 2009

What cooling trend?

Nonsense about the 'current cooling trend' is rife across the blogosphere, and the science minded folks usually point to the fact that you need 20-30 years to define a climate trend. The lies as such don't interest me, or make for a good topic for this blog.

What's useful or interesting is that the statement itself, often linked to 'last 10 years', is not true even after allowing for substantial cherry picking. This brings us back to the interesting matter of trying to define climate. And a further reminder that if you're reading bad sources, you can't trust even the simplest of statements.

To find current temperature trends, I used the NCDC monthly temperature anomalies. The most recent month is May, 2009. To look in to current trends, then, I computed the trends from every month of the last 30 years, through to May 2009. The trend shown for January 1979 is the trend from then to May 2009. The trend for April 2009 is to May 2009. Figure 1 gives the results (actually back to 1977).



Wow, current warming trend of 120 C per century! Surely we're all going to be boiling soon? Of course not. That trend was computed from a 1 month span -- April to May of 2009. It is yet another reminder that short term variations, namely weather, can be large. It isn't climate. Climate shouldn't depend sensitively on when exactly you start your trend computation. Unfortunately that figure shows us nothing new, beyond confirming yet again (not a bad process itself, and part of the scientific approach) that weather happens, and weather variability is much larger than climate variability. So in figure 2, I zoom in a little and ignore positive trends greater than 20 C/century.



So now we can see that if someone chooses very carefully (namely, cherry picks) the starting date, they can find a cooling trend between then and May 2009 ('current'). But notice how carefully they have to choose that starting date. If it's 10 years (or any number greater than that, back to the record's start date), the trend is a warming. In fact, you can only get cooling trends occur if you choose a start date between January 2001 and January 2007 (including those months), or October, 2008. Anything farther back, or more recent, shows warming.

Both for deciding climate, and for doing science, we want our conclusions not to depend sensitively on arbitrary choices. Ending with the most recent data is not arbitrary, so we're ok there. But choosing a starting date? Science-minded folks take a figure in the range of 20-30 years, in particular 30, because over a century of experience says that 30 years is a good time period to be able to look at climate trends as opposed to weather fluctuations. i.e., not arbitrary. Choosing 2.4-8.4 years (and not 9.4, or 12, ...)? Why would we do that? Well, if we wanted to support some particular conclusion, we might do so. But that is not science.

Let's zoom our attention to the period in late 2006 through early 2007. The largest 'cooling trend' you can contrive is to start with September or October 2006, giving 3.3 C per century cooling. Of course you're flagrantly violating sensible climate practice by using 30 months instead of 30 years. But now look to April 2007, where the trend is already a warming of 3.3 C/century, and remains higher than 3.3 to the present, except for that 1 month, October 2008. If 30 months are ok for cherry pickers, why are 24 months not? They're not very different time periods; if either one is acceptable, both must be.

On the science side, as my results post illustrated, if you take 20-30 years to determine your trends, then changing the length doesn't change your answer much. We see this again in figure 2, where any trend computed with from 15-30 years of data gives nearly the same answer as to the current trend -- about 1.8 C per century (1.49 for 15 years, 1.79 for 20, 1.92 for 25, and 1.62 for 30 years). The figures do fluctuate some, which is to be expected. But changing from 30 to 24 years doesn't take us from a large cooling to an equally large warming, the way it can for months.

I'll probably take this up in a separate note, as it illustrates a different way of misleading yourself with graphs. For now, I'll just observe that if you compute the 10 year trends, rather than telling people to 'just look', then the most recent time there was a 10 year cooling trend was the 10 years ending with January, 1987 (with 0.03 C/century). The last time you had several months in a row where the 10 year trend to that month was a cooling was in the late 1970s -- 30 years and more back. At no time that the '10 year cooling trend' claim has been getting made, has it been true.

09 April 2009

20 who deny CO2 is correlated with temperature

Over in my Does CO2 correlate with temperature? post, some of the commentators are claiming that nobody says CO2 is not correlated with temperature. This is odd, since I name a source there which does so. But, in the spirit of my 20 links game, here are 20 (more) who say so.

First, a word about doing science, and weeding sources. One thing about doing science is that you're supposed to read the source you're commenting on. As some commentators demonstrated, they didn't read my article before making their comment. That would have been the easiest way to discover a source which did as claimed. More work, but still easy, is to do a search and see if the comment is out there. Now, as you know from reading my 20 links game earlier, I think pretty much any statement you'd care to name is being asserted somewhere on the web, and probably in at least 20 different locations. If you've been looking at the web for a while, you've seen some pretty strange statements being made seriously.

Where the commentators agree with me is that it's absurd to claim that there's no correlation between temperature and CO2. Consequently, any source which does claim so is unreliable and you'd be better off moving on. (Oddly, they don't seem to agree with this part.)

So, here are 20 sources (well, 21) which assert no correlation between temperature and CO2, and are referring to recent (last 150 years) climate:
  1. Joseph D'Aleo on Jennifer Marohasy's blog
  2. Powerpoint presentation, see slide 47
  3. Ken Gregory
  4. Christopher Horner, Lawyer
  5. Lee C. Gerhard, Center for Science and Public Policy
  6. Warwick Hughes, repeat of preceding
  7. Article by Dennis Avery, quoting Timothy Patterson
  8. Article by Timothy Patterson, published in Financial Post, copied to this site
  9. An englishman's castle, blog
  10. Noel Sheppard, at Newsbusters
  11. Glen Meakam, Pittsburgh Tribune Review 25 January 2009 (cached version)
  12. Joseph D'Aleo, on his own site
  13. Jim Manzi, taking Steve Milloy to task for claiming no correlation
  14. Capitalism Magazine, quoting Timothy Ball
  15. Martin Durkin, the producer of the documentary The Great Global Warming Swindle
  16. Geoaffair
  17. Jules has been engaging in discussion and documenting Hans Labohm's denial of any correlation between CO2 and Temperature (Labohm goes farther than any others I've seen, and denies it for all time scales from tenths of years to millions of years)
  18. Christopher Monckton at Science and Public Policy
  19. Paul Drallos, PhD (Physics)
  20. user 'bravo22c' at the Telegraph, UK
  21. Alan Caruba in the Canada Free Press


Took 90 minutes since I didn't accept blog comments -- all these are original articles, sources that get quoted elsewhere. I also didn't take many copies of the same sources, which, again, would have shortened the search. Also no videos. But I threw in a bonus cite. Some cherry pick their periods ('last 10 years', '1945-1970' or the like), some leave it at 'recent', without saying what 'recent' means.

As I discussed before, you need 20-30 years to be talking about a climate trend. So the sources which use only 10 or so are being doubly misleading.

19 March 2009

Unreliability at co2sceptics/climaterealists

Last Tuesday I wrote up Misleading yourself with graphs, prompted by plots on the main page at co2sceptics. As I mentioned then, it could have been an honest mistake, so I sent a note to them on their site (message form).

They've neither responded nor changed their site. So I'm afraid they're simply an unreliable source. Maybe the mistake is honest, maybe not. But a reliable site would respond on being shown that they'd made a mistake and were misleading themselves and their readers.

This is less of a surprise to me now since I searched on their name and found one of the references to them is an earlier post of mine about a different unreliable source icecap.us. In that case, they were being extremely un-skeptical.

In Does CO2 Correlate with Temperature, to appear shortly, I'll be taking a more quantitative look at the correlation they want readers to believe does not exist.

18 March 2009

Read original sources

I've mention it here and there before, but was reminded recently of the importance of reading the original sources. The recent round was a document which said the IPCC had not discussed some points about sea surface temperature. I thought that was odd, so I looked up the IPCC section that talks about sea surface temperature (SST) and in truth, they do talk about those issues. If somebody is lying about what someone else says in such an easily identified way, time to pitch that original source and go looking for someone honest to learn from. So that's one reason to read the original sources -- to see who's lying and weed them out.

There are also more pleasant reasons to follow up to original sources. One is, often the source is being cited for something that's a minor part of what they were talking about -- and the major part is even more interesting. In oceanography, one of the things often mentioned in classes is the Ekman Layer. Don't worry about what it is exactly. Usually, a reference says that Ekman (1905) studied the formation of what we now call the Ekman layer for conditions of an infinitely deep ocean, infinitely steady winds, with absolutely constant friction through the depth of the ocean. Well, it turns out that, although he did examine that highly idealized case, this was a small part of the paper. In fact he also examined varying winds and varying friction. And the results of doing so were much more interesting than what he's normally cited for.

A second reason can be particularly important in science. In the original papers on an idea, the author is explaining something new to the audience. He can't assume nearly as much as later papers on the idea will. You'll also get to see the first matchups of the idea against observations. So I usually learn more by reading the original than by reading the textbook description. (For the geophysical fluid dynamicists out there -- Charney's paper on baroclinic instability is the one exception I've found. There also turn out to be reasons why it came out that way.)

Part three is that you'll get to see much more discussion of why the approximation can be made, and where it can be expected to fail. So, for example, a modern paper talking about the color of the sky -- perhaps for a planet orbiting some other star -- will merely mention 'We apply Rayleigh scattering law and arrive at ...'. It's only when you read Rayleigh's papers that you find out that the 'law' is an approximation, and it will fail under certain, predictable, conditions.

It can be difficult to get hold of the original sources when you start going after Reynolds 1895, Ekman 1905, etc. So the ideal can't always be met. Still, the whole IPCC working group 1 (physical science) 4th report is readily available online or you can order a print copy (also groups 2 and 3, but I'm a physical science guy, so look more to that one). So, when you encounter someone making claims about what the IPCC says, go take a look yourself. And if the point isn't clear, or it is interesting to you, start following up the citations they give. (Unfortunately, I think that after the first report, the writing declined in terms of readability by nonprofessionals. Any more, once you're past deciding if someone lied about the IPCC, I think you'll have an easier time reading by hitting the cited sources rather than the IPCC reports.)

11 March 2009

Not even wrong

Wolfgang Pauli is said to have responded That's not right. That's not even wrong. to a paper.

"Not even wrong" is a good summary of a number of psuedoscientific things. I was reminded of this by a document that wanted to toss aside most of the last 100+ years of science on climate. I'm not going to dwell on the document itself, but it seems worthwhile to look some more at the 'not even wrong' flags.

But first, the term itself. If I said 2+2 = 5, that'd be wrong. If I said 2+2 = kumquat, we're over to not even wrong. One form of 'not even wrong' is that the answer has nothing to do with the question. This shows up often in blog comments about climate where a question like "Has the temperature risen in the past 100 years?" is met with responses like "It was warmer 70 million years ago", "You're just trying to take away my SUV", "It's all natural." Not even wrong -- the response has no connection to the question.

Different version is to start with a falsehood and then draw whatever conclusion you'd like. ex: "Meteorologists don't allow for urban heat island effect, therefore there's been no real warming the last 50 years."

10 March 2009

Misleading yourself with graphs

I've mentioned before my appreciation of the book How to Lie with Statistics by Darrel Huff. One of the major sections regards graphs. Part of doing science is honesty, and, as Richard Feynman noted, the easiest person to fool is yourself.

Friday, I was doing some browsing and encountered co2sceptics. The graphs on that main page (at least on March 6th, 2009) were plots of the Hadley temperature record, from 1978 to 2008, and the atmospheric CO2 concentrations as measured at Mauna Loa from 1958 to 2008. That struck me as odd. Hadley goes back much farther than 1978, to 1850 in fact -- and co2sceptics link to this longer record so they must know that. Why show only 30 years data when you have almost 160? If nothing else, one of the How to Lie with Statistics methods is to show different time lines when comparing different information sources, and here we've got 30 years being shown against 50 years.

One thing to do, then, to try to avoid misleading yourself, is to plot 50 years for both. Here are the two plotted over the same time interval:





Let's see, the CO2 is rising steadily, and there's weather happening on top of temperature rising. Rather different from their conclusion (the quote is below).

But let's not make the same error of using too little data. Plus, with only 50 years of data, and temperatures having a climate period of 20-30 years, we might only be looking at a minor anomaly. Hadley goes back to 1850. Can we find CO2 information back that far? Yes, using the CO2 trapped in ice core bubbles, say at Siple. Here are the plots for 1850 to most recent, where I use Siple for CO2 until the start of Mauna Loa:





Now here's the text they introduce their graphs with the different time spans with:


If you look at the Global Temperature Anomaly graph below you will notice that temperatures peaked in 1998, and have been in general decline ever since, unlike the temperature figures you will see that CO2 output is still increasing.

Now ask yourself a simple question. Is CO2 driving the world's temperature changes?

It would appear not!



Emphasis theirs.

Actually, given the data types and sources they chose and method of comparison they chose, it looks like CO2 does indeed drive climate on longer periods than individual years. All we had to do was show data for temperature over the full period of the CO2 record they showed. Extending the CO2 record with ice cores only makes that connection look stronger.

Now, since I think you need 20-30 years of global mean temperature data to be talking about climate rather than weather, I wouldn't trust that method of analysis very far at all, whether by eyeball or doing a regression.


Since I'm an optimist, I've sent a note to them about this post. If it's just a matter of a mistake, well, honest people can make mistakes. They can then correct their figures and update their comments to reflect a significant role for CO2 according to their already-shown methods of analysis. And if they're not concerned with honest discussion of science, they wouldn't be the first.


Mauna Loa CO2 data
Siple CO2 data
Hadley Temperature data

05 March 2009

Weather will still happen

It looks like this is a surprise to some folks, so I guess it bears repeating: Weather will still happen in the future. This is true regardless of whether the current scientific understanding about climate change is more or less correct or not. There's still going to be weather. By that, I mean that there will still be periods when your back yard will be markedly warmer or colder than usual, you get more (or less) snow than usual, and so on.

What's bringing it to mind is that with a recent cold spell around here (Washington DC area), I've heard many more comments about how "There can't be global warming because it's cold here." (Or that it was cold when a rally was held, etc.) Now, if the people saying such things were honest (even if not correct), when we get to about 20 F warmer than usual this weekend (which is the forecast, vs. having been 20 F cooler than usual), they'd turn around and say just as loudly that there is global warming after all.

But this is one of the easier flags on whether you're dealing with an honest source. They ignore data that goes against what they want to conclude. Conversely, it's a good self-check when you start reading material that annoys you -- is it annoying because it presents evidence just as good as, or better than, you have for the conclusion you prefer? In that vein, if you think I'm ignoring important evidence, do bring it up to me.

As you know from earlier notes, if you've seen them, it's a silly thing to draw conclusions about global climate from a few days of local temperatures. Or even a few years of even global temperatures. If you haven't been here before, take a look at

01 March 2009

The 20 links game

The Washington Post's standards of truth are, apparently, that if you can provide 20 links to support your article, that's good enough for them. (see quotes from their Ombudsman and some responses at, say, http://getenergysmartnow.com/2009/02/28/washpost-ombudsman-steps-up-and-steps-in-it-plus-another-will-fabrication/).

I boggle. Granted that this isn't that rare (part of why I'm good at the game of that name).

So the game is to find 20 links (bonus for 20 links from 20 different sites) to support:
  • The earth is flat
  • The earth is the center of the solar system
  • There is no greenhouse effect
  • Carbon dioxide is not a greenhouse gas
  • The moon landings were faked
  • The earth is less than 100,000 years old
  • The earth is more than 1 trillion years old
  • Humans have been on the earth fewer than 10,000 years
  • Humans have been on the earth more than 50,000,000 years
  • Elvis is alive
  • Space aliens kidnap children
  • ... and any another statement of this caliber
I'm making it harder for you than the Post did for Will. You have to get your 20 links to support a single, clear statement. They approved the article with a number of (erroneous) statements which totalled support of 20 links. Still, I think 20 links is 20 minutes for any outrageous statement of your choosing will not be difficult.

If you post your 20, please use rel="nofollow" in the links. If you're not sure how, note that and I'll do it. Or just post the statement that you found your 20 links to support -- but only after you find the actual links (but save them, there might be later use).

17 February 2009

Neither politicians nor political commentators

Neither politicians nor political commentators are a reliable source for your scientific information. I've been reminded of this yet again as a political commentator has decided to abuse information from the Cryosphere Today and repeat a lie he's used before. The commentator is George Will (Washington Post 15 Feb 2009, page B07).

He repeats the lie about the experts calling for global cooling in the 1970s. One can see from his article itself that he's not looking to the experts -- he's referring to newspapers and other non-science sources. What the experts did have to say was generally that they expected a warming -- if you look at what papers they were publishing in the scientific literature. William Connolley has been pursuing this question for years, including a paper with Tom Peterson and John Fleck in the Bulletin of the American Meteorological Society The Myth of the 1970s Global Cooling Scientific Consensus. (September 2008 issue).

Nearer to my heart, professionally speaking at least, is he joined in the abuse of Cryosphere Today. I do know the fellow who runs it. (You're not surprised, I hope. The field isn't very large, so most of us know most of the rest of us.) He does good work and provides the public service of presenting his work daily. Downside is that he likely gets much more attention for the mentions by a political commentator than he does for scientific interest, which can be more than a bit frustrating.

Anyhow, Will opines "According to the University of Illinois' Arctic Climate Research Center, global sea ice levels now equal those of 1979. " Except, if you go to the Crysophere Today, you'll see that the global figures are (or were at the time Will's column appeared) well below 1979. For a brief period at the end of last year, the statement wasn't relentlessly false. But, as tamino showed at Open Mind, the statement was still terribly false. This is also the error I was taking Roger Pielke, Sr. to task for last October.

Probably few people who care about the science and what we really understand actually get their information from political commentators. Still, I'm depressed a widespread, influential source, Will in this case, which is given inappropriate credence, and which is so blindly disregarding reality.

Back to real science tomorrow!

29 January 2009

Ice before 1979?

It's incredible what you can discover by reading the antiscientific sources. For instance, did you know that before October 26, 1978, nobody knew anything at all about what the Arctic sea ice cover was like? Amazing. I certainly didn't know that. I don't think the Navy realized that in the 1950s when it issued an atlas of Arctic ice cover normals. (I have a copy.) The folks fishing and shipping across high latitudes would also be surprised to discover that they'd missed the chance to use the northwest passage, or to fish in the Beaufort Sea in late summer, or .... Just incredible, in the literal sense of 'not credible'.

The reality is simple -- we do indeed have observations of the Arctic ice pack running back before what we normally call the satellite period. This includes from a different satellite (ESMR) in the early 1970s, Naval operations, shipping and fishing observations, flight observations, and so on. As an antiscientific sort, though, one ignores the possibility that there could be more data available and draws the conclusion without bothering to look.

If, instead, you go look, say at the National Snow and Ice Data Center (a name in the news fairly routinely since summer 2007 when the major Arctic decline started) for what data are available on sea ice, you can rapidly find this listing of sea ice data that they have: http://nsidc.org/data/seaice/all.html . Looking through the table for 'temporal coverage', we see the AARI maps, 1953-1990, Arctic ocean ship tracks (irregularly back to 1872), Arctic ocean back to 1901 (see qualifiers as well), US-Russian atlas back to 1950, 'Morphometric characteristics of ice and snow ...' (irregularly back to 1928), the ESMR data (1973-1976). And, for some reason not listed there but I knew of it to look for it, information in the Nordic seas back to 1750: http://www.nsidc.org/data/g02169.html

So if we have data back to 1950 or so on most or all of the Arctic, and with more qualifiers back to 1901, why do Cryosphere Today (link on right) and NSIDC (ditto) show curves only from October 1978? The answer is, because they're trying to be scientifically honest. With the start of SMMR data in October 1978, we have a nearly continuous series of data which was all collected in nearly the same way (polar orbiting microwave satellite, only slight differences in details of the instrument). Before that period, the available data and their processing were distinctly different. This, the careful scientist knows, could introduce artefacts -- false trends or steps -- in a time series that spanned different sorts of sources. Since we expected the changes in the Arctic ice pack to be slight, these artefacts could overwhelm the slight -- but real -- changes that researchers were trying to detect.

On the other hand, we have the extraordinary low covers of 2007 and 2008. These are so drastically far from what has happened before that the minor differences in extent that would be due to changes in details of map construction and data sources are entirely overwhelmed.

So yes, we do know that the minima of 2007 and 2008 are far from what's previously been observed. And our knowledge extend much farther back than the 30 years of the satellite record. You can safely weed out sources that try to imply that the 2007 and 2008 minimum isn't unusual.