tag:blogger.com,1999:blog-5337555368793819627.post5444785799618779338..comments2023-06-07T09:04:36.390-04:00Comments on More Grumbine Science: Excess PrecisionRobert Grumbinehttp://www.blogger.com/profile/10783453972811796911noreply@blogger.comBlogger10125tag:blogger.com,1999:blog-5337555368793819627.post-48312203603116146142008-09-25T17:53:00.000-04:002008-09-25T17:53:00.000-04:00Thank you for the comments folks. There'll be a l...Thank you for the comments folks. There'll be a later 'excess precision' note, and a separate one on the water vapor issues. 'Divide and conquer' works for writing too.<BR/><BR/>steve: I think you're right, part of me trying to do too many things at once. Digressing: Did the sea ice answer cover the ground for you? If not, put in your followup.<BR/><BR/>kcsphil: Thank you for the detailed suggestions. Had I been moving faster on writing the additional notes, I think I'd have kept your notes as if it had been email. For future: do feel free to send email directly to me at plutarchspam at aim dot com. (The 'spam' is part of the correct address.)<BR/><BR/>bob: also points well taken. I think you're right about the calculators. When working by hand or slide rule, the bias was the other way -- avoid extra digits if possible. The significant digits then were a lower bound on the calculation. Today ... nobody seems to mind copying 13 digits for an answer to a problem that starts 'there are about 3 million ...'.Robert Grumbinehttps://www.blogger.com/profile/10783453972811796911noreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-42702245850817625332008-09-24T10:54:00.000-04:002008-09-24T10:54:00.000-04:00Good post PD, I quite enjoyed it. Excess precisio...Good post PD, I quite enjoyed it. Excess precision is definitely one of the things that annoys me. Working in the environmental field, I have seen excess precision many, many times when the results of various tests/analysis are presented in many consltants or regulators reports.<BR/><BR/>I think the problem may have started getting bad with the introduction of calculators and spreadsheets that automatically spit out calculations to 8 digits unless you specify the appropriate number of sig. figs. (just a personal theory, nothing more).<BR/><BR/>Finally, regarding the water vapor example, if you want to make it more understandable to lay readers, maybe put in terms of the variability of relative humidity, both throughout a single day and as weather systems move through an area. just descrbing the wide range of relative humidity (something most people or more or less familiar with) should be enough to get the point across that 3 decimal places is excessive.<BR/><BR/>thanks,<BR/>Bob NorthAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-67194719990841753552008-09-23T10:51:00.000-04:002008-09-23T10:51:00.000-04:00I wasn't sure if you wanted this as a comment or n...I wasn't sure if you wanted this as a comment or not, but here it is:<BR/><BR/>Excessive precision is one of the first methods mentioned in How to Lie With Statistics. It's one that my wife (a nonscientist) had discovered herself. It's very common, which makes it a handy warning signal when reading suspect sources. <BR/><BR/>In joke form, it goes like this:<BR/>Psychology students were training rats to run mazes. In the final report, they noted "33.3333% of the rats learned to run the maze. 33.3333% of the rats failed to learn. And the third rat escaped."<BR/><BR/>If you didn't at least wince, here's why you should have. In reporting scientific numbers, one of the things you need to do is represent how good the numbers are. That’s what scientists refer to as “precison.” And it’s also a useful mental trick. You see, the more numbers appear after the decimal place, the more “precise” we assume the number to be. Most people would say (without being able to say why) that a more precise number should be a more “correct number,” meaning they would trust the number more.<BR/> <BR/>In the example above, in order to talk about 33.3333% of the rats, you'd have to have a population of a million rats or more. Even though your calculator will happily give you 6-12 digits, you should be representing how accurate your number is. You only should be showing as much precision as you have data for. So here, where the students have only 3 rats (not the millions implied by their number), they should have just said that 33% of the rats did “X.” Actually, what the students should have done was just list the numbers, rather than percentages, of rats all along because they have such a small sample size or universe to report from.<BR/><BR/>As a reader, a useful test is to look for how large the population is versus how many digits they report in percentages. Every digit in the percentage requires 10 times as large a population. So in our current example, you need 10 rats for the first digit, 100 for the second, and so on. <BR/><BR/>I’ve looked at precision before. In my previous analysis of that bogus petition, for instance, I reported 0.3 and 0.8% {NB – It’s probably useful to say 0.3 and 0.8% of what}. I reported the number of signers to a single digit after the decimal, not the 4 0r 5 digits used by the original authors.. The reason I had only 1 digit is that I was dividing the number of signers by the size of the populations (2,000,000 and 800,000) -- and the population numbers looked like they'd been rounded heavily, down to only 1 digit of precision. When working with numbers of different precisions, the final answer can only have as many digits precision as the worst number in the entire chain. <BR/><BR/>As another example, and maybe the single most commonly repeated one from climate science, is this page, which gives the fraction of the greenhouse effect due to water vapor in the atmosphere as 95.000% (See Table 3 for his piece de resistance). That's a lot of digits, but does the data really support that level of precision? <BR/><BR/>Let's take a look at the sources he gives, and then think a little about the situation to see whether 5 digits precision is reasonable. First, the sources he has valid links for (1 of the 9 is broken, and one source doesn't have a link; I'll follow that up at lunch at work in a bit) certainly don't show much precision. Second, are his sources actually scientific? Several are news or opinion pieces, and my favorite is the 21st century science and technology source, which is actually a LaRouche publication, (whose cover articles include "LaRouche on the Pagan Worship of Newton"). The figures given are 96-99% (LaRouche mag), 'over 90%', 'about 95%', and the like. Not a single one gives as high a precision as 95.000%. This should be a red flag to us readers. Whatever can be said about the fraction of greenhouse effect that might be due to water vapor, it obviously can't be said with much precision based on these data. Not if you're being honest about it. (We'll come back in a later post to what can be said about water vapor, and it turns out that even the lowest of the figures is too high if you look at the science.)<BR/><BR/>{NB I took out the Water vapor example because 1) you just said you’d be doing a later post on water vapor, and 2) if your readers haven’t gotten it by now the last paragraph won’t help them get it either.Philip H.https://www.blogger.com/profile/12049875206738422083noreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-77366786267708602852008-09-22T19:18:00.000-04:002008-09-22T19:18:00.000-04:00I think the main problem is the last paragraph. I...I think the main problem is the last paragraph. It assumes a bit too much on the part of the reader. (FYI I'm a non-scientist but a long-term denizen of the climate science blogosphere, and so have seen all of this before.) E.g., what do the mysterious "mb"s have to do with the amount of water vapor? This confusion was added to when you said "million" instead of millibar. Also, does the less informed segment of your intended audience already know that 32F is equal to 0 C, and for that matter what F and C stand for? A few more words and sentences would fix this sort of thing. Alternatively, could this paragraph have been the other post?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-17749596113772913562008-09-22T19:04:00.000-04:002008-09-22T19:04:00.000-04:00:-) One of my favorite bits of net.sarcasm is "87....:-) <BR/><BR/>One of my favorite bits of net.sarcasm is "87.32% of statistics on the Internet are made up on the spot."Robert Grumbinehttps://www.blogger.com/profile/10783453972811796911noreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-64052686109044801762008-09-22T15:34:00.000-04:002008-09-22T15:34:00.000-04:00Research shows that if you add an extra decimal pl...Research shows that if you add an extra decimal place, 17.83% more people will find your results believable.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-61957777946005546202008-09-22T11:42:00.000-04:002008-09-22T11:42:00.000-04:00One thing I know it suffers from is that I try to ...One thing I know it suffers from is that I try to do two different things, one being the excess precision, the other its demonstration in a climate-related source.<BR/><BR/>By all means, let it simmer some in your mind and see what comes up.<BR/><BR/>And, other readers, if you have suggestions for improvements, do bring them up. The more so if you're not a scientist yourself. I want to be clear to the vast majority of the world that aren't scientists.Robert Grumbinehttps://www.blogger.com/profile/10783453972811796911noreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-3665883162962258022008-09-22T11:28:00.000-04:002008-09-22T11:28:00.000-04:00well . . . you're a scientist. I'm a scientist. ...well . . . you're a scientist. I'm a scientist. precision is our language. That said, I had to read it twice to get the full meaning. Let me play with it a while - It just seems like it needs to be redacted or revised somehow to be a tad less . . . scientific.Philip H.https://www.blogger.com/profile/12049875206738422083noreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-30609947446881404292008-09-22T10:44:00.000-04:002008-09-22T10:44:00.000-04:00Suggestions as to where it started going astray? ...Suggestions as to where it started going astray? (Or at least where it went astray.)<BR/><BR/>Do get the book. Huff's is an absolute classic, inexpensive, and definitely readable by folks regardless of background.<BR/><BR/>I'll add, though, that the excess precision flag is one that can be raised against quite a few posts in climate, regardless of what the poster is supporting or attacking.Robert Grumbinehttps://www.blogger.com/profile/10783453972811796911noreply@blogger.comtag:blogger.com,1999:blog-5337555368793819627.post-78706382203065822952008-09-22T10:36:00.000-04:002008-09-22T10:36:00.000-04:00This is one of those blog posts that EVERYONE who ...This is one of those blog posts that EVERYONE who fights climate change deniers should read. Now, if you can just tweak it a little to be readable fro the great, un-science-oriented masses, that would be even better. And I'm off at lunch to get the book in question.Philip H.https://www.blogger.com/profile/12049875206738422083noreply@blogger.com