News Science vs. Politics: Tipping Points in Climate Change Communication

AI Thread Summary
The discussion centers on the tension between scientific predictions of climate change and the political narratives surrounding them. Participants express skepticism about the accuracy of climate models, arguing that they oversimplify complex, non-linear systems and rely on uncertain initial conditions. Concerns are raised about the potential manipulation of climate data for political gain, particularly in light of leaked emails from climate scientists suggesting data may have been misrepresented. The role of organizations like the IPCC is debated, with some questioning their credibility and the motivations behind their reports. Ultimately, while acknowledging climate change, there is a call for more transparency and less politicization in the discourse surrounding it.
  • #151


arildno said:
This is just silly.

OF COURSE they solve PDEs, and so what?

Do you even know how hard it is, in the general case, to make a proper coupling of thermo-dynamic quantities in the viscosity parameter, for example?

It isn't something you can read off from statistical mechanics theory, for example, often you'll need to MODEL it, on basis of some empirical data set. In essence, you make it up.

THEN, you must gauge how your PDE works on totally independent data sets given that particular modelling of viscosity, than the one you used to construct your viscosity parameter.

It is true that you need to fit some effective transport coefficients, but that's not going to be useful to doctor your model in order to get to a preconceived prediction.

Another thing is that large class of climate models all with slightly different assumptions make essentially similar predictions. So, the hypothesis that there is Global Warming as a result of CO2 emissions does not depend on the very specific details of how the climate exactly works.

It is similar to putting a kettle of water on the fire after which the temperature will rise. Without any knowledge of thermodynamics, you could do a brute force calculation by modeling the watermolecules and how they interact. The model would make some prediction that is not strongly dependent on the details and the approximations made.
 
Last edited:
Physics news on Phys.org
  • #152


Choronzon said:
Numerous emails have been cited in this thread, and there was a discussion about how the hockey stick graph may misrepresent data. You don't just get to scoff at us and wave your hand and claim our concerns our unfounded in one post and then a page or so later lie out of your teeth and claim that none of us have made any specific claims.

Yes, but they have all been addressed. I am speaking about these new people to jump on board the discussion and make posts.

EDIT: I never even said anything about the previous posts? I would find that it is quite clear that since I have been posting in this thread since the first page that I know everything has been said back-and-forth so it would be assumed that I'm not talking about the posts made prior but the most recent ones. Unless of course you're just looking for a reason to be rude to me; then I can see exactly how you could make that mistake.
 
  • #154


mheslep said:

Gaah. Those clowns have no idea what the decline being discussed even means. I appreciate you are simply pointing to a T-shirt so I am not aiming this at you personally. But the people wanting this shirt are so sure that someone is hiding a decline in global temperature that they've assumed this comment from the emails is related to hiding some measured decline in temperatures, a hidden cooling trend.

It isn't.

I've explained what the email is question is ACTUALLY talking about in [post=2453564]msg #9[/post] of thread "HadleyCru data hacked" in the Earth forum, which is now locked.

If anyone is inclined to accuse me of being biased or being a "true believer" or otherwise refusing to admit the obvious, please read the post first. This is actually very straightforward if you actually know what the topic of discussion in the email is about, and as all the participants in the email discussion understood without needing any long explanations.

The "decline" is not a decline in measured temperatures, but a known "divergence" of a certain limited set of proxys, from tree rings in the Northern Hemisphere. It's not hidden in the science at all... it is extensively discussed in the literature and in all the papers that use this data. The proxies in question are simply not accurate after about 1960, and this has been discussed and explained and explicitly shown in all the literature. ALL the literature that uses this particular data set. All they mean with this remark is that in a diagram meant to show temperatures, you need to avoid using that part of the proxy set known to be inaccurate... and for which we have good direct measures of temperature anyway. That is, you need to remove the spurious decline when you are wanting to show temperature.

I know people have all kinds of concerns with proxy reconstructions. But honestly, this is way out of step with what is going on with the science. Contrary to claims in this thread, it is not all dependent on this tree ring data set. You can toss this set completely and you still get the same basic result. You can use this set in isolation, and you get a reasonable result, though only for a limited regional area, and one that diverges after about 1960 due to changes -- still being studied -- of the growth pattern of trees in that region that are known to be not a reflection of temperature. The study of this -- there's a LOT of it -- indicates that the proxy is still useful for earlier periods, and that is what it is used for.

In brief. The decline is more usually called the "divergence problem", and it is the right thing to do to get rid of that decline when you are plotting for temperature.

When you are studying the particular proxy in more detail -- you show clearly the actual divergence.

Nothing is "hidden" in the sense of being a big bad secret. It's in all the literature, it's well known, and in particular it is extensively discussed in the references provided for the data used in the summary diagram that was being produced.

This "hide the decline" meme is all over the web now, and nothing better shows how much this climategate nonsense is all politics, and the massive disconnect between science and public perception.

Cheers -- sylas
 
Last edited by a moderator:
  • #155


skypunter said:
Is this thread mislabeled, or is there another one to discuss the CRU hack?
The thread was originally about ethics in science, so I added the CRU hack to the thread. Since the release of the data from Hadley Cru has becuase the primary focus, I agree a title change is appropriate.
 
  • #156
Evo said:
The thread was originally about ethics in science, so I added the CRU hack to the thread. Since the release of the data from Hadley Cru has becuase the primary focus, I agree a title change is appropriate.

Excellent idea, but it isn't actually anything to do with the http://www.metoffice.gov.uk/climatechange/science/hadleycentre/. The Hadley Centre is part of the UK Met Office, and has no special connection with the CRU, any more than any other research facility around the world working on climate science.

The CRU is part of the University of East Anglia.

This misconception has plagued the story from the start. Let's not contribute to it!

Cheers -- sylas
 
Last edited by a moderator:
  • #157
Another indication that the claims made by sceptics about the emails are unlikely to be true is to read wat Rush Limbaugh wrote about this:

http://www.rushlimbaugh.com/home/daily/site_112509/content/01125106.guest.html

:biggrin:
 
Last edited by a moderator:
  • #158
Oh, FFS, Count. Who cares what Limbaugh says?

Stop poisoning the well.
 
  • #159
told ya-all repeatedly that this this global warming industry wasn't science (but good psycodrama none the less).

Where can I get a download of FOIA's file? Send me a PM.
 
  • #160


sylas said:
The "decline" is not a decline in measured temperatures, but a known "divergence" of a certain limited set of proxys, from tree rings in the Northern Hemisphere. It's not hidden in the science at all... it is extensively discussed in the literature and in all the papers that use this data. The proxies in question are simply not accurate after about 1960, and this has been discussed and explained and explicitly shown in all the literature. ALL the literature that uses this particular data set. All they mean with this remark is that in a diagram meant to show temperatures, you need to avoid using that part of the proxy set known to be inaccurate... and for which we have good direct measures of temperature anyway. That is, you need to remove the spurious decline when you are wanting to show temperature.

I know people have all kinds of concerns with proxy reconstructions. But honestly, this is way out of step with what is going on with the science. Contrary to claims in this thread, it is not all dependent on this tree ring data set. You can toss this set completely and you still get the same basic result. You can use this set in isolation, and you get a reasonable result, though only for a limited regional area, and one that diverges after about 1960 due to changes -- still being studied -- of the growth pattern of trees in that region that are known to be not a reflection of temperature. The study of this -- there's a LOT of it -- indicates that the proxy is still useful for earlier periods, and that is what it is used for.
Cheers -- sylas

Sylas,
Perhaps you know the answer to this.
Is it common for the newest tree rings to be unuseful as a proxy?
We learned in grammar school that tree rings undergo a change as they age, eventually becoming dead "heartwood" which is primarily strucural support for the tree. The younger, outer tree rings carry the nutrients to the rest of the tree, and so are surely of different composition and/or structure than the deadwood.
If this is not the case, then what might be the reason that they are eliminated from the dataset? What might cause unusual growth such as this?
 
  • #161


I have been following global warming etc for quite awhile and the arguments are really starting to irritate me. I just want to make a couple of points to get them off my chests.

1. First of all there is no "consensus" about GW's cause, it even seems that there might be a "Cooling". I don't know who's right but it's annoying with Copenhagen and Cap & Trade looming.

2. The recent CRU and New Zealand revelations might be political but they certainly bring into question ANY DATA PRESENTED BY ANYONE about climate change. What I mean is without a full audit of every data point in the data set I won't trust any of them.

3. Does anyone have a solution to bringing about a consensus on GW? Any plans to put forth a "bipartisan" plan to resolve the outstanding questions?

4. Last but not least is that the politicians are running with this any it's going to cost us badly in the long run. I have no issues with CO2 causing GW, no issues with SOL causing GW. I would just like to know as I'm sure I will be taxed to death either way.

Thanks for letting me vent guys. Carry on.
 
  • #162
What is unfortunate with this "hide the decline" stuff, is that deniers are trying to make it look like that scientists would have been trying to censor some alleged cooling, while in reality the hack exposed a fact that the tree ring reconstructions of the past are not as reliable as some reports may have let the public believe.
 
  • #164


skypunter said:
Sylas,
Perhaps you know the answer to this.
Is it common for the newest tree rings to be unuseful as a proxy?
We learned in grammar school that tree rings undergo a change as they age, eventually becoming dead "heartwood" which is primarily strucural support for the tree. The younger, outer tree rings carry the nutrients to the rest of the tree, and so are surely of different composition and/or structure than the deadwood.
If this is not the case, then what might be the reason that they are eliminated from the dataset? What might cause unusual growth such as this?

I don't really know how common it is; but it is not universal. The divergence problem is specific to certain regions in the Northern Hemisphere forests. There are many other factors that have been considered (precipitation, pollution, non-linear response from heat stress, and plenty more) but the bottom line is that it is still an open question. The latter half of the twentieth century is marked by a number of significant changes in such factors in excess of rates of change over the last couple of millennia, so there are all kinds of credible possibilities. Here are some relevant references (also in [post=2453564]msg #9[/post] of a locked thread). Just reading these, especially D'Arrigo et al, would give better answers than I could manage; or it could be the basis for a new focused thread in the Earth forum.
  • Briffa, K.R. (2000) http://dx.doi.org/10.1016/S0277-3791(99)00056-6" , in Quaternary Science Reviews 19(1), pp 87-105.
  • D'Arrigo R. et. al. (2007) http://dx.doi.org/10.1016/j.gloplacha.2007.03.004" in Global and Planetary Change 60(3) Feb 2008 pp289-305

Cheers -- sylas
 
Last edited by a moderator:
  • #165


skypunter said:
The Germany analogy is offensive and highly inappropriate here. This is not fox news. People are not being exterminated, just used to promote schemes for financial gain and political power.

ROFL.. Allow me to elaborate on my "german anology"..someone's not an SNL fan:



http://www.youtube.com/watch?v=xKKaZhNXJe0&feature=related

http://www.youtube.com/watch?v=41lTZaHMTCw&feature=related

http://www.youtube.com/watch?v=zy_IxhLL5vQ&feature=related

I agree that there is a duty to the truth, but that doesn't mean we bury our heads in the sand at the first hint of impropriety.
 
Last edited by a moderator:
  • #166
meanwhile it seems that there is http://www.thegwpf.org/news-a-events.html :

Six days after Lord Lawson, the Chairman of the Board of Trustees of the GWPF, called for an independent inquiry into the CRU data affair, it would appear that such a public investigation may now be set up. It will be absolutely crucial that the inquiry is beyond reproach. For this reason, the Global Warming Policy Foundation calls for the inquiry to be carried out by a High Court judge...cont'd.

But this is not looking good:

SCIENTISTS at the University of East Anglia (UEA) have admitted throwing away much of the raw temperature data on which their predictions of global warming are based.

It means that other academics are not able to check basic calculations said to show a long-term rise in temperature over the past 150 years...cont'd
 
Last edited by a moderator:
  • #167


Count Iblis said:
Macintyre did not really correct a major eror, the hockey stick is still an accepted fact. All he did is point out that the result may be less statistically significant as proof that GW exists based only on the data that went into the hockey stick.

It is similar to astrophysicists doing loads of data processing on the shapes of far away galaxies in a cluster to extract the dark matter signal (dark matter would warp the apparent shape of galaxies via weak gravitational lensing). If some dark matter skeptic comes along and criticizes some statement by these astrophysicists on this being proof that dark matter really exists, because this is not 8 sigma proof but only 4 sigma, so be it.

LOL, Now you are backpeddling as you claim Macintyre "did not really correct a major eror". So you are splitting hairs between what constitutes an error and what a "major eror". Thats just too funny!

By the way have your read the Harry Readme file associated with their models? You really should because even the programmers who had the impossible job of trying to write the software for the models complained about the quality of data, and in fact numerous times in their comments on the code they admit to having to fudge and botch the programming.

Sorry mate but the party is well and truly over.
 
  • #168
Can anyone believe CRU actually dumped the raw temp data? So the end result being "trust us" because we don't have the raw data and you'll just have to take our word for it.

Is this a new precedent being set for scientific process? Ya right :-)
 
  • #169


Coldcall said:
... Sorry mate but the party is well and truly over.

That may be a bit premature. Whereever the truth is, it's not going to bother http://www.citeman.com/3177-group-think-and-group-shift/ a lot.
 
Last edited by a moderator:
  • #170


Andre said:
That may be a bit premature. Whereever the truth is, it's not going to bother http://www.citeman.com/3177-group-think-and-group-shift/ a lot.

Oh it will eventually because CRU have now made a big U-turn and agreed to release all the data they have (of course that won't include the data they conventiently dumped).

Climategate will also now make it possible for other climate researchers who are sceptics come out of the closet and i think the final end for the agw hysteria will be led by principled scientists who are sick of having their repuation tarnished by the anti-scientific practices of people like Jones, Mann, Hansen, Briffa et al.
 
Last edited by a moderator:
  • #171
Andre said:
meanwhile it seems that there is http://www.thegwpf.org/news-a-events.html :

Yes. I agree this is an appropriate response. I've already linked to the BBC original for this back in [post=2463251]msg #145[/post], and again in [post=2463317]msg #154[/post]. The story is Inquiry into stolen climate e-mails, an early look at the inquiry now being set up, by Roger Harrabin for the BBC.

But this is not looking good:

There's a certain irony in that. This is a story alleging that original raw data has been lost; but does not let you discover the original sources for their story.

As described, the story is incorrect in the details -- like many other stories that have been rapidly circulating based apparently on assuming the worst. It is also old news; not some new discovery in the light of the stolen emails.

The real details of what is alleged in this story is contained in the CRU page on data availability, which is currently down precisely because of the problems caused by the illegal access. However, the information can still be found in, for example, a google cache of the page. The original https://www.cru.uea.ac.uk/cru/data/availability/, and I am using a snapshot of the page as it appeared on 21 Oct 2009 12:27:45 GMT, shortly before the hack.

We are not in a position to supply data for a particular country not covered by the example agreements referred to earlier, as we have never had sufficient resources to keep track of the exact source of each individual monthly value. Since the 1980s, we have merged the data we have received into existing series or begun new ones, so it is impossible to say if all stations within a particular country or if all of an individual record should be freely available. Data storage availability in the 1980s meant that we were not able to keep the multiple sources for some sites, only the station series after adjustment for homogeneity issues. We, therefore, do not hold the original raw data but only the value-added (i.e. quality controlled and homogenized) data. The priorities we use when merging data from the same station from different sources are discussed in some of the literature cited below. Parts of series may have come from restricted sources, whilst the rest came from other sources. Furthermore, as stated in http://www.cru.uea.ac.uk/cru/data/landstations/ we have never kept track of changes to country names, as it is only the location and the station's data that are important. So, extracting data for a single country isn't always a simple task.[/color]​

This isn't new information; it's been known for some time, and is a major reason many of the FOI requests cannot be granted.

The claim that original data is now gone is simply incorrect. The original data is, as always, kept with the owners of that data -- the various national bodies who keep their own national weather and climate records. They have it still.

The backdrop to this -- which is perfectly apparent if you read more of the hacked emails in a real attempt to figure out the whole story, rather than merely isolated examples chosen to suggest the worst of the scientists involved -- is a long standing campaign of harassment from individuals who cannot or will not accept the constraints under which the CRU is obliged to act. It's led to a dreadful situation of frustration and anger on the part of the scientists, and with good reason.

There is also a common misunderstanding of what replication means in science. Genuine replication does not mean getting exactly the same data and repeating exactly the same calculations. That is more of a verification or audit; which might indeed be a useful internal exercise for an organization, if they have the resources.

Scientific replication means another independent collection of data, preferably from independent data sources. With historical data that is not always possible; but certainly there are other major efforts that repeat the same measurement, but using different data as they can obtain themselves and using different algorithms. If you don't trust the CRU... then use one of the others. If you don't trust them either; then do it yourself. Get as much raw data as you can -- the vast majority of it is readily available -- and repeat a calculation. It's a big job but not actually prohibitive. If you don't get approximately the same result using the 95% of the data that has always been available, then that is a genuine exposure of a problem... in your processing or in theirs.

The problem with the so-called skeptics is that they just want to take the data already assembled by others. There's nothing wrong with that... except that they want ALL of it, NOW, and will not accept that this can't actually be legally done, unfortunately.

The major advantage of a truly independent inquiry is that it would not be merely a witchhunt to seek out any failings of the CRU staff, but would actually look at all aspects of the difficulties of dealing with critics who will never be satisfied under any circumstances.

Cheers -- sylas
 
Last edited by a moderator:
  • #172
if they don't have original data, then everything is suspect. you might as well start over.
 
  • #173
Sylas,

"The claim that original data is now gone is simply incorrect. The original data is, as always, kept with the owners of that data -- the various national bodies who keep their own national weather and climate records. They have it still."

CRU has admitted dumping their raw temp data. That data was primary for the alarmist models they have produced and the fact they dumped it is in itself tremendously serious failure of traditiional scientific methodology.

So in order to validate CRU's models someone is going to have to collate all that temp data all over again.

One would think that when making such catastrophic predictions the scientists behind such work would feel inclined to have kept their raw data available for colleagues to re-check the validity of proxies emanating from that raw data.

In fact even more disturbing is that CRU only admitted to having dumped all their raw data after various requests from Macintyre which had gone totally unanswered.

You can spin this anyway you want but in my opinion this is a huge scientific fraud and will remain so until the raw data has been collated once again and checked against the "homogenized" data which was used for the alarmist models.

This is science and in science there is no such thing as a benefit of doubt. Those models today are worthless because they cannot be reverse engineered without the raw data.
 
  • #174
put crap in, you'll get crap out. Reading the Harry ReadMe file, one can obviously see that there was a lot of inaccurate crap that ended up in the so-called "homogenised data".

Hence any model emanating from that crappy input will inevitably be bigger crap.
 
  • #175
There really is no excuse for dumping raw data. A hard copy would suffice.
No data...no publish.
 
  • #176
skypunter said:
There really is no excuse for dumping raw data. A hard copy would suffice.
No data...no publish.
This is my understanding as well. In my profession, we must maintain 'traceability'. We can't simply report final results and be done with it. We must maintain records of inputs and developments of models to the 'raw data'.

AFAIK, any scientist must retain raw measurments in a lab book, so that anyone can go back to the 'source' and perform an independent review.

If data is destroyed, that is troublesome. Either the persons who destroy the data are sloppy or they are being inappropriate, if not dishonest.

Now - it appears that UEA CRU is one of several/many datasets. If one rejects (throws out) CRU's models (based on their homogenized data), do the other datasets (and derived models) still show an increase in corresponding temperature (mean/average/. . . .)?

From where I sit, I see the opponents of CC/GW/AGW claiming bad/dubious/questionable science on the part of proponents of CC/GW/AGW, and the fact that proponents (more so alarmists) have politicized the process. However, also note that opponents (particularly so-called skeptics/deniers) are equally guilty in this regard.
 
  • #177
Astronuc said:
From where I sit, I see the opponents of CC/GW/AGW claiming bad/dubious/questionable science on the part of proponents of CC/GW/AGW, and the fact that proponents (more so alarmists) have politicized the process. However, also note that opponents (particularly so-called skeptics/deniers) are equally guilty in this regard.
While I agree, that's a completely irrelevant red herring, isn't it? The fact that some/many(?) skeptics/deniers commit scientific fraud or even just mislead with propaganda does not change the burden on the proponents at all. **If anything, when the proponents do the same thing it implies the case is weaker than the scientific consensus -- which is what we are finding here with this specific issue.**

Someone posted earlier, a Rush Limbaugh link(tongue-in-cheek?) , saying that since Rush Limbaugh says Global Warming is a hoax, that's proof that it is real. But it doesn't really work that way, does it?

But I've gotten the impression from some global warming proponents that lying/manipulation -- ie, propaganda -- is ok when the issue is important enough.

**Edit: very sloppy wording corrected.
 
Last edited:
  • #178
russ_watters said:
While I agree, that's a completely irrelevant red herring, isn't it? The fact that some/many(?) skeptics/deniers commit scientific fraud does not change the burden on the proponents at all.

Someone posted earlier, a Rush Limbaugh link(tongue-in-cheek?) , saying that since Rush Limbaugh says Global Warming is a hoax, that's proof that it is real. But it doesn't really work that way, does it?

Agreed. Just because there are unsavoury characters jumping on the sceptic bandwagon does not justify the actions at CRU.

Equally agw could be quite correct and the poor conduct of a few climate scientists does not falsify the its premise.

As an agnostic I am hoping that regular everyday scientists who work on really difficult projects which don't make the headlines are the ones infuriated at the behaviour of these gold plated funded climate scientists at CRU. Its been reported Dr Phil Jones has been the recipient of over $20million in funding in recent years. That's a lot more money than most scientists will ever see in a lifetime of funding.

Time for the silent majority in the scientific community to get mad because (in my opinion) the CRU emails stains the whole community.

There is also another really serious angle to this. Let's say we discover that humans are not primarily responsible for climate change. Science is going to have a really hard time ever being taken seriously again by government. There could be a really serious threat in the future from some direction and the public and the government will just glaze over and think "here we go again".

So i am gobsmacked when i see scientists hand waving away this scandal because it is likely to have a serious impact on future careers, funding, and how science is viewed by the wider community.
 
  • #179
Coldcall said:
There is also another really serious angle to this. Let's say we discover that humans are not primarily responsible for climate change. Science is going to have a really hard time ever being taken seriously again by government. There could be a really serious threat in the future from some direction and the public and the government will just glaze over and think "here we go again".

So i am gobsmacked when i see scientists hand waving away this scandal because it is likely to have a serious impact on future careers, funding, and how science is viewed by the wider community.
Maybe that the practice of science will eventually be improved by this mess.
Open sourcing would make information available to a much larger set of creative minds.
Am I being overly optimistic?
 
  • #180
Astronuc said:
This is my understanding as well. In my profession, we must maintain 'traceability'. We can't simply report final results and be done with it. We must maintain records of inputs and developments of models to the 'raw data'.

AFAIK, any scientist must retain raw measurments in a lab book, so that anyone can go back to the 'source' and perform an independent review.

If data is destroyed, that is troublesome. Either the persons who destroy the data are sloppy or they are being inappropriate, if not dishonest.

I'm not so sure it is quite that simple. Sure; it would be better to keep everything you can, but it looks as if what was lost/destroyed/deleted/whatever is not actually original data at all; but merely the copies sent the the CRU. The original data in this context is, and always has been, maintained by the overseas meteorology institutes that released copies to the CRU for their limited use under a promise of confidentiality. There's nothing in principle preventing others requesting that data from the source as well; but it does have commercial value in some of these other jurisdictions and you can't presume a right to availability.

Large amounts of data were involved, apparently, and it all had to be brought into a common unified format. I think it may be the case that the large combined databases are still there; because there is (and has been for some time) an ongoing effort by the CRU to arrange for permissions required to let this combined database of underlying data be made available.

This was all first collated back thirty years ago or so, it seems; and though I can well believe processes were not up to the highest standards of data management, I really think it is unlikely anyone ever expected the kind of campaign that is going on now. We are not just talking notebooks here; but rather collating a lot of data into a common record. Although I do tend to agree that keeping everything is best; it's not really that unusual to have raw data records from decades into the past not actually archived indefinitely, particularly back in the 80s.

Now - it appears that UEA CRU is one of several/many datasets. If one rejects (throws out) CRU's models (based on their homogenized data), do the other datasets (and derived models) still show an increase in corresponding temperature (mean/average/. . . .)?

Yes. And furthermore this kind of independent work is far more useful scientifically than an audit of an existing experiment. You can get the vast majority of the underlying data behind the CRU datasets now; and that is enough to replicate the results in the more usual scientific sense, of doing an independent calculation of your own rather than auditing someone else's calculations.

At the same time there are two other major independent projects that do pretty much the same thing. They are not entirely independent because there's a lot of overlap in the underlying data used... but the overlap occurs precisely in that data that IS available for anyone else to have a look at. The ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/v2/ (link to the ftp site at NCDC). I've this data myself a couple of times.

I have given the references and links for the three main professional level global anomaly constructions in [post=2464019]msg #17[/post] of "Climate Science Update".

From where I sit, I see the opponents of CC/GW/AGW laiming bad/dubious/questionable science on the part of proponents of CC/GW/AGW, and the fact that proponents (more so alarmists) have politicized the process. However, also note that opponents (particularly so-called skeptics/deniers) are equally guilty in this regard.

I won't presume actual "equality"; but I do support the idea of an independent inquiry with terms of reference that would allow them to consider both the nature of the response within the CRU to the actions of "skeptics"; AND the actions of the "skeptics" which have been such a source of frustration and distraction to the scientists. If the guilt turns out to be "equally" shared; so be it. If it's not a matter for "guilt" but simply a matter of dealing with the conflicts in better ways; great. But look at the whole thing. This will take some time, of course; and meanwhile in some quarters there will be no let up in the mutual wars of words, unfortunately.

I'm not that much concerned to deal with ethical judgments. My major concern is to clear up some simple underlying facts that should be the basis of any judgment anyone cares to make. Specifically, in this case, the loss of raw data is not quite as has been reported. The raw data is still out there; all that was "lost" is copies given to the CRU once they had collated them into a combined record... I think. We'll know better when the CRU is able to release that underlying data, as they have been working towards now for some time. The never-ending flood of demands and FOI requests and speculative attacks on certain notorious blogs that has been ongoing now for ages, is a pretty clear indication that nothing will ever satisfy a certain vocal minority. A recurring theme is that the scientists should simply open everything up right now; and that is neither legally nor pragmatically possible, nor would it help as much as everyone seems to think.

Cheers -- sylas
 
  • #181
skypunter said:
Maybe that the practice of science will eventually be improved by this mess.
Open sourcing would make information available to a much larger set of creative minds.
Am I being overly optimistic?

Open sourcing would be a great idea. Especially for this type of climate science which is then used by politicians and has an effect on all of us. The very idea that publicly funded *raw* climate data from around the world is not available to all researchers is a disgrace.

If agw is as serious as these people claim then there appears no good reason not to make the data publicly available.
 
  • #182
Coldcall said:
Its been reported Dr Phil Jones has been the recipient of over $20million in funding in recent years. That's a lot more money than most scientists will ever see in a lifetime of funding.
Red herring, and no, it's not a lot of money. That amounts to a few million a year, and that is the funding for the entire CRU. That is a rather small budget.

There is also another really serious angle to this. Let's say we discover that humans are not primarily responsible for climate change. Science is going to have a really hard time ever being taken seriously again by government. There could be a really serious threat in the future from some direction and the public and the government will just glaze over and think "here we go again".
The problem here is not so much with the government but the people. As far as politicians are concerned, scientists are a bunch of convenient fools. Politicians of all ilk only care whether scientists say something that furthers or interferes with their political agenda. If science happens to say something that comports with a politician's world view, great. Fund it. If science says something otherwise, squash it. Politicians don't give a hoot about scientific truth.

What this could do to the public perception of science is another matter. The US at least has always been plagued with a decidedly anti-intellectual bent. This will only encourage that sentiment.
 
  • #183
Coldcall said:
Open sourcing would be a great idea. Especially for this type of climate science which is then used by politicians and has an effect on all of us. The very idea that publicly funded *raw* climate data from around the world is not available to all researchers is a disgrace.

If agw is as serious as these people claim then there appears no good reason not to make the data publicly available.

Once again, with feeling. The raw data is from all over the world, and it is owned by all sorts of different national meteorological bodies with different jurisdictions and commercial interests in the data -- and in many case the organizations are contractually obligated to consider the commercial value of their own data.

However much you'd love to have immediate access to everybody's data from all over the world right now; and no matter now important ANYONE thinks it is; you just can't do that.

In the mean time, the vast majority of the data being used IS available, and always has been. Vast amounts of code ARE open source (in particular, the climate models used by NASA).

The ongoing meme about a serious problem with hidden data is codswallop. There's a vocal band of "skeptics" who have done an excellent job of promulgating this idea of hidden data, by honing in on small bits of the data that they just can't have, or even raising a ruckus about data that IS available because hard working scientists won't take time out to hold their hand through an endless series of questions about finding stuff; especially when the major apparent use of the data is to produce incompetent error ridden criticisms. I am not kidding. The frustration of scientists about this is enormous; and if you read ALL the stolen emails (it will take a long time) you will get some pointers to some of this background.

One response to this has been mentioned in the thread already. It is (yet another) directory to help newcomers or interested amateurs find their way around the mountain of information that has been available now for years.

See: Data Sources: a catalog of publicly available data and code relating to climate. Nothing there is new; it is just a simple list to help you discover the world of code and data that is out there.

Cheers -- sylas
 
Last edited:
  • #184
D H said:
Red herring, and no, it's not a lot of money. That amounts to a few million a year, and that is the funding for the entire CRU. That is a rather small budget.


The problem here is not so much with the government but the people. As far as politicians are concerned, scientists are a bunch of convenient fools. Politicians of all ilk only care whether scientists say something that furthers or interferes with their political agenda. If science happens to say something that comports with a politician's world view, great. Fund it. If science says something otherwise, squash it. Politicians don't give a hoot about scientific truth.

What this could do to the public perception of science is another matter. The US at least has always been plagued with a decidedly anti-intellectual bent. This will only encourage that sentiment.

The amount of money is relative to the field of scientific research. Climate research is relatively well funded compared to other more obscure subjects. And i reckon $20million is enough for them not to have to suffer from the apparent lack of resources and poor climate databases moaned about by coders in the harry_read_me file and others.

While I agree with some of your points above i don't think its fair to pass this one off on the fault of politicians. Its vital that if politicians are going to be influenced by an "intellectual bent" then it should be based on proper science and those scientists advising should be conducting themselves with the highest possible standards in scientific method.
 
  • #185
Sylas,

"Once again, with feeling. The raw data is from all over the world, and it is owned by all sorts of different national meteorological bodies with different jurisdictions and commercial interests in the data -- and in many case the organizations are contractually obligated to consider the commercial value of their own data."

Exactly why they should have kept the raw data drom all these disparate sources! They put together a dataset from a wide variety of sources and that process is of fundamental importance to methodology behind their models.

What you are suggesting is that its okay for them to throw away that raw data and make it that much more difficult to reproduce their work in order to validate process, methods involved in setting proxies.

So any scientist who wants to replicate their "experiment" now has to go all request all the same old raw data from all those organisations.

You sure you have the best interest of science in mind? Doesn't sound like it to me.
 
  • #186
sylas said:
The problem with the so-called skeptics is that they just want to take the data already assembled by others.

This is simply not true. The request for data has always been the urge to duplicate the information processing. See how it has been done and if that was to be acceptable.

Nice insinuation with the use of "so called". To a lot of people sceptics stands as equivalents for greedy pocket fillers with oil money, crackpots (no straw man - you did not say it), etc. Maybe, one day, it will be scrutinized why these scientists had to be character murdered.

Let's introduce a few, here for instance, in Solomons book "The Deniers"

Or the signees of http://www.cato.org/special/climatechange/alternate_version.html
 
Last edited by a moderator:
  • #187
Coldcall said:
And i reckon $20million is enough for them not to have to suffer from the apparent lack of resources and poor climate databases moaned about by coders in the harry_read_me file and others.
$20 million isn't all that much. Most research project that last a few years will have multi-million dollar budgets. Remember that even just a single PhD student can easily cost about $0.5 million (over four years) once you factor in salary, social security, office space, additional equipment etc and a senior scientist will cost several times that amount. And then you need to add in the cost for equipment and lab space for the actual research. My time is about £50 an hour or so in our internal budgets (I am a research assistant in the UK).

I was recently involved in writing a grant application for a relatively small project (solid state physics) involving 4-5 senior scientists (none of them full time) plus a post-doc and a PhD student. As far as I remember the budget was about £2 million over four years.
 
  • #188
Coldcall said:
Sylas,

"Once again, with feeling. The raw data is from all over the world, and it is owned by all sorts of different national meteorological bodies with different jurisdictions and commercial interests in the data -- and in many case the organizations are contractually obligated to consider the commercial value of their own data."

Exactly why they should have kept the raw data drom all these disparate sources! They put together a dataset from a wide variety of sources and that process is of fundamental importance to methodology behind their models.

What you are suggesting is that its okay for them to throw away that raw data and make it that much more difficult to reproduce their work in order to validate process, methods involved in setting proxies.

So any scientist who wants to replicate their "experiment" now has to go all request all the same old raw data from all those organisations.

You sure you have the best interest of science in mind? Doesn't sound like it to me.

I think you still don't get it. They can't give you that data. It isn't theirs to give. When all the various data sources were collated, they had the start of what they could work with as a global data set; and it still includes all the individual stations -- including those additional stations for which they can't release the data.

It might be possible to trawl through and pull out the individual records that have restrictions on redistribution; but that's a massive amount of additional work; the data was never set up with the intent of doing that. And why would you bother? What you would end up with is pretty much the GHCN data -- which IS available -- plus a bit extra maybe. You couldn't use that to get a perfect audit of the CRU result; but you could use it to get an independent cross check -- and that has already been done anyway!

What the CRU is trying to do -- and they've been working towards this for a while now -- is get permissions from everyone involved to make the whole collated data available. That requires co-ordination with a whole pile of national bodies that work under different regulations and ideas for the value of their data.

What do you think I should do to show that I support the free exchange of data? And I certainly do. Shall I raise up and army and overthrow other nations and organizations that treat data as a commercial asset? Shall I demand the CRU release everything right now regardless of their existing legal obligations? WHAT?

In the meantime, the big bad CRU when it started out this work long ago went around and obtained formal permission to use a whole pile of data -- the more data the better, right? Now (for shame!) it turns out that you can't get hold of it yourself to audit every last detail of their calculations. It also turns out that some of the individual records were not archived after they were merged into the global set that people actually use.

Some folks seem to think that is terrible. I'm rather "meh" about it, honestly. The data isn't lost; it's still maintained by the original owners of it. It is just copies that were no longer needed. Sure, in the modern day and age it would have been better to keep everything; but that's actually pretty expensive and they probably never even imagined this ludicrous state of affairs now. But suppose they find it again, in closet that has been overlooked. What changes?

NOTHING. You don't actually use that data; you use the merged data. Do you want to audit the process of putting it together? OK; I don't see any great value in that, but there's no harm in it. Once you get over the hurdles of obtaining all the permissions you need! Which will be much much harder with these sets than with the single collated set. But suppose we get those permissions. Given all the other independent calculations around we already know it isn't going to make substantial differences even if any errors are found; but it's still a nice thing to do. But wait! Can you be sure the files in the closet are correct? Why not audit them against the original data? Where does it end? What what difference does it make?

----

Tell you what; you plainly are not convinced and think there's something deeply wrong with the work the CRU has been doing. So forget the CRU. Use the GISS datasets instead. In that case you DO have access to all the data and all the code. Is that going to satisfy you? Surprise me. Here's the ftp site which will take you though the code, the makefiles, the raw data, and the procedures required to put it all together into anomalies.
ftp://data.giss.nasa.gov/pub/gistemp/[/URL][/indent]

Here's another clue for you. This is not just a game. It isn't just some media savvy trick in response to the CRU hack. It's a different independent analysis -- and THAT is far more useful scientifically than an audit. Further more it has been there for some time.

I've used this myself; for some time now. I have not simply compiled their code; I prefer to write my own. (I tried it at first, but I didn't have a suitable fortran compiler available and anyway I wanted the flexibility to try out processes of my own.) I have repeated various parts of the calculations that are of interest to me. Not a complete audit, but a fair bit all the same. I've written a suite of programs of my own to trawl through the raw data and pull out records I want for whatever reason. I haven't done anything much with it for some months now; but at the time I did a repeat calculation -- completely independent with my own programs -- of a regional anomaly around the continental USA, in order to test out some ideas for myself about the alleged problems with certain USHCN stations.

The data is there. Now what do [u]you[/u] propose to do with it?

Cheers -- sylas​
 
Last edited by a moderator:
  • #189
f95toli said:
$20 million isn't all that much. Most research project that last a few years will have multi-million dollar budgets. Remember that even just a single PhD student can easily cost about $0.5 million (over four years) once you factor in salary, social security, office space, additional equipment etc and a senior scientist will cost several times that amount. And then you need to add in the cost for equipment and lab space for the actual research. My time is about £50 an hour or so in our internal budgets (I am a research assistant in the UK).

I was recently involved in writing a grant application for a relatively small project (solid state physics) involving 4-5 senior scientists (none of them full time) plus a post-doc and a PhD student. As far as I remember the budget was about £2 million over four years.

I'm sure you guys could use more money so I'm not going to argue about it but they certainly had enough money to make sure they were properly resourced to come to such extreme conclusions re agw.
 
  • #190
Andre said:
Nice insinuation with the use of "so called".

It's not intended simply as an insinuation, but as a serious problem I have with what is often incorrectly called skepticism. And note, none of the people I was alluding to that instance were scientists. Of those involved in the whole FOI harassment (people are going to object to that word as well, but it is very apt) McIntrye would be the closest to a scientist, and I am also willing to call him a skeptic.

Skepticism is a very good thing and an essential part of a genuinely scientific attitude. I am not saying that there is no such thing as a genuine climate skeptic. Of course there is.

On the other hand, there are many people around who describe themselves as skeptics, but who don't measure up as skeptics, IMO. It is a kind of faux-skepticism, and often a deep conviction that AGW is all wrong; and this is in full hue and cry at the moment all across the internet.

You can see this most plainly, perhaps, in the speed at which rumours and stories are picked up and seized upon and then treated as gospel. As soon as any paper comes out which has any possibility of being seen as a criticism of conventional climate science, it sweeps across the internet within a day of publication and sometimes even before hand, as the new proof that AGW is all wrong. That isn't skepticism. It is the opposite of skepticism; it is credulous naivety.

I have another problem here, because I don't want to single out any individuals as false skeptics, particularly people here engaging in the discussions. I tend to assume good faith all around with the people I debate. It's only a couple of individuals who really go the whole hog with simplistic immediate acceptance of any alleged problem with conventional climate science; and I think most of the really bad faux-skeptics would have a bit of a problem at physicsforums. The way the site works, there seems to be some natural weeding out of the worst cases.

Now I could avoid giving any offense by simply avoiding such insinuations about climate skepticism. But on the other hand -- particularly here in the politics forum -- I think a major part of the reason climate is such a hot button issue is actually because so much of it is being driven by "so-called skeptics"; and those who are genuinely skeptical and unsure of what to trust and careful about jumping to conclusions can end up being unsure of what to believe.

I've previously mentioned the comparison with creationism, or perhaps better "Intelligent Design" in biology. It's not a perfect match, but I think there's a lot in common. Interestingly, there is a certain amount of overlap in the people also! There's a strong resistance to the conclusions of a certain field of science; a spurious notion that there is actually a substantial and credible scientifically based objection to the main conclusions of that field; and a credulous naivety on the part of many individuals that makes education a far from straightforward matter of just explaining with better information. There's a mental block at work as well.

Now of course there are many people who disagree with me vehemently with this comparison; or who think that I (and, I suppose, all the various scientists who accept anthropogenic global warming as a solidly established discovery) are the ones who are being naive and failing to have proper skepticism.

That doesn't bother me all that much. It underlines that there is a massive gap here; and usually I prefer to address the scientific issues case by case by case in the science related forum; for anyone to read and consider.

Sorry, I am rambling a bit here. The point is; a lot of climate skepticism I really do not consider to be actual skepticism at all; rather just the reverse.

Cheers -- sylas
 
Last edited:
  • #191
Sylas it just won't work that way I think. Most people see very linear, they think that CRU is the centre organization for all climate research and whatever happens to them effects all research ever done by any organization on the climate. I've already posted many links to data and sourcecode and so far no one here has come up to the challenge to take the data and sourcecode and show where other organizations have gone wrong with their data. There is even that link actually to that 'directory' of data sets and sourcecode.

I'll assume that most people on here don't actually know what to do with the data and are just going to keep crying because certain media outlets are saying 'this and that'. So the skeptics propaganda has worked against the CRU and so far it's working against climate research as a whole. Sucks but who cares?

Most people here do not understand what 'skepticism' is climate research in relation to the CRU so they don't understand fully what is going on. Regardless of how well you explain it they just won't see eye-to-eye in my opinion. Which is why I gave up on this thread after I posted the data.
 
  • #192
Sylas,

"I think you still don't get it. They can't give you that data. It isn't theirs to give. When all the various data sources were collated, they had the start of what they could work with as a global data set; and it still includes all the individual stations -- including those additional stations for which they can't release the data."

Why does every post you make begin with an assumption that i am "just not getting it"? I get it very well thank you. To suggest otherwise is very patronising, and is very represenative of the sort of attitude taken by the agw lobby. Howabout i just don't agree with you? Okay?

The fact is CRU only recently announced they had dumped all the data. So if it is common practice as you are implying then why not come out much earlier before the FOI requests are piling up and just say: "we can't give you the raw data becaus we dumped it", instead of what they did was first to say they couldn't because they did not have the right to distribute - impying they still held the raw data.

Listen you won't convince me there is no fire here, and please don't insult my intelligence by resorting to questioning whether i "get it".
 
  • #193
Coldcall said:
Sylas,

"I think you still don't get it. They can't give you that data. It isn't theirs to give. When all the various data sources were collated, they had the start of what they could work with as a global data set; and it still includes all the individual stations -- including those additional stations for which they can't release the data."

Why does every post you make begin with an assumption that i am "just not getting it"? I get it very well thank you. To suggest otherwise is very patronising, and is very represenative of the sort of attitude taken by the agw lobby. Howabout i just don't agree with you? Okay?

The fact is CRU only recently announced they had dumped all the data. So if it is common practice as you are implying then why not come out much earlier before the FOI requests are piling up and just say: "we can't give you the raw data becaus we dumped it", instead of what they did was first to say they couldn't because they did not have the right to distribute - impying they still held the raw data.

Listen you won't convince me there is no fire here, and please don't insult my intelligence by resorting to questioning whether i "get it".

Question: Because CRU dumped raw data for whatever purpose (I haven't been keeping up with this anymore because it doesn't really matter to me anymore) how does this effect AGW? Makes their position stronger? How does this effect global cliamate research from other organizations? Discredits them even though they have had public available data for the longest time?
 
  • #194
badea chem said:
Forum chemistry students
url deleted

What link has this with CRU ?

Besides, Google reports this site as malicious:


*********************************************************************
What is the current listing status for **url deleted **?

Site is listed as suspicious - visiting this website may harm your computer.

Part of this site was listed for suspicious activity 4 time(s) over the past 90 days.


What happened when Google visited this site?

Of the 118 pages we tested on the site over the past 90 days, 38 page(s) resulted in malicious software being downloaded and installed without user consent. The last time Google visited this site was on 2009-11-29, and the last time suspicious content was found on this site was on 2009-11-27.

Malicious software includes 1 trojan(s), 1 exploit(s). Successful infection resulted in an average of 1 new process(es) on the target machine.

Malicious software is hosted on 1 domain(s), including cosa83.se/.

This site was hosted on 1 network(s) including AS4323 (TWTC).
***************************************************************
 
Last edited by a moderator:
  • #195
Sorry! said:
Question: Because CRU dumped raw data for whatever purpose (I haven't been keeping up with this anymore because it doesn't really matter to me anymore) how does this effect AGW? Makes their position stronger? How does this effect global cliamate research from other organizations? Discredits them even though they have had public available data for the longest time?

Sorry,

Let not confuse matters intentionally :-) I think you are perfectly capable of reading this thread and the basic complaints being made about the behaviour at CRU re openess to scrutiny.
 
  • #196
DanP said:
What link has this with CRU ?

Besides, Google reports this site as malicious:


*********************************************************************
What is the current listing status for **url deleted **?

Site is listed as suspicious - visiting this website may harm your computer.

Part of this site was listed for suspicious activity 4 time(s) over the past 90 days.


What happened when Google visited this site?

Of the 118 pages we tested on the site over the past 90 days, 38 page(s) resulted in malicious software being downloaded and installed without user consent. The last time Google visited this site was on 2009-11-29, and the last time suspicious content was found on this site was on 2009-11-27.

Malicious software includes 1 trojan(s), 1 exploit(s). Successful infection resulted in an average of 1 new process(es) on the target machine.

Malicious software is hosted on 1 domain(s), including cosa83.se/.

This site was hosted on 1 network(s) including AS4323 (TWTC).
***************************************************************
That was spam. Spam was deleted and spambot destroyed.
 
  • #197
Coldcall said:
Sorry,

Let not confuse matters intentionally :-) I think you are perfectly capable of reading this thread and the basic complaints being made about the behaviour at CRU re openess to scrutiny.

I'm not confusing matters intentionally. Most posts from here indicate the poster thinks that since this hack of CRU has occurred that the position for global warming is pointless skeptics were right all along etc. etc. I'm asking you what your position is on this.
 
  • #198
Maybe that this hack gives further food to the possible thought that AGW has been constructed, like for instance:

http://epw.senate.gov/hearing_statements.cfm?id=266543

I received an astonishing email from a major researcher in the area of climate change. He said, "We have to get rid of the Medieval Warm Period."

or Chris Landsea:

I found it a bit perplexing that the participants in the Harvard press
conference had come to the conclusion that global warming was impacting
hurricane activity today. To my knowledge, none of the participants in that
press conference had performed any research on hurricane variability, nor
were they reporting on any new work in the field. All previous and current
research in the area of hurricane variability has shown no reliable,
long-term trend up in the frequency or intensity of tropical cyclones,
either in the Atlantic or any other basin.

Or http://www.publications.parliament.uk/pa/ld200506/ldselect/ldeconaf/12/12we21.htm

It would also be interesting to know which side of these stories relates to Sylas:

comparison with creationism, or perhaps better "Intelligent Design" in biology
 
Last edited:
  • #199
Andre said:
It would also be interesting to know which side of these stories relates to Sylas:

Exactly. I think we can all agree that this issue involves, somewhere, something that is not quite kosher. Skeptics who aren't skeptical, or scientists who aren't scientific, and some people who are letting their social or political or economic or self-interest views drive their opinions about scientific questions relating to climate.

I think we can all agree that there are a whole pile of people who are not facing up to the obvious that (take your pick)... (1) climate is really uncertain and there's no good evidence to sort out with any confidence what is causing climate changes, if any, or what they might do in the future -- or (2) the evidence has established pretty solidly that the planet is warming primarily under the influence of an anthropogenic enhanced greenhouse effect, and will continue to do so.

Which ever side you want to think has gone off the rails of rational consideration of available evidence; there's something here a bit like the whole Intelligent Design debate.

The trick, somehow, is to continue to engage robustly with the various topics that crop up, without getting too angry with one another; and seeing if we can all relax and share a beer or a joke at the end of the day.

One of the aims I try to keep in mind (and I don't always succeed) is that you can't change the mind of another person against their will. If anyone does happen to change their mind on something, that is invariably something they do for themselves, on their own time. A simple error of fact can often be picked up and corrected and everyone moves on; a major shift in perspective is less easy. It can happen... many of us have experienced something like that once or twice... but when it occurs it occurs in stages.

For me, a debate is a success when two sides have been able to express their perspective or input for consideration of each other -- and other readers. Whether someone later actually shifts a view point is their own business; not mine. I have enough trouble trying to keep myself as honest as I can. My own personal biggest win is when I learn something new for myself. I presume it is the same for others.

Cheers -- sylas
 
  • #200
sylas said:
Of those involved in the whole FOI harassment (people are going to object to that word as well, but it is very apt) McIntrye would be the closest to a scientist, and I am also willing to call him a skeptic.

Then stop calling it harassment. The tree ring data were hidden for years. The data finally did come out recently, but that was by mistake rather than by intent.

I've previously mentioned the comparison with creationism, or perhaps better "Intelligent Design" in biology. It's not a perfect match, but I think there's a lot in common.
There are complete idiots on both sides of this issue.

It is time for a truce and it is far past time to stop with the name calling. I'm guilty of this, too. I will stop calling you a true believer (a definite perjorative). Would you please refrain from perjoratives such as denier/denialist and comparisons with creationism?
 
Back
Top