Pages: 1 [2] 3 4 5 6
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-10-08 09:33:26

Milo confirms that the cpdn server is short of space and says it will take a day or two to fix. At the moment cpdn model trickles are being accepted by the server, but not zip file uploads. This has now been confirmed for all cpdn models, both coupled and slab. Please see the previous post for when your model will create its next zip file.

The best plan of action is to either

* suspend network activity well before you reach a zip file point

* or if you can't suspend network activity, suspend the model instead so it doesn't reach a zip file point while the problem lasts

Beta, BBC and SAP models can upload files.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-10-09 17:22:59

For CPDN members - does not apply to SAP, CPDN bet or BBC

Milo says the problematic server is up and running again 'for the moment'. My own zip file that couldn't upload has just uploaded. So boinc network activity can be allowed again.

But until the new server is delivered and installed in Oxford it would be a good idea to

* Check your boinc manager Transfers window regularly to ensure that no file is stuck there unable to upload

* Check your boinc manager messages each day if you can. If you have an up-to-date version of boinc, messages indicating a problem will be coloured red

* Check this news thread regularly

* If you only run climate models (not other projects with short tasks) remember you can if you wish keep boinc network activity suspended most of the time and only allow it once a day/week (or month in a few situations!)
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-10-29 23:37:58

We've just discovered that CPDN credits haven't been sent to the stats sites for two days, though BBC and SAP credits seem to getting through normally. Milo has been informed.

When there's a stats glitch everyone receives their correct credits eventually so there's no need to panic.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-10-30 22:46:25


Milo has fixed this and our CPDN credits on the stats sites have updated.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-11-01 03:04:37


    * On Wednesday, CPDN credits again did not export to the external stats sites, though CPDN beta, SAP and BBC credits did. We are receiving our credits within CPDN but they are not being reported to these sites. This problem could perhaps take until next week to resolve fully.

    * Again on Wednesday, some CPDN members reported that their HADCM 10-year zip files or HADSM end-of-phase zip files failed to upload to the CPDN server. They received the boinc manager message 'No space left on device'. The device in question is the server whose disk is full (not our home computer disks). Trickles appear to be accepted normally; the problem is the zip files.

    * Tolu has been informed.

    * Until the problem is resolved, if you have a zip file waiting to upload in the boinc manager Transfers window, suspend network activity. We realise that this is difficult for multi-project crunchers. The ideal is to avoid multiple failed upload attempts.

    If your HADCM model is approaching the end of a decade (eg Dec 1 2030), or your HADSM is approaching the end of a 15-year phase, suspend network activity before it creates the zip file. Multi-project crunchers who need network activity could suspend their model in the Tasks tab (while setting CPDN to No new work in the Projects tab) before the zip file is created.

    * Otherwise, CPDN models can safely be left running.

    * BBC, CPDN beta and SAP zip files are uploading normally.

    * The good news is that the new CPDN server with disk space for lots of terabytes has been delivered to Oxford. The less good news is that it hasn't yet been installed. After its installation these periodic server crises should be over.

    * Thank you to all crunchers for your patience and good humour.


mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-11-02 11:42:24


* The CPDN upload server is now back to normal and accepting zip files, so the special precautions are no longer necessary. A new server disk has been installed to provide plenty of space for these files.

* The CPDN credits export to the stats sites also appears to be functioning normally now.

* On an unrelated but hot topic, Milo says
'We have had two attempts to upgrade or alter the server software so that it will send the usual 32-bit apps to those who connect with a 64-bit client. Unfortunately, we haven't yet managed to make it work properly. All I can say is that we will manage it eventually.'


mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-11-08 00:39:01
last modified: 2007-11-08 00:41:38

The CPDN upload file server climateapps3 is down. This does not affect Beta, BBC or SAP uploads. Further up this thread there are links to all the ClimatePrediction server status pages.
MikeMarsUK
BAM!ID: 24737
Joined: 2007-04-28
Posts: 16
Credits: 0
World-rank: 0

2007-11-08 14:11:52
last modified: 2007-11-08 15:12:30

64-bit Support

People with the 64-bit Boinc Client installed can now download and run HadSM3 (AKA 'slab') climate models on their system in both Windows/64 and Linux/64. The climate models are 32-bit, so Linux/64 users will need to enable 32-bit support on their systems (IA32).
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-11-08 15:07:48

All CPDN servers are now fully functional.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-03 01:34:14

The CPDN upload server climateapps3 has filled up and Milo is moving data from it overnight. Until Monday 3 Dec some CPDN crunchers will find that their trickles and zip file uploads are refused. If this happens to your CPDN model you should if possible suspend network activity for at least 12 hours.

The server status of all ClimatePrediction projects can be checked through links further up this thread.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-03 19:22:08

The servers are now all functional again.

BBC and CPDN members together have now crunched over 22000 Hadcm (coupled) models.

The Seasonal Attribution Project has stopped handing out new SAP models; as always, crunchers are asked to please complete models they already have. It is hoped that similar SAP-type models will fairly soon be made available as an extra choice on the main CPDN project. Their aim will be to investigate particular climatic events in other years in other regions.

mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-06 03:10:19


There was a full unplanned CPDN server outage on Wed Dec 5, which Tolu has now put right. CPDN credits will be delayed for a day on the stats sites.

MikeMarsUK
BAM!ID: 24737
Joined: 2007-04-28
Posts: 16
Credits: 0
World-rank: 0

2007-12-06 13:55:10

The ClimatePrediction.Net database server will be down for a couple of hours this afternoon to resolve a few last issues. This doesn't affect SAP, Beta or BBC/CCE.

The server status of all ClimatePrediction projects can be checked here:

CPDN
http://climateapps2.oucs.ox.ac.uk/cpdnboinc/server_status.php
BBC
http://bbc.cpdn.org/server_status.php
Beta
http://climateapps1.oucs.ox.ac.uk/beta/server_status.php
SAP
http://attribution.cpdn.org/server_status.php
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-12 17:35:56

There was an SAP server outage this afternoon for a few hours due to a power cut in the Atmospheric Physics department in Oxford. The SAP servers are now fixed and functioning.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-20 20:24:58

CPDN and BBC credits haven't been updated by the server today. They therefore haven't been exported (ie reported) to the stats sites either. None of us will lose any credits; I expect the servers will update them all tomorrow.

Tolu has added to the CPDN work queue a very small number of HADAM 1-year seasonal models like those previously only available on the SAP project. They take less time to run than HADSM slabs, perhaps 10 days running 24/7. HADAM models should only be run on computers with at least 1Gb RAM, or 1.5Gb for two models run side-by-side on a dual-core.

We expect more of these HADAM models to be available in the new year.

REMINDER: CPDN members can select the type of model they prefer in their project preferences. Availability of models can be seen on the server status page, to which there's a link further up this thread.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-21 19:44:24


Edit to previous post:

The seasonal attribution models available now from CPDN are more likely to take at least 2 weeks to crunch running 24/7.
MikeMarsUK
BAM!ID: 24737
Joined: 2007-04-28
Posts: 16
Credits: 0
World-rank: 0

2007-12-21 20:04:42

A very interesting message from Sue:
"SueR" wrote:
CONTINUED THANKS FROM THE CPDN GROUP IN OXFORD TO ALL USERS - YOUR HELP IS VERY MUCH APPRECIATED!


I took over from Nick as CPDN Coordinator in October and, among other things, have been busy finding out exactly what is being done here in Oxford with the CPDN data you so kindly provide. I hope you might find the following update about the group interesting.

Wishing you all a very Merry Christmas and a Happy New Year!

Sue


We have just recently bid goodbye and good luck to PARDEEP PALL, who is moving on to take up a position at ETH, Zurich. Pardeep successfully completed his DPhil early this year looking at attributing the UK floods of Autumn 2000 to anthropogenic influences. He has since been working at CPDN as a post-doc. His experimental set-up - the Seasonal Attribution Project - will already be very familiar to many users! At ETH he will continue working on understanding and attributing/predicting extreme rainfall events.


HIRO YAMAZAKI, whose research background includes oceanography, GFD and planetary modelling and who joined CPDN originally on the computing side, is now working on the EU funded project MILLENNIUM investigating European climate of the last millennium. He is using the 'FAMOUS' model, a coarse resolution version of HadCM3 that enables about 1000 years of simulation to be performed in approximately the same time as one 160-year BBC simulation. Via CPDN he hopes to acquire a large ensemble of runs that begin in 800 AD and run for 1200 years, and will investigate changes not only in temperature but also in other quantities for which there are proxy data in Europe. Later on in the project he will also make future predictions of climate change under a variety of different emissions scenarios.


KUNIKO YAMAZAKI is in full writing up mode and is close to finishing her DPhil thesis. Kuniko is a physical oceanographer and has been studying some of the processes occurring in the ocean of the coupled model experiments. She is interested in how ocean heat uptake relates to the state of the ocean and how feedbacks are thereby formed. She has helped to develop a simple 2-level model, based on that of Jonathan Gregory at Reading University, and comparing it with the 20 ocean levels in the HadCM3 coupled model she finds it does very well. Her application for funding to continue as a post-doc was successful - congratulations Kuniko! - and in the New Year she plans to distribute experiments whereby she can investigate possible changes in the meridional overturning circulation in the North Atlantic resulting from idealised greenhouse gas change scenarios.


Third year DPhil student HELENE MURI is investigating how well CPDN models fare in simulating paleoclimates. She is looking particularly at the mid-Holocene period - 6000 years before present. Her work is important in helping us decide which models could most reliably be used for climate prediction. Her models will be tested against a variety of paleo-observations; as part of this she will use an offline vegetation model to determine which models produce a realistic shift of the Arctic treeline. She is very close to being able to distribute her slab experiments so look out for those!


HELEN HANLON, who is also a third year DPhil student, studies the summer '03 heatwave in southern Europe and is investigating whether and how this may be attributable to anthropogenic greenhouse gas increases. One aspect she is looking at is how soil moisture feedbacks may have contributed. Technically she is not actually involved in CPDN, instead using ECMWF's IFS (Integrated Forecasting System) running on their supercomputer, but it is just possible she might decide to involve herself with CPDN at some point. Watch this space.


RUTH CEREZO-MOTA, again a third year DPhil student, works with the high resolution regional model PRECIS. She is currently running this with NCEP and ERA-40 data providing boundary conditions. She is particularly interested in monsoon rainfall over Mexico and the importance of atmosphere/ocean coupling to the processes involved in this. She has a background in physical oceanography and has previously studied hurricanes using a simpler model. She does not plan to distribute any experiments via CPDN - rather her work contributes towards the general set-up and testing of the PRECIS model.


NEIL MASSEY originally joined CPDN as a research assistant but began a DPhil two years ago, during which time he has been developing a storm tracking algorithm which he will use to investigate possible changes to the location of storm tracks under various greenhouse gas emission scenarios. He is now taking a year 'out' to be employed on a contract among the Met. Office, CEH Wallingford and Oxford University, during which time he will calibrate his model against ERA-40 reanalyses. He is using a relatively high resolution atmosphere model (HadAM3P) forced with observed SSTs, similar to that used in Pardeep's Seasonal Attribution Project, but with a few modifications. Once the behaviour of this model has been validated he will then perform his storm track investigations.


DAN ROWLANDS has just started as a DPhil student having successfully completed an MPhys project with CPDN earlier this year. In his MPhys work he tested Clausius-Clapeyron predictions of changes in extreme precipitation over Northern Europe, using data from Pardeep's Seasonal Attribution Project ensemble. For his DPhil he is now investigating the issue of deciding which parameter combinations are likely to give the most reliable climate forecasts. Starting with the slab model data, he is initially calculating which combinations give the best agreement with observations; he will then use statistical techniques to devise new combinations which could potentially give an even better fit.


Earlier this year ROSALIND WEST completed her fourth year MPhys project in which she used CPDN data to investigate using the seasonal cycle in temperature to constrain climate sensitivity. She found quite different results for the slab and the coupled experiments and is in the process of writing this up for publication in the peer-reviewed literature.


Two new MPhys projects are planned to take place between now and March:
CHLOE SHARROCKS will be looking at relationships between temperature and precipitation changes in the slab model data, and
BENJAMIN GRANDEY will be investigating the effect of sulphate aerosol forcing in the coupled model experiments.


Scientists WILLIAM INGRAM, DAITHI STONE and DAVE FRAME continue to be very productively involved with the Climate Dynamics group in a large variety of ways - update to follow in the New Year!
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2007-12-24 12:16:55

There have been two recent problems on the CPDN servers while Milo has been extracting large amounts of model data for the researchers.

* When trying to upload trickles, the message that there's an HTTP error has occurred. It doesn't mean that the CPDN server is down, or that your internet connection has failed. The best idea is to suspend network activity in BOINC manager and allow it again a short time later.

* There have been delays with credits. Don't worry - we will all receive our full credits eventually even if they're sometimes late!

These problems may or may not continue during the holiday period.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-05 01:45:13

The SAP servers are down. Milo has been informed but as it's the weekend he may not be able to investigate the problem until Monday. If you don't want to suspend BOINC network activity and have a SAP model close to completion, you could suspend the model and let the computer crunch tasks from other projects until the server problem is resolved.

The CPDN and BBC servers are functioning normally.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-05 11:33:47

The SAP servers are all up and running again thanks to Milo.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-11 20:45:51

The CPDN upload servers climateapps3 and uploadatm are down. This will affect trickles and zip file uploads of some CPDN members.

If you only crunch CPDN and encounter this problem, which will show up in BOINC manager messages or by a 10-year zip file unable to upload from the Transfers tab of BOINC manager, the best idea is to suspend network activity using the BOINC manager Activity menu.

For multi-project crunchers who don't want to suspend network activity, the best advice is to prevent your CPDN model producing a 10-year zip file. Set CPDN to No New Tasks and suspend your model in the Tasks tab before it reaches December of a year ending in 0 eg 1970, 2030.

We may have to wait until Monday for this server problem to be fixed. CPDN server status can be checked here:

http://climateapps2.oucs.ox.ac.uk/cpdnboinc/server_status.php

This server problem does not affect CPDN beta, SAP or BBC members.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-12 10:43:57

Milo has just got the upload server climateapps3 going again. The problem occurred because the disk was nearly full.
mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-19 19:50:49


A few hours ago (Saturday) the CPDN upload server uploadatm was down temporarily but it's now up again.


However, the CPDN servers have been problematic for over a month and this situation may continue for some time. Even when all the CPDN servers are up and show as normal on the CPDN server status page, they have been under stress because of large amounts of data extraction for the researchers and because the disks contain so much data. There may be other undiagnosed problem(s). Tolu and Milo have various plans for the CPDN servers but cannot implement them all yet.

As a result of the current situation

* The CPDN-BOINC forum is sometimes difficult to access and we see a 'too many connections' message. Try later or use the independent forum instead.

* Sometimes the servers temporarily refuse to accept trickles and zip file uploads. BOINC has a rich variety of descriptions for this problem. You may see messages such as

HTTP error
HTTP internal server error
Project communication failed
Scheduler request failed: failed sending data to the peer
Project servers may be temporarily down

These messages can appear even when all the servers seem normal on the server status page. The best idea is to suspend BOINC network activity if possible and try again later.

There have also been delays recently with the appearance of our successful trickles on our models' project web pages.

These problems do not affect the progress of our models and we are all receiving correct credits. Only the CPDN servers are affected, not BBC or SAP.

Many thanks to all CPDN crunchers for your patience!

mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-20 15:06:41



It's possible that sometimes a CPDN server shows on the server status page as down when in fact it's running! So in future I will only announce server outages when we have evidence that they're real.


mo.v
BAM!ID: 25128
Joined: 2007-05-01
Posts: 280
Credits: 0
World-rank: 0

2008-01-31 04:44:51



Thanks to Jonathan Colman from Washington DC for pointing out this Nature Conservancy article published on 29 January by Dave Connell. It highlights the ClimatePrediction project. The article is being discussed on Digg here.

There's a forum thread about it here.

Thanks also to Xapadoo for setting up a ClimatePrediction fan for members of Facebook. Read here about how Facebook members can join the fan and invite their friends to find out about CPDN.


Pages: 1 [2] 3 4 5 6

Index :: News :: CPDN news