 |
| smalltalker 2002-11-19 01:12:23 | Stephen, Are your stats updates fully operational again? I've been reading through all the posts here and I'm not quite sure of the current state. FWIW. I uploaded some results on Sunday 17th, the log shows 20021117-124221 80 results sent to muon.rdsroot.net but they haven't yet been added to the totals and my last update is shown as 4 days ago (the 15th). I kept a backup so I can send them again if needed. Ian |
| DukeBox 2002-11-19 01:40:37 | i have troubles with muon.rdsroot.net 2. |
| pvs 2002-11-19 02:20:05 | Smalltalkers result ist still on the ftp-server smalltalker 99840 bytes 2002/11/17 12:42 This server has a own website, updated every 15 minutes, so if you miss a file on this server look here: http://muon.rdsroot.net/ ..and DukeBox [DPC]DukeBox101088 bytes 2002/11/15 06:05 [DPC]DukeBox348192 bytes 2002/11/14 23:00 [DPC]DukeBox3744 bytes 2002/11/18 18:15 [DPC]DukeBox38688 bytes 2002/11/18 23:19 [DPC]DukeBox44928 bytes 2002/11/18 23:20 [DPC]DukeBox4992 bytes 2002/11/14 23:00 [DPC]DukeBox68640 bytes 2002/11/18 23:30 [DPC]DukeBox7488 bytes 2002/11/18 23:17 I think the problem is Stephens DownloadScript and not the server.. Peter |
| DukeBox 2002-11-19 03:06:44 | quote: how is it possible that my files are on muon.rdsroot.net ?? I always use the 'old' manual send. |
| Brian Sogard 2002-11-19 04:54:07 | I am sure everything will be straightened out in the end. There are currently 63 results files on my server, some have been uploaded but not deleted. This distributed ftp server concept is unique enough that there were bound to be challenges in getting the scripts working. It is good that Stephen can work on this while v4.21b appears to be hovering around optimal design. Good luck Stephen |
| Henri Valta 2002-11-19 07:27:45 | cgmuonftp.homelinux.org server has now some (very ugly) queue stats too. They are here |
| [DPC]Speedy_J 2002-11-19 07:34:01 | quote: I used the old linux client. My results are on this ftp too.. I wander when it will be flushed.. |
| Stephen Brooks 2002-11-19 07:36:57 | I've just rewritten my stats thing to try and retrieve-then-delete files in blocks of 10, to avoid the 'hanging' that occurs with long FTP scripts. You should gradually see the queues coming down. I'd be interested to see what the FTP server admins think is happening - is the logjam gradually clearing? The reason files are turning up on muon.rdsroot.net is because PX3 has decided to retrieve them off my original FTP himself with a cron job. This makes them more secure because they are being moved from an FTP server where other users can delete them to one that's set up with the correct permissions. "As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline" |
| DukeBox 2002-11-19 08:16:39 | Was my idea of any help ? ( http://www.stephenbrooks.org/groupee/forums?a=tpc&s=724606111&f=144606111&m=8606035211&r=7096056661#7096056661 ) |
| px3 2002-11-19 08:26:57 | quote: Looks really good.. the queue at muon.rdsroot.net is at 100 files right now.  quote: This was discussed by Stephen and me. So i coded a small script to get the files off this really wide opened system and moved them to mine. The job will be planned out, when stephens old ftp is secure. so if someone uploads results to the old ftp (using the old manualsend) have a look at my queue if you're missing files  Regards, Rolf PX3 |
| Stephen Brooks 2002-11-19 09:42:02 | quote: Well because the Oxford Computing Service was offline for 48 hours I didn't get time to read that, and have done a workaround using normal FTP. However using that program sounds like a good idea because right now the stats-getter is fairly successful, but often does not quit and threads are left running. "As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline" |
| Henri Valta 2002-11-19 10:26:53 | quote: This new 'thing' is working much better than the previous one. It took some time but the queue on my server is now empty |
| pvs 2002-11-19 12:32:14 | Missing again 47 Million particles 20021118-212115 127 results sent to sogard.serveftp.net sent nearly 24 hours ago, so I think this file is lost. I'll send it again if 21:00 Statsupdate won't show the missing particles. Edit: Had al look at PX3's Queue, there are still files dated November 14th, so i think I'll wait a little longer... Peter [This message was edited by pvs on 2002-Nov-19 at 20:40.] |
| Brian Sogard 2002-11-19 15:36:52 | Your results file is still on my server. The server went haywire while I was at work today. It would allow uploads but was rejecting the repetition rate of datacenter download requests (It was interpreting this as hammering). Connection permissions have been adjusted for data center account, the server has been re-started, and data center has started pulling files. There are 78 result files currently on my server, I don't believe any have been lost on my server. I expect the results on my server will now begin to be pulled into Stephen's stats. I'm learning too, we will get past these learning pains. |
| Stephen Brooks 2002-11-19 15:49:59 | I noticed your server blocked me I could make a retry-delay of 30 seconds if you want - to stop genuine hammering - but right now I do need to log on and off quite a bit to stop the FTP program freezing, so this way is probably better. Maybe soon I'll use ncftpget instead of Windows FTP. DukeBox says it's probably better and more reliable. "As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline" |
| Brian Sogard 2002-11-19 16:44:56 | quote: There were two triggers giving my server fits, as it turns out. I don't know what exactly it objected to, but datacenter was also triggering a hack detection, which was enabling an auto-ban. For datacenter account only I disabled bans due to hammer and hack alerts. I'll adjust the server permissions as needed, when I figure out they need adjusting, to help the system work. No retry-delays are needed, and once again I have cleared datacenter's IP from the ban list, um, sorry! I hope I've opened up that account enough to stop those from happening! |
| Stephen Brooks 2002-11-19 17:05:24 | The hack alerts are because I'm using many threads of FTP, but for some reason FTP doesn't seem to be entirely thread-safe so it actually corrupts the IP headers sometimes  . However, I've worked _around_ this problem."As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline" |
| DukeBox 2002-11-20 00:16:04 | We at work are using ncftpget quite a while.. we use it to retrieve (and put) data in backoffices in our stores. Most of them are connected with ISDN with sometimes bad configured routers/damaged cables, wich results in buggy ftp-transfers (hangin, partical and corrupt up/down loads, timeouts etc.). Sinds we use ncftpget we dont have any problems.. even when connection isn't possible it timeouts and goes on with the next one (about 420 stores, +/- 1mb up and +/- 5mb down every night). Mostly i start 6 threads with each 70 stores in queue. We are using the unix (aix) version, but with manual actions the win32 version works fine 2. |
| [DPC]Scorpion 2002-11-20 01:08:07 | quote: quote: Are you still getting the results from there? because i see alot of resluts there from different dates (not that many tough (25))  |
| px3 2002-11-21 13:18:18 | Currently muon.rdsroot.net is no longer catching results from stephens ftp server due to internal tests... Regards, Rolf |
| Stephen Brooks 2002-11-21 14:14:08 | quote: I've added that server back to my script, so it's cleared on the same basis as the other ones. "As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline" |
