stephenbrooks.org : HIDDEN RESULTS

tomaz 2006-07-17 14:32:48	Stephen, can you check servers for some hidden results ? I send some on 12th and 17th July but no change in stats. Some send in mid June might also be hideing.... They are all more than 100k each if this help.
Stephen Brooks 2006-07-17 15:17:39	Do you know which servers you are sending to? I found a few "lost" results here but none were from you (mostly PY222 and team ColdFusion).
tomaz 2006-07-17 19:59:53	20060601-193708 668 results sent to muon1.serveftp.org 20060601-193836 397 results sent to muon1.wmikrut.com 20060607-064243 1263 results sent to muon1.serveftp.org 20060607-064639 665 results sent to muon1.wmikrut.com 20060608-195347 330 results sent to muon1.wmikrut.com 20060608-201904 236 results sent to muon1.serveftp.org 20060608-202750 106 results sent to muon1.wmikrut.com 20060608-204000 375 results sent to muon1.wmikrut.com 20060609-113730 279 results sent to muon1.wmikrut.com 20060609-220226 80 results sent to muon1.wmikrut.com 20060612-084228 455 results sent to muon1.wmikrut.com 20060612-084353 678 results sent to muon1.wmikrut.com 20060612-084618 581 results sent to muon1.serveftp.org 20060615-193238 608 results sent to white-panther.kicks-ass.net 20060615-193737 568 results sent to muon1.serveftp.org 20060615-193909 980 results sent to muon1.wmikrut.com 20060615-195745 2357 results sent to muon1.serveftp.org 20060704-125023 632 results sent to white-panther.kicks-ass.net 20060712-075806 133 results sent to muon1.serveftp.org 20060717-061706 174 results sent to muon1.serveftp.org Last two are "lost" and I belive some from June, too.
Stephen Brooks 2006-07-18 12:30:02	muon1.serveftp.org is my server and I checked last night there is nothing "stuck" on there. Do you have a results.dat that you could send the last ~400 results of?
tomaz 2006-07-18 12:38:34	Is there a way for you to see if there was any traffic on the server with me? I have backup of txt files so I will send last two of July for a test right now.
tomaz 2006-07-18 12:43:15	20060712-075806 133 results sent to muon1.serveftp.org 20060717-061706 174 results sent to muon1.serveftp.org 20060718-114119 133 results sent to muon1.serveftp.org 20060718-114233 174 results sent to muon1.serveftp.org ok, I just resend last two
tomaz 2006-07-18 21:21:18	Can you see that two files on your server or not ? Where could they gone ?
tomaz 2006-07-20 08:15:28	Yesterday I've try another thing. I manual send first file (with 133 results) with version 4.43d. It was divided in two files with 67 and 66 results. One with 67 results went to white-panther and the other went to wmikrut. Then I manual send file with 174 results to white-panther with version 4.42 so it went in one piece. Only first part of first file appeared in stats (67 results). Strange ? 20060719-205744 67 results sent to white-panther.kicks-ass.net 20060719-205802 66 results sent to muon1.wmikrut.com 20060719-210041 174 results sent to white-panther.kicks-ass.net Did somebody else also noticed missing of files ?
RGtx 2006-07-20 10:20:47	Over the last few days, I had noticed that results sent to muon1.wmikrut.com were not immediately appearing at the corresponding stats update. Whether or not, they were appearring much later, I wasn't sure, so yesterday I temporarily edited this rogue server out of the servers.csv file.
Stephen Brooks 2006-07-20 11:08:39	Yes, that may be a problem: I can't FTP to muon1.wmikrut.com any more. I've e-mailed him to ask what's going on. I'll also see if I can make a log for all files received (BEFORE they're processed by the stats generator), to make it easier to tell apart FTP errors from local ones.
tomaz 2006-07-20 11:35:16	It can be only part of a problem. Where are files I sent yesterday to your server ? And where are the other file from white panther ? Is there also a problem with files larger than 100k ? I will make another test-send file smaller than 100k to your server and whitepanther's.
Stephen Brooks 2006-07-20 11:44:25	Seems the "67" came through. Nothing else has even arrived, as far as I can tell, so maybe white-panther has only been connecting intermittantly.
Stephen Brooks 2006-07-20 11:46:11	My server has 20060720-104353-XjzuE-TOMAZ.bin on it right now, waiting to be downloaded.
Stephen Brooks 2006-07-20 11:50:03	This is a very strange problem - files do indeed seem to be disappearing at some point. My new logging should be able to give a clue where that is. Meanwhile if you tell me the filenames from your send-log, that helps because I can track them.
tomaz 2006-07-20 11:52:37	ok, it is the 174. But why it didn't came through on 17 and 18th of July from your server? And yesterday from white panther ?
Stephen Brooks 2006-07-20 11:57:17	Well maybe there's an error and it's going to get deleted in this pass? Then at least I'll be able to see where the "vanishing" is taking place.
tomaz 2006-07-20 12:00:26	Hmm Stephen, there are no file names im my send.log. This is example of my send.log: 20060601-193708 668 results sent to muon1.serveftp.org 20060601-193836 397 results sent to muon1.wmikrut.com 20060607-064243 1263 results sent to muon1.serveftp.org 20060607-064639 665 results sent to muon1.wmikrut.com 20060608-195347 330 results sent to muon1.wmikrut.com 20060608-201904 236 results sent to muon1.serveftp.org 20060608-202750 106 results sent to muon1.wmikrut.com 20060608-204000 375 results sent to muon1.wmikrut.com 20060609-113730 279 results sent to muon1.wmikrut.com 20060609-220226 80 results sent to muon1.wmikrut.com 20060612-084228 455 results sent to muon1.wmikrut.com 20060612-084353 678 results sent to muon1.wmikrut.com 20060612-084618 581 results sent to muon1.serveftp.org 20060615-193238 608 results sent to white-panther.kicks-ass.net 20060615-193737 568 results sent to muon1.serveftp.org 20060615-193909 980 results sent to muon1.wmikrut.com 20060615-195745 2357 results sent to muon1.serveftp.org 20060704-125023 632 results sent to white-panther.kicks-ass.net 20060712-075806 133 results sent to muon1.serveftp.org 20060717-061706 174 results sent to muon1.serveftp.org 20060718-114119 133 results sent to muon1.serveftp.org 20060718-114233 174 results sent to muon1.serveftp.org 20060719-205744 67 results sent to white-panther.kicks-ass.net 20060719-205802 66 results sent to muon1.wmikrut.com 20060719-210041 174 results sent to white-panther.kicks-ass.net 20060720-104353 174 results sent to muon1.serveftp.org
Stephen Brooks 2006-07-20 12:01:42	Interesting - some files have been downloaded from muon1.serveftp.org and white-panther in this pass, but it looks like yours will have to wait for the next run. It's taking them from the oldest first. It could also be that that file was uploaded after the download on muon1.serveftp.org had finished this time.
Stephen Brooks 2006-07-20 12:02:11	The date-time and your username is almost always enough to identify the unit.

Stephen Brooks
2006-07-20 15:18:58

2006-Jul-20 13:16:42 ftp\muon1.serveftp.org\v4.4x\20060720-104353-XjzuE-TOMAZ.bin 56754

That file just arrived. It hasn't shown in your other log, though, so maybe we have to wait for it to be counted and update again.

guest 2006-07-20 16:18:26	Maybe I'm mistaken in how I'm reading things, but if I log into muon1.wmikrut.com I see over 5,000 files.
Stephen Brooks 2006-07-20 16:40:00	Yes, he says he's fixed it now, though it will take a while to count through all those files.
GOD 2006-07-20 17:19:45	Cool! For the last week I've been wondering where approx 1/3 of my usual output was going. I seemed to be down by about 100,000 points per day, yet I was uploading the usual 40 to 50mb. I was beginning to go nuts as I twiddled the dials, kicked the tyres and whistled dixie ... but nothing worked I've had a peek at the backlog on wmikrut.com and sure enough there are hundreds of my burnt offerings just spinning around on some platters looking lost!
guest 2006-07-20 19:29:32	Good job, Stephen. Looks like you're on top of things as always.
tomaz 2006-07-21 07:51:42	The 66 finaly came through. But 174 is still missing. And what happend with previous 133 ? (basicaly it is now over because it is 67+66, but why didn't the 133 come through at the first place ?) This is not connected with wmikrut server. 133 and 176 went on Stephen's server at first.
Stephen Brooks 2006-07-21 10:55:23	Now that I have better logging, try sending those again. So far, I have indications of your 67 and 66 being received and then counted. Say also the line of sendlog.log that shows the timestamp so I can find the things. I've also realised that my "100KB" chunking is actually a bit small for HTTP results because they seem to be rather small once converted into binary. Something more in the 300-500KB range might be more efficient for a next version.
tomaz 2006-07-21 12:25:15	You should see this new one on your server already. 20060721-065809 245 results sent to muon1.serveftp.org And ghostly 174 for the fifth time... 20060721-112510 174 results sent to muon1.serveftp.org

Stephen Brooks
2006-07-24 14:07:14

2006-Jul-21 18:51:28 ftp\muon1.serveftp.org\v4.4x\20060721-112510-QlbD3-TOMAZ.bin 56754

2006-Jul-21 18:50:13 ftp\muon1.serveftp.org\v4.4x\20060721-065809-sE7Nz-TOMAZ.bin 79332

Both of those have arrived. Stats don't seem to be up due to another issue with FTP access to my site, but your line from simplestats.txt is:

TOMAZ 87734(results) 14155600.2(Mpts) 85(hours)

Hobbes 2006-08-14 04:50:14	Is there a backlog pulling from the WhitePanther ftp? My last upload is short about the same points as what was sent to that site. Thanks!
RGtx 2006-08-14 09:59:00	Stephen's unregenerate server has been up to its old tricks again.
Stephen Brooks 2006-08-15 09:54:29	My FTP server is letting the thing retrieve results again, it seems. (First the thing had lost/reset its user config and then I'd got a user called "datacenter" when it should have been "muon1datacenter".
Hobbes 2006-08-15 14:00:13	My missing points showed up, so another satisfied customer.
tomaz 2006-08-21 13:24:20	Something is still wrong... 20060719-205744 67 results sent to white-panther.kicks-ass.net 20060719-205802 66 results sent to muon1.wmikrut.com 20060719-210041 174 results sent to white-panther.kicks-ass.net 20060720-104353 174 results sent to muon1.serveftp.org 20060721-065809 245 results sent to muon1.serveftp.org 20060721-112510 174 results sent to muon1.serveftp.org 20060721-130144 360 results sent to muon1.serveftp.org 20060721-134845 13 results sent to muon1.serveftp.org 20060816-081232 1179 results sent to muon1.wmikrut.com Last results added to my stats were 67 and 66 which brings total of 87734 results. Where are others ? Please keep in mind that 174 are same file so total shoul be 89705. Stephen is this only stats problem or you didn't receive that files at all ?
Xanathorn 2006-08-21 22:49:17	Your results aren't lost, just the statsgenerator died. Wait until Stephen's back in a week and a half and your 'lost' files will turn up .
tomaz 2006-08-22 08:40:50	Im not sure it's only statsgen problem. Some files were sent a month ago...(174,245,360,13) and they didn't show up.
[DPC]white_panther 2006-08-22 11:19:50	i have checked mine server, but there aren't any files from you from july. so the statsserver grabed it from mine server
tomaz 2006-08-22 12:56:18	I am worryed that that files never reach server...is this possible? White panther, is there a way you can check if this file 20060719-210041 174 results sent to white-panther.kicks-ass.net was on your server at all ?
[DPC]white_panther 2006-08-22 18:12:12	was it send by ftp or http?
tomaz 2006-08-22 21:05:45	http
[DPC]white_panther 2006-08-22 23:32:25	could this be you? 70-89-135-250-smc-wa.hfc.comcastbusiness.net - - [19/Jul/2006:00:21:00 +0200]
tomaz 2006-08-23 00:53:19	no, i don't think so. what data you need? maybe you should look for triera.net or something ending with .si ?
[DPC]white_panther 2006-08-23 08:19:48	than it must be this one gatekeeper.vgb.si - - [19/Jul/2006:22:53:17 +0200]
tomaz 2006-08-23 08:31:58	yes, it is ! you should find 2 records from 19/jul/2006. I send one file with 67 and one with 174 results... The one with 174 results is "lost" one.
[DPC]white_panther 2006-08-23 10:42:11	just found one, and i can't see witch file you uploaded and how big it was. sorry
tomaz 2006-08-23 10:52:51	ok, thank you. Now we know that second one never reached your server. Any ideas how can it "dissapear"? Is it possible that log is generated but file is not send? Or can it stuck somewhere ?
tomaz 2006-09-08 09:44:19	hello stephen, it seems you are back. can you figure out about missing files ?
tomaz 2006-09-13 07:58:33	even stranger, "hours since last active2 went to zero but "results send" didn't change... 20060911-092128 2067 results sent to muon1.serveftp.org

Stephen Brooks
2006-09-14 14:47:17

The log says I received:

2006-Sep-11 15:30:58 ftp\muon1.serveftp.org\v4.4x\20060911-092128-RgbM6-TOMAZ.bin 658728

Stephen Brooks 2006-09-14 14:50:10	But that was during the stats problems and it didn't appear to parse it or add it to your results.
tomaz 2006-09-14 19:46:19	Nice to hear that file was loged. But where others since July ? It isn't really important in stats but I want to be sure that files get to you, I don't like to spend electric power for nothing. Stats serve (or should serve ) for control if everything were OK.