stephenbrooks.orgForumMuon1GeneralResults lost?
Username: Password:
Page 1 2
Search site:
Subscribe to thread via RSS
Black-X
2002-11-13 14:15:07
I sent 1,3 Mb results to cgmuonftp.homelinux.org and my files are away now from the dir, but I can't find the stats from them?  Are the stats from 22:00 coming later or is there a serious problem?
Stephen Brooks
2002-11-13 15:50:22
"[DPC]Clan Delft" had its database file modified under an hour ago, but it's still only 340KB.  There is no file left on the server.  If you look at "sendlog.txt" or whatever it was, how many results does it say it sent?


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
ZeonX[OCAU]
2002-11-13 15:51:01
stephen might have downloaded them but not done the stats at the moment..

But one thing that can happen and did happen on my ftp server but stephen had problems deleting from my ftp so it actully saved a result.  Is that stephen will download all the results and then delete all the .txt file after but i looked through the log and as stephen was downloading the results someone had uploaded one and then stephen tried to delete all the .txt files but my ftp didn't understand his command so it didn't delete them if it had that persons result file would have just been deleted and was never downloaded by stephen.  I later deleted the files he had already downlaoded and now i've changed my ftp so this can happen.

Maybe stephen should delete each file by name and not every .txt file as this can happen and when this project gets bigger could happen alot more.
Stephen Brooks
2002-11-13 15:52:50
This is the reason some results went missing early on and probably a few could go missing now.  I'm thinking about modifying the program to do one script for downloading and then construct a second script just for deleting specific files afterwards.

For the next couple of days, keep backups.  I'll post here when I've got the FTP script "safe".


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
ZeonX[OCAU]
2002-11-13 15:54:37
yeah that would be good stephen.
Henri Valta
2002-11-13 22:06:44
Hi, looked through my ftp server logs and found this one instance where the datacenter user just logs in, doesn't retrieve any results and then deletes all files.  These are probably the lost results?

163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:01:13 +0200] "XMKD v4.21b" 550 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:01:13 +0200] "CWD v4.21b" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:01:13 +0200] "TYPE A" 200 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:01:14 +0200] "PORT 163,1,162,5,4,190" 200 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:23 +0200] "NLST *.txt" 425 0
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:23 +0200] "TYPE A" 200 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:23 +0200] "TYPE A" 200 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:23 +0200] "PORT 163,1,162,5,4,11" 200 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:23 +0200] "NLST *.txt" 226 378
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "TYPE A" 200 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-212713-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-212904-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-212948-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-213024-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-213056-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-213128-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:24 +0200] "DELE 20021113-213148-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:25 +0200] "DELE 20021113-213214-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:25 +0200] "DELE 20021113-220215-H5kLv-[DPC]Clan_Delft.txt" 250 -
163.1.162.5 UNKNOWN muonadmin [14/Nov/2002:00:04:25 +0200] "CWD .." 250 -

I really don't know whats happening here, but there seems to be quite long time from the first port command to the nlst command.  Maybe some command timeouted and it skipped the downloading part...

-Henri
Black-X
2002-11-13 22:42:24
Yes that are they... I first send one 1,3 Mb files but thats gets wrong I thought so I have send them after that in pieces and I hoped that that would work... But it didn't...

I'll try again...
pvs
2002-11-14 15:50:43
Something is wrong with resultsupload and/or Stats.  Lost my last upload again, there was no change in my stats over the last few hours but last update 0h is displayd (not only now, every hour)

Peter
Midon
2002-11-14 23:08:51
Same for me.  In the last file I had my best result big grin until now.  0 h update was displayed but no update of the best result.  I did not check the other numbers.
Black-X
2002-11-14 23:24:41
I have found what's the problem by uploading Clan_Delft files.

We have our own proxy so the points that come in on the proxy put we in a database.  Then every 10 minutes we FTP our results if we have... But the reason is doesn't work, I think is that we send a wrong type of file.

So I would ask can you tell me where you put /n or /r in your files?  I now have something like:
zsrc=550;;s11f=991;s11r=890;s11l=646;d11l=005;s12f=992;s12r=891;s12l=668;etc.\r
2.857982 (58579 particles) [v4.21b] {B75C17BC}\n

O am I wrong with the \r and \n??

[This message was edited by Black-X on 2002-Nov-15 at 7:37.]
[DPC]Stephan202
2002-11-15 00:04:34
Not sure, but I think they're BOTH \n
You could use a hex editor to find out.  I can't do this right now 'cause I'm at school.

---
Dutch Power Cow.
MOOH!
Goner
2002-11-15 01:04:10
quote:
Originally posted by Black-X:
O am I wrong with the \r and \n??

in a Windows result.txt both lines end with hex 0d (\r = Carriage Return) _and_ 0a (\n = Line Feed)

--
Goner - [DPC]TeamNWW
Black-X
2002-11-15 06:07:04
zsrc=550;;s11f=991;s11r=890;s11l=646;d11l=005;s12f=992;s12r=891;s12l=668;etc.\r\n
2.857982 (58579 particles) [v4.21b] {B75C17BC}\r\n

Like this???
Midon
2002-11-15 06:16:05
But on Windows Carriage Return Linefeed is quite normal ?????
Black-X
2002-11-15 06:30:17
I have sent al the results again with /r/n and it looks good...

But please can you do a dupecheck... We have now send ech results much times because we ahve 8 members... I flushed the results for every member in one file so i sent 8 files but after that I also sent a file with all the 8 members in one file...
Goner
2002-11-15 06:36:35
quote:
Originally posted by Midon:
But on Windows Carriage Return Linefeed is quite normal ?????
yep ... Windows always uses CR/LF, but Unix/linux uses only a LF as end-of-line.

--
Goner - [DPC]TeamNWW
[DPC]Stephan202
2002-11-15 06:41:54
quote:
Originally posted by Goner:
quote:
Originally posted by Midon:
But on Windows Carriage Return Linefeed is quite normal ?????
yep ... Windows always uses CR/LF, but Unix/linux uses only a LF as end-of-line.

--
Goner - [DPC]TeamNWW

Now you say so, yes I noticed that some time ago when playing with a hex editor.  Should have remembered.

---
Dutch Power Cow.
MOOH!
Midon
2002-11-15 06:56:01
Yes, that right.  I'm not sure but doing a FTP with ASCII mode several FTP Server or Clients will make the transfer and remove the extra character.  It is also possible that this is a special switch.  I'm not sure.

It this is not done this can cause problems with Stephens programs as you mentioned.
Stephen Brooks
2002-11-15 07:36:12
I think what happens is that I upload as ASCII, at which point the \r\n is turned into just \n if the server is UNIX-based.  Then I also download as ASCII, so the \n gets turned back into \r\n for the Windows machine.


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
Black-X
2002-11-15 09:14:15
Okay but could it be that me points not count because I had /n instead of /r/n??
Midon
2002-11-15 10:52:40
Stephen,

I'm not sure that the /r/n will always be changed at a FTP.  At many times (but not always) I was sending a text file from Windows to Unix and I have taken a look at it with vi or emacs the /r was not removed.  At emacs you will see a ^M
Stephen Brooks
2002-11-15 11:23:38
Well when I upload and download with ascii all the results come through OK.


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
Midon
2002-11-15 11:28:05
Then we have no problem at this point confused. But I have resent my best result and it still missing.
[DPC]inquestos
2002-11-15 14:21:56
Sent exactly 24h ago 70 results, but still no change in the stats.  Hope this problem can be solved ( I have a back-up of about 64 of them, so I could at least try to resent those)
Stephen Brooks
2002-11-16 03:03:17
I'm rewriting the stats-getting script so it will not delete files it hasn't downloaded... So no updates right now


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
[DPC] White Panther
2002-11-17 06:13:17
but how come that there ware an update of the stats and my best muon 3.559% didn't shows in the stats?

sorry vor bad english smile

mooh mooh
Monsoon
2002-11-17 06:24:58
I don't think there was really a stats update, just the time kept changing.
px3
2002-11-17 06:37:53
Hi,

if someone is missing files on my queue, first have a look at my web page.
i wrote a small queue-status script, which shows currently queued files.
the page is updated every 15 minutes.

Regards,

Rolf
PX3
[DPC] White Panther
2002-11-17 07:06:46
it's not the point that i mis some files, but it is that the best muon that i sent is not in the list, 3.559% that is the best of my team [DPC] smile

mooh mooh
Stephen Brooks
2002-11-18 08:29:05
My program keeps _trying_ to retrieve files from that server, but with such a long list it sometimes hangs... (Also it appears that more files go to PX3's server than anyone else's, which is odd - I've checked I've seeded the random number generator and so on).

I may have to rewrite the results-getter script _again_ to make it only login and do 10 files at a time... tedious...


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
[DPC] White Panther
2002-11-18 08:45:39
mine result is standing in the stats now smile

sorry for resending this result

mooh mooh
Monsoon
2002-11-18 16:02:32
Stephen, have you gotten the files that were uploaded to sogard.serveftp.net?  I still haven't gotten credit for the file I uploaded there on the 15th.  It also has what appears to be the 1.3MB file that went missing under the name [DPC]Clan Delft.
Pascal
2002-11-18 23:54:33
A member of team Rechenkraft.net has lost most of his particles since a week.

May you have a look for DersaureFritz[Rechenkraft.net]'s results?
Thx a lot.

___________________________
BaDMaN
2002-11-21 00:54:27
Hi Stephen,

I send a file of 674Kb under [DPC]BaDMaN the 20th to your FTP-server and I don't find these results?
Could you check if you could find some traces or errors?
If you don't find anything I will upload it again (2 B safe I've kept the results wink )

Thx,
Stephen Brooks
2002-11-21 05:32:31
Some results will be about a day or so before they come through.  The ones Pascal mentioned should have come through because I cleared the queues that went back that long.


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
BaDMaN
2002-11-22 01:54:50
Stephen,

I haven't seen any updates to my results send to your original server.
Is it ok for me to resend them??

PS: How many times a day do you create stats?
Bluumi [SwissTeam.NET]
2002-11-22 03:37:58
Stephen what is wrong?

3-20. KSBA [SwissTeam.NET] 0 0 0 0 0 (0.0%) 0

One Day there are about 2'000'000'000 Particles, next day Zero .. ?

What is going on?
He say he send no dupes, and if, there must be SOME results but not ZERO...

Any answer?

Anything he say, is that he send with the OLD manualsend, see it, CTRL-C and send with the new one ... but the stats go down to ZERO?

Hear ya frown
Stephen Brooks
2002-11-22 05:44:35
--[One Day there are about 2'000'000'000 Particles, next day Zero .. ?]--

The day before he had 2 billion particles he had none.  It looked suspicious like cheating, and when I checked the file all the results were sorted in descending order and only covered the range 2.7-2.95% or something like that.  The designs also didn't seem to show enough variation to be genuine - I'd've excepted some low ones.


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
Herb[Romulus2]
2002-11-22 07:03:43
Yet another fuss roll eyes
I've seen over the last 2 days certain updates of the stats, but those:
20021122-135328 12 results sent to blank-it.dyndns.org
20021122-055532 24 results sent to cgmuonftp.homelinux.org
20021121-163956 19 results sent to muon.serveftp.org
20021121-032341 23 results sent to zeonx.mega-reviews.com
20021120-140750 31 results sent to sogard.serveftp.net (uncertain if yes or no)
and a few smaller ones from my homebox didn't show up (with a nice 3.086 result in). 

The last update some minutes ago increased my account by around 6 mio particles, so it looks like that actually only the latest one from the list came through eek

What shall I do, wait and see, or resend with a load of dupes again?  confused

-------------------------------
Y0k compliant, counting upwards wink
Herb[Romulus2]
2002-11-22 12:29:15
Another 13 mio somehow arived smile
But where is still the rest and especially my good 3.086 one?

-------------------------------
I'd say more, but I can't reach the keyboard from the floor.
Bluumi [SwissTeam.NET]
2002-11-22 13:59:57
quote:
Originally posted by Stephen Brooks:
cheating, and when I checked the file all the results were sorted in descending order and only covered the range 2.7-2.95% or something like that.  The designs also didn't seem to show enough variation to be genuine - I'd've excepted some low ones.


cool

Ok, i will say (translate) him, he should send all other low Results ...
And he should NOT sort the Results with the MuonMonitor...

So i unterstand him right, he has only send the bigger results because the lower one don't count enough ... this is what he say to me ... but i'm the interface only .. big grin

SwissTeam.NET, the better .NET
Herb[Romulus2]
2002-11-22 23:53:54
Another batch of 16 mio in smile, but still some missing.

I suspect this server doesn't deliver, or has completely lost results:
20021121-032341 23 results sent to zeonx.mega-reviews.com
20021121-075741 6 results sent to zeonx.mega-reviews.com <-- here is my new best muon result in, which is still not in the stats.

What to do?

-------------------------------
I'd say more, but I can't reach the keyboard from the floor.
Bluumi [SwissTeam.NET]
2002-11-23 02:26:39
@Herb[Rom2]

Did you REALLY need to send your Results every Day?
Hold back the Results and send bigger packet...

...

SwissTeam.NET, the better .NET
Stephen Brooks
2002-11-23 06:46:42
quote:
Originally posted by Herb[Rom2]:
I suspect this server doesn't deliver, or has completely lost results:
20021121-032341 23 results sent to zeonx.mega-reviews.com
20021121-075741 6 results sent to zeonx.mega-reviews.com <-- here is my new best muon result in, which is still not in the stats.

What to do?


I'll go and kick ZeonX Looks as if he has his FTP switched off.


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
Herb[Romulus2]
2002-11-23 06:59:23
quote:
Did you REALLY need to send your Results every Day?

big grin Stats adicted weirdo to ground control: YES Sir
quote:
Hold back the Results and send bigger packet...
I won't frightening the competition wink razz

Else, it doesn't help with the general problem around, as is, some servers either keep back or let disappear some packages. 

I tell ya, the success of DC-projects lives from good, accurate current stats big grin

And we're going to blow you away anyway eek in the long run razz resistance is futile wink

-------------------------------
I'd say more, but I can't reach the keyboard from the floor.
Herb[Romulus2]
2002-11-23 07:02:20
Cross posting

Thanks Stephen, don't take the above too serious wink

-------------------------------
I'd say more, but I can't reach the keyboard from the floor.
pvs
2002-11-23 08:24:04
And again...
Missing:
20021122-213904 36 results sent to blank-it.dyndns.org

Peter
Stephen Brooks
2002-11-23 13:32:21
Give it at least 48 hours before complaining or re-sending (unless you're totally sure it didn't even get uploaded).


"As every 11-year-old kid knows, if you concentrate enough Van-der-Graff generators and expensive special effects in one place, you create a spiral space-time whirly thing, AND an interesting plotline"
ZeonX[OCAU]
2002-11-23 14:05:42
Ok well i checked the server and guild ftp server had crashed it seemed but its running again now.

Also if you need to tell me something like this in the future stephen just send me a message on ICQ because i'm always on that.
Herb[Romulus2]
2002-11-24 00:36:18
Looks like, as if all my straying stuff finally arrived now cool
Thanks smile

How about adding the last flush-time to the servers.php page?  That would allow everybody to check against their sendlog, if some packages may still hang somewhere and not to much bother with it smile

-------------------------------
I'd say more, but I can't reach the keyboard from the floor.
: contact : - - -
E-mail: sbstrudel characterstephenbrooks.orgTwitter: stephenjbrooksMastodon: strudel charactersjbstrudel charactermstdn.io RSS feed

Site has had 25412892 accesses.