 |
| GOD 2010-06-07 10:02:25 | Stephen, Can you explain why more than 35,000,000 points have been deducted from my account [ARS]GOD ? As far as I can tell, I have been crunching and submitting data in an unchanged manner for years. Thanks, Me! |
| Stephen Brooks 2010-06-07 14:06:09 | Well, it's not obvious what's caused that, particularly as there have been no massive decreases in the totals for the current optimisations. However, I've told it to do a recount of all your results on the next stats run. Will keep looking, please post if your points come back. |
| Stephen Brooks 2010-06-07 16:12:33 | Is this your 35 million back again? Linac900Removable8c2 Tab-separated stats list [updated 2010-Jun-07; 15:03 UTC] 3. [ARS]GOD 25444 results 35`990919.9 Mpts (4.70%) |
| GOD 2010-06-08 10:59:09 | Thanks for such a fast response  Nothing has appeared yet; I'll look again later after I go for a swim & sauna. Thanks. |
| Stephen Brooks 2010-06-09 13:05:33 | Probably what I did didn't work, if it hasn't shown up by now. Was the loss just in the last few days before the 7th? If so, I think I should be able to trace which optimisation it has happened in. |
| Stephen Brooks 2010-06-09 13:36:55 | At least I've found *when* it happened now: 2010-Jun-02; 01:05 UTC 2543944 703971165.5 39 2010-Jun-02; 02:58 UTC 2140402 665089021.1 41 |
| Stephen Brooks 2010-06-09 13:38:49 | And now cross-correlated with the other log file (which I otherwise couldn't locate the problem without a date/time): 2010-Jun-02 03:47:26 PhaseRotD v4.4 Added -403542/-38882144.4/0.132608 BMark 403542/38882144.4/0.205956 to 0/0.0/-8999999999999990000000000000000000000000000000000000000000000000000000000000000000000000000000000000.000000 |
| Stephen Brooks 2010-06-09 13:45:41 | So somehow your PhaseRotD results all disappeared from the count, though the file is still there! I've resubmitted it to look like a new file, see if that fixes things in the next recount. |
| Stephen Brooks 2010-06-09 14:28:48 | OK, that wasn't it, your problem was the PhaseRotD file shrunk to about half its size (or half the Mpts anyway). I'm stumped, it didn't trigger the backup mechanism when it did that either. So I've just credited the lost points back to your account. |
| GOD 2010-06-09 14:58:09 | Hi Stephen, From my side of the planet, it appeared to happen on 2010-jun-01. No change seems to have occurred yet on your stats count other than the number of hours since last active. http://stats.free-dc.org/stats.php?page=user&proj=dpad&name=[ARS]GOD shows -38,882,144 points for Jun-01. And here's me bragging about reaching 700,000,000 on Mar-31: http://arstechnica.com/civis/viewtopic.php?p=20459678&sid=d46813ded37e1f8376eadbbc954ab596#p20459678 I know I suck, but not that hard!  [Edited by GOD at 2010-06-09 14:58:47] |
| GOD 2010-06-09 16:09:35 | OK, it looks like the credit you applied appeared - was that 35,000,000? From your post above; 2010-Jun-02; 01:05 UTC 2543944 703971165.5 39 minus 2010-Jun-02; 02:58 UTC 2140402 665089021.1 41 equals 38,882,144 which is the same as reported at stats.free-dc.org above. It's probably close enough - up to you. Thanks! |
| GOD 2010-06-09 18:34:46 | Checking http://stats.free-dc.org/stats.php?page=user&proj=dpad&name=[ARS]GOD shows 38,838,467 points returned - that's definitely close enough. I wonder why that glitch got me and no-one else? Cheers. |
| RGtx 2010-06-09 22:32:31 | "I wonder why that glitch got me and no-one else?" Actually, on the same day that you lost ~35M, (June 8), Mezocop (Russia) lost ~38M; yet to be returned. |
| Stephen Brooks 2010-06-10 10:41:32 | It happened at exactly the same time: 2010-Jun-02; 01:05 UTC 751212 101431572.5 1528 2010-Jun-02; 02:58 UTC 370796 64564350.4 1530 ...and again in PhaseRotD: 2010-Jun-02 03:50:39 PhaseRotD v4.4 Added -380416/-36867222.1/0.132608 BMark 380416/36867222.1/0.297004 to 0/0.0/-9e99 Something must have gone wrong at exactly that point in time, maybe a disk write error? Anyway, Mezocop's point are going to be back soon too. |
| RGtx 2010-06-17 23:51:06 | 2010-Jun-12: [Team Ninja]PenDragon lost 207,869 [PhaseRotD, again] [ARS]guzzler lost 1,087,875 [DecayRotB] Both losses again occured at the same update. Me thinks, it's time to plug that leak. [Edited by RGtx at 2010-06-18 00:05:44] |
| Stephen Brooks 2010-06-18 12:22:25 | [ARS]guzzler hadn't been active for a while. 2007-Oct-10 21:08:54 PhaseRotDD v4.4 Added 21/10097.7/0.362521 BMark 6391/2390085.2/0.385680 to 6412/2400182.9/0.385680 2010-Jun-13 03:46:51 DecayRotB v4.4 Added -2945/-1087874.8/1.095745 Rejected 2945+0/1087874.8/1.081699 BMark 52075/9419621.2/1.095745 to 49130/8331746.4/1.095745 The good news is that his file shrinkage triggered the automatic emergency backup mechanism, so I can compare the file before and after the shrink to try and find out what is going on. DecayRotB\v4.4\results_[ARS]guzzler.txt file shrank when added to DecayRotB\v4.4\results_[ARS]guzzler.txt.RR, backed up to junk\_shrunken\20100613024649DecayRotB¬v4.4¬results_[ARS]guzzler.txt [0 bytes] (bpos=0) + [118287702 bytes] --> [111592043 bytes] {2945 repeats} |
| Stephen Brooks 2010-06-18 16:06:59 | OK, I resubmitted the backed-up file and exactly the same number of results were removed - so at least it's reproducible! That leaves two possibilities: (1) there is a bug where it is finding false "repeats" that aren't; (2) these really are repeats and for some reason the stats checker didn't find them before. |
| [DPC]white_panther 2010-06-22 18:30:13 | stephen what happent with the 6.6M points from teamNWW (DPC) they lost today 6.6M points. but the last time they were active on this project was on 18-01-2008  [Edited by [DPC]white_panther at 2010-06-22 18:30:35] |
| Stephen Brooks 2010-06-23 14:34:47 | Now that I've tested [ARS]guzzler's file, I find that the repeats in his file that were removed really were repeats. Not sure why they weren't removed the first time - these are all fairly old lattices so it could have been a period where the repeats checker wasn't working. |
| Stephen Brooks 2010-06-23 14:42:30 | The last two lines in TeamNWW's log are 2008-Jan-18 08:06:34 PhaseRotEb1 v4.4 Added 187/92774.1/3.081115 BMark 3118/1330217.6/3.183711 to 3305/1422991.7/3.183711 2010-Jun-22 03:45:58 PhaseRotB v4.4 Added -15197/-6676852.1/3.026242 BMark 15197/6676852.1/4.210487 to 0/0.0/-9e99 Looks like the points for all his PhaseRotB results were removed, even though the file is still there! I'll see what happens with this file. |
| Stephen Brooks 2010-06-23 15:48:53 | The TeamNWW passed with no repeats found at all. I've told the stats generator to recount all his points, that should make the points reappear. |
| [DPC]white_panther 2010-06-24 18:42:20 | Stephen if TeamNWW hasn't got anny repeats, how come they only got 4.809.936 from the 6.676.852 points. So there are still 1.866.916 points missing. |
| Stephen Brooks 2010-06-25 13:00:16 | Ah, I meant they didn't have any repeats in PhaseRotB. I recounted all the optimisations for TeamNWW and the log shows 4941 repeats (1801076.0 Mpts) in DecayRotB plus a few in PhaseRotD. (This is a similar situation to [ARS]guzzler's DecayRotB recount.) |
| [DPC]white_panther 2010-07-01 08:12:23 | -12.676.468 points are lost from [DPC]TEB last active was 10-08-2008 why? |
| Stephen Brooks 2010-07-02 17:40:32 | This happened in [DPC]TEB~SSSF's log, some PhaseRotB results were removed. 2008-Aug-10 15:01:26 PhaseRotC v4.4 Added 20/1493.3/0.312257 BMark 20763/1263865.3/0.246209 to 20783/1265358.6/0.246209 2010-Jul-01 04:01:15 PhaseRotB v4.4 Added -21245/-12676468.9/-0.9e+100 Rejected 7+0/4306.3/3.171161 BMark 21245/12676468.9/0.117069 to 0/0.0/-0.9e+100 Or rather, the PhaseRotB credit was reduced to zero. However, his file is still there, so I'm telling it to recount it (and generate its index/hash file again). |
| [DPC]white_panther 2010-07-08 16:45:36 | it's been over a week now and SSSF hasn't got his points back..... |
| Stephen Brooks 2010-07-08 17:20:34 | Ah, it's not noticed the index needs rebuilding. I've now resubmitted the results as if they were new. |
| [DPC]white_panther 2010-07-08 19:36:58 | thanks, the point are back |
| [DPC]white_panther 2010-07-12 18:04:40 | Now -1.498.635 points are lost from Team WAU. 12 October 2008 last active looks like the dubb checker meshedup another file. |
| [DPC]white_panther 2010-07-13 09:10:52 | and -57.132.814 points from DeApen~Kuuke do someting about it |
| Kuuke 2010-07-15 16:32:30 | Actually it looks to be not 57.132.814 points but -2632283 but nevertheless it would be kind to get some information about why these points disappeared |
| Kuuke 2010-07-17 11:22:06 | It looks like the loss of points continues. Stats for today show negative results for: WW0, NoizyCows and Super. They are members of the Dutch Power Cows. |
| Stephen Brooks 2010-07-17 17:40:01 | I fixed Kuuke and Team WAU last week, that's why Kuuke didn't lose 57 million, just 2.6 million which were most likely repeats. The files are still there, there's just a indexing problem which means they disappear from the totals sometimes - I'll see if I can find more detail on Monday! |
| [DPC]white_panther 2010-07-18 23:36:19 | i'm sorry, but Team WAU hasn't got there points back yet. |
| Stephen Brooks 2010-07-19 15:00:01 | I think I've found the source of the problem. When it does a scan of all the files, the stats generator looks at the file size to check with inconsistencies with its own index (files that need to be recounted). Unfortunately, my function that returns the size of a file sometimes returns "0" if the file can't be opened, which has been happening occasionally recently. This is what triggered the recounts and repeat-removal of very old files. I've now told it to take no action when filesize=0 is returned. |
| Stephen Brooks 2010-07-19 15:09:36 | Next update should be better (let me know if it's still missing any and by how much). |
| [DPC]white_panther 2010-07-19 22:53:35 | [dpc]noizycows~tomahawk still missing 3.244.725 point (from 2010-07-17) [dpc]super still missing 11.026.873 points (from 2010-07-17) the rest of the DPC users from the top 100 are fine. and i returned today 2010-07-19 over 600K and only found 450K back. if they are double, has it something to do with the fact that i use more then 1 pc? [Edited by [DPC]white_panther at 2010-07-19 22:54:44] |
| [DPC]white_panther 2011-01-11 14:36:48 | today [DPC] DMS flushed about 150K and he gets -2332 points he changed the config.txt so the random is higher so it can't be repeats, what happend? he says he's leaving this project, but i want him to stay a litle longer |
| Stephen Brooks 2011-01-13 11:16:39 | His file was certainly modified on the 11th (1434 results added but only 44 rejected as repeats), I've asked the stats script to re-count his files again. I suspect the loss was of repeats that were already there for some reason, though - I've got logs of a lot of manual sends of files in earlier months (probably a results.dat) with many repeats being removed. |
| [DPC]white_panther 2011-01-23 22:09:24 | and again [DPC]DMS lost points, he downloaded a new client again and lost over 80K. strange things happend to this user [Edited by [DPC]white_panther at 2011-01-23 22:09:53] |
| Stephen Brooks 2011-01-24 16:20:05 | There is something strange about that user, it says it added "-14" results without rejecting any. The indexing hash file appears to not contain all the results either. I've deleted it so it will rebuild. Can he send those results (or just results.dat) again? |
| Stephen Brooks 2011-01-24 17:50:01 | Fixed a bug in the routine the rebuilds the hash index for files when they grow a lot (or I delete the hash file in order to get a clean refreshed copy like just now). It meant that for some users, repeats or accidental uploads of results.dat were going unnoticed, only to be found later. |
| runesk 2012-01-02 17:15:41 | I lost about 8.8 mill today. Am I hit by the same bug? .R |
| Stephen Brooks 2012-01-09 15:53:01 | I notice this in the log 2012-Jan-02 11:05:52 Linac900Ext10tc2 v4.4 Added -10259/-10714549.3/3.731633 BMark 22885/25465347.6/3.732552 to 12626/14750798.3/3.732552 Don't know what it means exactly. Asking the stats to re-index that file (should happen in a few hours) to see if that helps. |
| runesk 2012-01-09 20:37:38 | Did not seem to restore any credits.. some negative movement for zachariassen today as well.. related? .r |
