stephenbrooks.orgForumMuon1GeneralMax. data to be flushed...
Username: Password:
Search site:
Subscribe to thread via RSS
[DPC] Zephyer
2004-11-02 01:37:37
Hi guys,

Can anyone give me the info bout the max.  data to be flushed in a day ?

I guess it's not the stats from Stephen that will be the bottleneck... but the FTP's.

So, i guess Stephen or the FTP owners need to answer this one...
What's the speeds you guys run on ?
(upload and download)

There's gonna be a mother of all flushes getting ready to be flushed in the near future.
But... as we don't want to hit any FTP's due to datatransfers... (or the stats from Stephen), i'm checking here...

So... i'll be waiting Smile
Z.
kitsura
2004-11-03 17:55:42
I think the only limit should be hard disk space because I have flushed more than 50MB and have seen 500MB being sent too.
[DPC] Zephyer
2004-11-04 09:49:11
Thnkx for that info...
Now we've got some aim that has worked in the past.

Z.
Stephen Brooks
2004-11-05 07:39:09
To be safe, I'd advise sending it in chunks rather than as one massively-large file.  That will spread the load across the servers and make it less likely to bork the stats.
Tony De Leenheir
2004-11-08 16:46:10
Stephen: how do we do that?  Without screwing up the result.txt
Stephen Brooks
2004-11-09 04:48:10
You can see in results.txt that the lines are in pairs: one very, very long line that specifies the design and is repeats of "param=value;" and a second, shorter line that goes "score (calculation Mpts) [version] {checksum} <latticename>". As long as you break the file so that these lines are still paired, you are OK.  So for instance you could make a load of files, rename one to results.txt, use manualsend.bat on that, and repeat.
Tony De Leenheir
2004-11-09 23:21:28
and from what size of the results.txt would you advise to do so?
Stephen Brooks
2004-11-10 03:17:54
Pieces of 10MB should go through fine.
[DPC] Zephyer
2004-11-24 06:06:29
Thnkx for that info... Smile
[DPC]Stephan202
2004-12-02 11:28:58
A week or two ago I made this chop script (Perl): http://student.science.uva.nl/~sschroev/DPAD/scripts/results_chopper.pl

Use it as you like.  The default output file size is 10MB.
[DPC] - Alphen
2004-12-06 06:00:06
The day of days has come...
The MOAF is on it's way...

Hold on to anything that's tough enough to hold out in a Hurricane...

DPC is flushing... and there's more to come.. Big Grin
[DPC]Alphen - Milo
2004-12-06 07:00:46
Just uploaded a results file of 135 MB to Stephen's ftp server.
Hope you can handle it Wink
: contact : - - -
E-mail: sbstrudel characterstephenbrooks.orgTwitter: stephenjbrooksMastodon: strudel charactersjbstrudel charactermstdn.io RSS feed

Site has had 25165156 accesses.