[DPC] Zephyer 2004-11-02 01:37:37 | Hi guys, Can anyone give me the info bout the max. data to be flushed in a day ? I guess it's not the stats from Stephen that will be the bottleneck... but the FTP's. So, i guess Stephen or the FTP owners need to answer this one... What's the speeds you guys run on ? (upload and download) There's gonna be a mother of all flushes getting ready to be flushed in the near future. But... as we don't want to hit any FTP's due to datatransfers... (or the stats from Stephen), i'm checking here... So... i'll be waiting Z. |
kitsura 2004-11-03 17:55:42 | I think the only limit should be hard disk space because I have flushed more than 50MB and have seen 500MB being sent too. |
[DPC] Zephyer 2004-11-04 09:49:11 | Thnkx for that info... Now we've got some aim that has worked in the past. Z. |
Stephen Brooks 2004-11-05 07:39:09 | To be safe, I'd advise sending it in chunks rather than as one massively-large file. That will spread the load across the servers and make it less likely to bork the stats. |
Tony De Leenheir 2004-11-08 16:46:10 | Stephen: how do we do that? Without screwing up the result.txt |
Stephen Brooks 2004-11-09 04:48:10 | You can see in results.txt that the lines are in pairs: one very, very long line that specifies the design and is repeats of "param=value;" and a second, shorter line that goes "score (calculation Mpts) [version] {checksum} <latticename>". As long as you break the file so that these lines are still paired, you are OK. So for instance you could make a load of files, rename one to results.txt, use manualsend.bat on that, and repeat. |
Tony De Leenheir 2004-11-09 23:21:28 | and from what size of the results.txt would you advise to do so? |
Stephen Brooks 2004-11-10 03:17:54 | Pieces of 10MB should go through fine. |
[DPC] Zephyer 2004-11-24 06:06:29 | Thnkx for that info... |
[DPC]Stephan202 2004-12-02 11:28:58 | A week or two ago I made this chop script (Perl): http://student.science.uva.nl/~sschroev/DPAD/scripts/results_chopper.pl Use it as you like. The default output file size is 10MB. |
[DPC] - Alphen 2004-12-06 06:00:06 | The day of days has come... The MOAF is on it's way... Hold on to anything that's tough enough to hold out in a Hurricane... DPC is flushing... and there's more to come.. |
[DPC]Alphen - Milo 2004-12-06 07:00:46 | Just uploaded a results file of 135 MB to Stephen's ftp server. Hope you can handle it |