Welcome guest

Some new cool numbers

Posted by ben 21 Aug 2010 | 0 comments

It's been a while since I posted about the volume of traffic coming through here. On the 10th of June I posted about reaching 108m events in a single day. That record was very short lived though I was busy working on the new version of everything and making games and stuff.

The total number of events today: 194,399,231

To put that into perspective:

  • it's an average of 2250 events per second all day long

  • 34 gigabytes of logfiles recorded the events

  • about 100 gigabytes of data was transferred to/from, fortunately the new servers from Hivelocity come with a staggering 10 terabytes each of bandwidth

The new log processing software I launched a few weeks ago performed admirably, reports updated 174 times during the day or about every 8.5 minutes on average. It's almost time to do another iteration of that software though, frequently throughout the day I could see a small number of files waiting to be processed in the queue. I have some ideas on how I can shave a few more minutes off the processing time, on top of which it's still single-threaded which means only one set of files are processed at a time so there's a lot of room to bring the lag between a player doing something in your game and that data hitting your reports down to the 1 or 2 minutes window.

It's the biggest day so far although I doubt it will be for long, by the end of this month I expect our games will be sending more than 200 million events per day.

Some of the culprits

Comments

blog comments powered by Disqus