High-Performance Server Architecture is a great article about making network servers go fast. I highly recommend reading it if you are interested in implementing big distributed systems. In fact, Jeff Darcy's "four horsemen of poor performance" are so fundamental that they should be taught in school: