A Web Developer in Winnipeg
The other day I was doing some surfing as googlebot (using firefox’s user agent switcher plugin) to try to debug some weirdly cloaked spammy search results I was seeing. I had accidentally done 3 searches as googlebot when I was redirected to sorry.google.com with this error screen:
Odd.
To scale at Digg they followed a set of practices very similar to those used at eBay. No joins, no foreign key constraints (to scale writes), primary key look-ups only, limited range queries, and joins were done in memory. When implementing the comment feature a 4,000 percent increase in performance was created by sorting in PHP instead of MySQL. All this effort required to make a relational database scale basically meant you were using a non-relational database anyway. So why not just use a non-relational database from the start?
[via High Scalability]
[iTunes Link]