We have over 900 live blogs, probably 200 are active and maybe 100 are really active.

Our blogs have 700k visits per month, with around 3 million+ page views by actual humans and probably 7 to 8 million total page views counting bots.

Our bot visits are extraordinarily high. See our minimal robots.txt – we attempt to enforce the Crawl-delay value through the excellent limiting features provided by nginx.

Posted in: Blog Admin FAQs