[livejournal] r18643: LJSUP-8278: robots.txt for communities

LJSUP-8278: robots.txt for communities

U   trunk/cgi-bin/Apache/LiveJournal.pm

Modified: trunk/cgi-bin/Apache/LiveJournal.pm
===================================================================
--- trunk/cgi-bin/Apache/LiveJournal.pm	2011-03-21 06:26:25 UTC (rev 18642)
+++ trunk/cgi-bin/Apache/LiveJournal.pm	2011-03-21 07:36:13 UTC (rev 18643)
@@ -1546,6 +1546,8 @@
         LJ::Request->print("User-Agent: *\n");
         if ($u->should_block_robots) {
             LJ::Request->print("Disallow: /\n");
+        } else {
+            LJ::Request->print("Disallow: /data/foaf/\n");
         }
         return LJ::Request::OK
     }