{"id":358,"date":"2011-11-29T10:15:05","date_gmt":"2011-11-29T15:15:05","guid":{"rendered":"http:\/\/blogs.law.harvard.edu\/djcp\/?p=358"},"modified":"2011-11-29T10:15:05","modified_gmt":"2011-11-29T15:15:05","slug":"yacy-a-p2p-search-engine","status":"publish","type":"post","link":"https:\/\/archive.blogs.harvard.edu\/djcp\/2011\/11\/yacy-a-p2p-search-engine\/","title":{"rendered":"YaCy &#8211; a p2p search engine"},"content":{"rendered":"<p>So I&#8217;m running a <a href=\"http:\/\/collispuro.dyndns.org:8090\/\">YaCy node<\/a>\u00a0&#8211; which is a pretty<a href=\"http:\/\/yacy.net\/en\/\"> awesome project to create a search engine\u00a0indexed &#8220;by the people, for the people.&#8221;<\/a><\/p>\n<p>YaCy provides a java servent \u00a0that can index internal resources and external web pages. You have MANY controls over what and how it&#8217;s indexing and the resources allocated to it. There are tons of built-in analytics and logging for the stats geek in you.<\/p>\n<p>It&#8217;s still rough, but seems damned promising. \u00a0A bonus &#8211; it uses <a href=\"http:\/\/jquery.org\">jQuery<\/a> and <a href=\"http:\/\/lucene.apache.org\">Solr<\/a>.<\/p>\n<p>I really like the idea of indexing all the content you care about and also providing that index to the world at large to search, but I have concerns over the long-term impact of more &#8216;bots crawling the web. I would like to see YaCy figure out a way to minimize it&#8217;s impact on a global level &#8211; if every yacy node is indexing the same sites, it could easily escalate to a DDoS-level problem. Perhaps they&#8217;re already working on this issue.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>So I&#8217;m running a YaCy node\u00a0&#8211; which is a pretty awesome project to create a search engine\u00a0indexed &#8220;by the people, for the people.&#8221; YaCy provides a java servent \u00a0that can index internal resources and external web pages. You have MANY &hellip; <a href=\"https:\/\/archive.blogs.harvard.edu\/djcp\/2011\/11\/yacy-a-p2p-search-engine\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1984,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[4,2978,1210,17294,17314],"class_list":["post-358","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-code","tag-freedom","tag-java","tag-jquery","tag-solr"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/posts\/358","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/users\/1984"}],"replies":[{"embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/comments?post=358"}],"version-history":[{"count":2,"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/posts\/358\/revisions"}],"predecessor-version":[{"id":360,"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/posts\/358\/revisions\/360"}],"wp:attachment":[{"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/media?parent=358"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/categories?post=358"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/djcp\/wp-json\/wp\/v2\/tags?post=358"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}