Gmane is an archive of public mailing lists, accessible via the web and NNTP. It has been running for nearly 8 years, and now carries around 12000 mailing lists. It runs on Linux and is powered entirely by Free/Open Source software..
One of the services Gmane offers is a free-text search of over 70 million email messages, built using Xapian and libgmime, and running on a single server. In this presentation, you'll learn exactly how this works.
Slides: http://survex.com/~olly/how_search.gmane.org_works_lca2010/
OllyBettsOlly is the lead developer of the Xapian search engine library. He's spent 13 years working in the field of information retrieval, including running the EuroFerret website, which was the most comprehensive index of European web pages in its day.
He's been working on Xapian for 10 years, and makes a living as a freelance developer and consultant on Xapian-related projects.
Olly is originally from the UK where he studied mathematics and computer science at Cambridge University, but now lives near Wellington, New Zealand. He once broke a toe falling off a cliff in Majorca.
|
