Monday, April 4, 2011

Metadata Monday: Sophia Search and Taxonomy

Have you ever heard of document clustering? Well, a new company called Sophia Search claims to have harnessed the power of context resulting in more relevant search results and ultimately, organization of information.

Here is an article to help you make sense of this wizardry complete with an impressive example of accurate clustering applied to the vast content of The New York Times.

Again, I might sound like a broken record when I say that a powerful tool like Sophia Search coupled with a smart taxonomist might help many organizations to dig themselves out of information hell. But, I still firmly believe that an actual person needs to evaluate the returned data and create a taxonomy that works for people. Tools can automate, but not intuit.

3 comments:

  1. Hi Tracy,This post gives some examples, screenshots, explanation of Sophia vis a vis other search engienes - http://bit.ly/iemcWeSophia does not REQUIRE taxonomy, metadata, cataloging etc - it instead automatically by calculating the information entropy (from Claude Shannon's information theory) of documents. Its algorithms are published as research papers.best wishesChris PS see also @sophisearch on twitter

    ReplyDelete
  2. PPS - the research papers are listed at http://bit.ly/fwzu3v

    ReplyDelete
  3. Thanks for the clarification and supplementary information, Chris!

    ReplyDelete