Comments on: Finding keywords using Python http://uswaretech.com/blog/2009/03/finding-keywords-using-python/ Building Amazing Webapps Sat, 13 Mar 2010 00:26:09 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: buy_vigrxplus http://uswaretech.com/blog/2009/03/finding-keywords-using-python/comment-page-1/#comment-1931 buy_vigrxplus Tue, 14 Jul 2009 12:47:38 +0000 http://uswaretech.com/blog/?p=214#comment-1931 <p>Great post! I’ll subscribe right now wth my feedreader software!</p> Great post! I’ll subscribe right now wth my feedreader software!

]]> By: thecapacity » Blog Archive » CouchDB Performance or Use a File http://uswaretech.com/blog/2009/03/finding-keywords-using-python/comment-page-1/#comment-610 thecapacity » Blog Archive » CouchDB Performance or Use a File Fri, 20 Mar 2009 02:49:44 +0000 http://uswaretech.com/blog/?p=214#comment-610 <p>[...] samples and feeling like I’d gotten my legs underneath me I decided to “port” a nice little example over to couchDB. If you want to play along at home then you’ll want to check out the article [...]</p> [...] samples and feeling like I’d gotten my legs underneath me I decided to “port” a nice little example over to couchDB. If you want to play along at home then you’ll want to check out the article [...]

]]> By: Joe Ganley http://uswaretech.com/blog/2009/03/finding-keywords-using-python/comment-page-1/#comment-314 Joe Ganley Wed, 11 Mar 2009 15:50:26 +0000 http://uswaretech.com/blog/?p=214#comment-314 <p>You could do this in just a few lines of code by using a more Pythonic, functional style instead of this very imperative style; see, e.g., http://digitalhistoryhacks.blogspot.com/2006/08/easy-pieces-in-python-word-frequencies.html</p> <p>The sort_func is totally unnecessary; just do test_word_ba_list.sort(key = operator.itemgetter(1))</p> <p>Also, you probably want to remove stop words (a, and, the, etc.).</p> <p>Finally, raw term frequency isn't the best measure to identify the most important keywords; instead, for example, you might use the term's frequency in the document divided by its frequency in English overall (or across a larger corpus of documents).</p> You could do this in just a few lines of code by using a more Pythonic, functional style instead of this very imperative style; see, e.g., http://digitalhistoryhacks.blogspot.com/2006/08/easy-pieces-in-python-word-frequencies.html

The sort_func is totally unnecessary; just do test_word_ba_list.sort(key = operator.itemgetter(1))

Also, you probably want to remove stop words (a, and, the, etc.).

Finally, raw term frequency isn’t the best measure to identify the most important keywords; instead, for example, you might use the term’s frequency in the document divided by its frequency in English overall (or across a larger corpus of documents).

]]>