[ciapug] MySQL fulltext common word filtering

[carl-olsen at mchsi.com]

I found the default set of stop words, and I found the setting that allows you to create your own stop word list, which is found in the my.ini file on Windows.  However, the problem I'm having is the 50% rule.  The MySQL manual says you can turn this off or on, but it does not tell me how to find out which words have been filtered.  I don't want to turn it off, I just want to display a message to the user explaining what happened.  If the word is a stop word, I want to display a message telling the user the word has been filtered (this is easy to do, because I have the list of stop words).  I also want to display a message telling the user the word has been filtered if it meets the 50% rule (this is not easy to do, because I have no idea how to find the list of words that occur in over 50% of the rows in my database.  I suppose I could start doing queries on words I suspect are found over 50% of the time, but that could change as users keep adding data to the database.  Does anyone
 know how to find out if a search failed because of the 50% rule and return a meaningful message to the user explaining what happened?

Carl Olsen
Drake University
www.drake.edu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://cialug.org/pipermail/ciapug/attachments/20060914/0e93138b/attachment.htm