I have a lot of data that gets indexed by the core search task. Here are my table sizes:
select count(*) from SearchItem - 24737 rows
select count(*) from SearchItemWord - 597849
select count(*) from SearchItemWordPosition - 1337070
select count(*) from SearchWord -57284
As soon as someone does a search on PokerDIY.com the whole site grinds to a halt with System Out of Memory exceptions, Timeouts and all sorts of issues (that appear on other parts of the site).
My solution is going to be to switch to the Google Custom Search Engine. The problem is that I use RSS feeds a lot on PokerDIY - latest Groups, latest leagues etc. and from my understanding I need the indexed content to power RSS (these are my Smart-Thinker modules and a lot of core and 3rd party mods)
So -
1) Is there any way to turn off core Search completely and keep RSS?
2) If not, how can I reduce the indexed data to just what I need? eg. I only need the last 10 users, not all 35 000 of them. I could of course change the Isearchable interface on the modules I control but does this mean that the core search is useless on a site of any size? I have chosen only to index words larger than 4 letters and do not include common words or numbers in the Search Admin screen.
3) How do large sites approach Search? This DNN mothership seems to use the core so how is it so responsive (PokerDIY.com is a fraction of the DNN.com site).
As a temp solution I am wiping all my search tables and disabling the scheduled task, but I fear this is going to kill all my RSS feeds... any help appreicated please.