 |
|
|
|
 |
moncster
Guest
Registered: Not Yet
Location:
|
|
|
Maybe if it's too hard to filter out the generic <4 letter words, we could do it by white list. There aren't too many <4 letter words that we "really" need anyway. As we need more, we could probably update the white list easily.
Oh and let the white listed words have the same priority as regular search queries.
|
|
 Jul-18-2003 20:48
|
|
|
|
|
JohnSmith
Agent Smith
Registered: Apr 2002
Location: Kamloops
|
|
|
BT is the only 2 letter word you could think of searching? how about DJ? or TT (common abbreviation for turntable). or CD. those all get missed.
The problem with searching is that it takes a tremendous amount of processing to do, especially if words like "the" are searched on. it's not the length of the word, but the frequency of it. The best way to get around this is to have a list of unsearchable terms.
This is what we do, if you search for a common word, then you get this message:
Ignored Terms:
The following terms are ignored by search. This is done to provide both faster search results and more relevant results.
a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, $, about, after, all, also, an, and, another, any, are, as, at, be, because, been, before, being, between, both, but, by, came, can, come, could, did, do, each, for, from, get, got, has, had, he, have, her, here, him, himself, his, how, if, in, into, is, it, like, make, many, me, might, more, most, much, must, my, never, now, of, on, only, or, other, our, out, over, said, same, see, should, since, some, still, such, take, than, that, the, their, them, then, there, these, they, this, those, through, to, too, under, up, very, was, way, we, well, were, what, where, which, while, who, with, would, you, your
our servers are searching 3GB sql server databases, and the results usually come back in less than 5 seconds.
___________________
 Visit my site Antiwar Homepage
|
|
Jul-18-2003 22:09 
|
|
|
|
|
Spad
wise sage of the forest
Registered: Jun 2001
Location: Chesterfield ,UK
|
|
|
The search just hunts out strings doesn't it, not just whole words. So a search for BT would also bring up any thread with the words
debt, debts, doubt, debtor, doubts, obtain, obtect, obtest, obtund, obtuse, subtle, subtly, bobtail, debtors, doubted, doubter, obtains, obtests, obtrude, obtunds, obtuser, redoubt, subtask, subtaxa, subteen, subtend, subtest, subtext, subtile, subtler, subtone, subtype, bobtails, codebtor, debtless, doubters, doubtful, doubting, indebted, misdoubt, obtained, obtainer, obtected, obtested, obtruded, obtruder, obtrudes, obtunded, obturate, obtusely, obtusest, obtusity, redoubts, reobtain, subtasks, subtaxon, subteens, subtends, subtests, subtexts, subtheme, subtiler, subtilin, subtilty, subtitle, subtlest, subtlety, subtones, subtonic, subtopia, subtopic, subtotal, subtract, subtrend, subtribe, subtunic, subtypes, unsubtle, unsubtly, bobtailed, codebtors, doubtable, doubtless, misdoubts, obtainers, obtaining, obtesting, obtruders, obtruding, obtrusion, obtrusive, obtunding, obturated, obturates, obturator, reobtains, subtaxons, subtenant, subtended, subthemes, subtilely, subtilest, subtilins, subtilize, subtitled, subtitles, subtonics, subtopias, subtopics, subtotals, subtracts, subtrends, subtribes, subtropic, subtunics, thumbtack, undoubted, bobtailing, doubtfully, doubtingly, misdoubted, obtainable, obtainment, obtrusions, obturating, obturation, obturators, obtuseness, obtusities, oversubtle, reobtained, subtenancy, subtenants, subtending, subterfuge, subtextual, subtilisin, subtilized, subtilizes, subtilties, subtitling, subtleness, subtleties, subtotaled, subtotally, subtracted, subtracter, subtrahend, subtropics, thumbtacks, undoubting,
doubtlessly, misdoubting, obtainments, obtrusively, obturations, redoubtable, redoubtably, reobtaining, subterfuges, subterminal, subtileness, subtilisins, subtilizing, subtotaling, subtotalled, subtracters, subtracting, subtraction, subtractive, subtrahends, subtreasury, subtropical, supersubtle, thumbtacked, undoubtable, undoubtedly, unobtrusive, doubtfulness, indebtedness, obtusenesses, subtemperate, subtenancies, subterranean, subthreshold, subtlenesses, subtotalling, subtractions, thumbtacking, unobtainable, doubtlessness, obtainability, obtrusiveness, subterraneous, subtilenesses, subtilization, subtreasuries, supersubtlety, unobtrusively, doubtfulnesses, indebtednesses, subterraneanly, subtherapeutic, subtilizations, doubtlessnesses, obtainabilities, obtrusivenesses, subterraneously, supersubtleties, unobtrusiveness, overindebtedness, unobtrusivenesses and overindebtednesses.
Not to mention net abbreviations like "abt".
So the search would have to be modified so it would only search for full words on words less than 3 characters, but also taking into account if you type in multiple words some being more than 3 characters and some being less.
Big job I would've thought....
edit: wot johnsmith said
|
|
Jul-18-2003 22:15 
|
|
|
|
|
|
|
|
Coup
Retired
Registered: May 2001
Location: England, UK
|
|
|
| quote: | Originally posted by BigDil
I think you should include "lol", "ffs", "stfu", etc, as they are frequently used... if this decreases the load on the server at all. |
lmfao, rofl, lmao, haha, hehe, w00t, woot, woohoo, erm..
|
|
Jul-20-2003 13:21 
|
|
|
|
|
BigDil
Hungarian trancEaddict
Registered: Mar 2002
Location: Budapest, Hungary
|
|
|
| quote: | Originally posted by Coup
lmfao, rofl, lmao, haha, hehe, w00t, woot, woohoo, erm.. |
how can we forget "omg" and "omfg".. they're extremly popular as well. 
___________________
"I use drugs sometimes... no actually I use them a lot, I'm an addict... My drugs are cheap and they make me feel fine. The only problem is I can't get enough of them... they are called TRANCE, have you heard of them?"
|
|
Jul-20-2003 14:14 
|
|
|
|
All times are GMT. The time now is 20:21.
Forum Rules:
You may not post new threads
You may not post replies
You may not edit your posts
|
HTML code is ON
vB code is ON
[IMG] code is ON
|
|
|
|
|
|
Contact Us - return to tranceaddict
Powered by: Trance Music & vBulletin Forums
Copyright ©2000-2026, Jelsoft Enterprises Ltd.
Privacy Statement / DMCA
|
