Re: Re: Re: Complicated searches in a very large text file.

[ant9000]

Tons of people already pointed out Swish-E: that's the way I'd go myself, considering it already does all the searches you are looking for (and more) and that you can access its index files directly from Perl, via its Perl interface.

[waswas-fng]

From the Swish docs,


The wildcard (*) is available, however it can only be used at the end 
+of a word: otherwise is is considerd a normal character (i.e. can be 
+searched for if included in the WordCharacters directive). 

        swish-e -w "librarian" -f myIndex
 


this query only retrieves files which contain the given word. 

On the other hand: 

        swish-e -w "librarian*" -f myIndex
 


retrieves ``librarians'', ``librarianship'', etc. along with ``librari
+an''.

So how would you go about having a search string such as "test and apple" be able to match on a document conatining "an apple is good to eat when they come from the grabaltester reigon of madeupcountry."

-Waswas