Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Comment on

( #3333=superdoc: print w/ replies, xml ) Need Help??

Here is the "cache.pl" script, that needs to be run each time the site is updated:

#!/usr/local/bin/perl -w # this script builds a cache of web pages, which can be searched # by sitesearch.pl; shd be run each time web site content changes use strict; use CGI qw(:standard); use Data::Dumper; my $dir = 'your_file_path'; # dir to search. my $ext = 'htm'; # page types to search. my $cache = 'sitesearch.dat'; # cache file. my (@Results,$file,$title); # optional boundaries for search area, to avoid # searching on repeated text: my $startstring = 'unique_ident_1'; my $endstring = 'unique_ident_2'; chdir $dir; # get all the relevant pages, strip out title, file name and # searchable text, store in array of hashes: while (<*.$ext>) { open FILE, $_; read FILE, $file, -s(FILE); $file =~ m#<title>(.*?)</title>#i; $title = $1; $file =~ s/^.*$startstring/$startstring/s; # delete these 2 lines + if $file =~ s/$endstring.*$//s; # you want to search t +he whole page $file =~ s/<[^>]*>/ /g; push @Results, {filename => $_, title => $title, text => $file}; } # save the results in the cache file: open SAVE, ">$cache" or die "could not open $cache $!"; print SAVE Dumper(\@Results); close SAVE; # check what has been saved in the cache file, and display it: open RETRIEVE, $cache or die "could not open $cache $!"; my $data = do { local $/; <RETRIEVE> }; my @Retrieves = @{ my $VAR1; eval $data }; print header,h2('You have successfully cached the following pages:'); print $_->{title},br for @Retrieves;

Here is the "sitesearch.pl" script, which shd be called from a form on all the pages on the site:

#!/usr/local/bin/perl -w # this script searches the given web directory for # pages containing the given search term. Need to run # cache.pl first to create the cache file. use lib 'your_file_path'; use strict; use CGI qw(:standard); use HTML::Template; my $cache = '/u/www/virtual/w01-0785/sitesearch.dat'; # path to cache +file. my $param = 'search'; # name field from input tag # in calling web page. # get the web site data from the cache: open RETRIEVE, $cache or die "could not open $cache $!"; my $data = do { local $/; <RETRIEVE> }; my @Retrieves = @{ my $VAR1; eval $data }; # search the data and pull out the relevant filenames and page titles: my $SearchTerm = param($param); my @Results; my $text; for (@Retrieves) { if ($_->{text} =~ /$SearchTerm/i) { push @Results, {filename => $_->{filename}, title => $_->{title +}}; } } # print the search results: my $results_tmpl = HTML::Template->new(filename => 'siteresults.tmpl') +; $results_tmpl->param( search_term => $SearchTerm, results => [@Results], ); print header; print $results_tmpl->output();

There also has to be a file called siteresults.tmpl, which shd look like the other html files on the site, but contain, at the appropriate point, this stuff:

# send back the sitesearch input box: <form method="get" action="http://your_path/cgi-bin/sitesearch.pl"> <input type="text" name="search" size="15" value="<TMPL_VAR SEARCH +_TERM>"> </form> ..... # print out the relevant links: Here are the Pages that match your Search Terms:<br> <TMPL_LOOP RESULTS> <a href="http://your_path/<TMPL_VAR FILENAME>"><TMPL_VAR TITLE></a +><br> </TMPL_LOOP>

In reply to Sitesearch Lite by George_Sherston

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post; it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • Outside of code tags, you may need to use entities for some characters:
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.
  • Log In?
    Username:
    Password:

    What's my password?
    Create A New User
    Chatterbox?
    and the web crawler heard nothing...

    How do I use this? | Other CB clients
    Other Users?
    Others about the Monastery: (9)
    As of 2014-12-21 02:46 GMT
    Sections?
    Information?
    Find Nodes?
    Leftovers?
      Voting Booth?

      Is guessing a good strategy for surviving in the IT business?





      Results (101 votes), past polls