In the newer version of the egrep clone with function name display (a snapshot can be downloaded from http://www.math.bme.hu/~ambrus/pu/cgrep) I require the File::Find module only if a recursive grep is requested.
I just did a quick mesurement to see how much time this conserves. I ran a grepping command on a single small file that runs very fast. When I didn't use recursive grepping, the command ran in 0.49 seconds. When I turned on recursive grepping (which doesn't make much sense as I haven't given any directories only a single file) it ran in 0.78 seconds.
As a comparision, the grep program (which is written in C) always did the same search in 0.00 seconds, whether recursive or not.