From: FL (no email)
Date: Thu Jan 17 2002 - 05:02:59 EST
Hi!
To index my quite huge database, I decided to run a loop :
./index -N5 -R5 -n 5000 2>log
./index -D
The program is lauched each hour via cron.
I have noticed that the robot.txt files seems to be always downloaded
before real indexing starts, wich is not quite efficient with my
configuration (with about 400 differents Server commands).
What -q tag really means ? Will it solve my problem ?
Thanks,
Francois
|
|
|