Harvest Templates
Template for daily harvest
Some help to harvest newspapers : a way to stop automatically the harvest after a day (exactly after 23 hours so the deduplication has time to be finished). Here is the extract of the order.xml for this purpose:
A processor that halts further progress once a fixed amount of time has elapsed since the start of a crawl.
...
| Child pages (Children Display) | ||
|---|---|---|
|