Statistics

[wpdatachart id=6]

• resources – (Pages crawled) A resources counter shows a number of resources in the storage. Resource – it is a crawled but not processed item. If all stages of a data processing finished this counter in zero value, if not – it means that some crawled items still waiting on processing or never be processed because selection to process conditions does not match (for example, the content-type of a crawled item is text/xml, but text/html required).

[wpdatachart id=7]

• new – (URLs ready to crawl) A new counter shows a number of items that was not crawled or processed yet (just inserted) or waiting on crawling (after re-crawling).
• deleted – (Waiting on cleanup) A deleted counter shows a number of items that was deleted from storage and waiting on data cleanup.
• contents – (Pages processed) A contents counter shows a number of processed items.
• collected – (project’s URLs)A collected counter shows a total number of items in the storage but not including a root URLs.

[wpdatachart id=8]

• iterations – (Recrawling iterations)
• errors – (Total errors on recrawling) An errors counter shows a total number of errors happened since last crawling or re-crawling started.