Understanding Spider Configuration

The Heaton Research Spider uses the SpiderOptions class for basic configuration information. There are two ways to configure the spider. Either you must set the properties of the SpiderOptions class directly, or you must instruct the spider to load the SpiderOptions properties from a file. This article shows how to do this, as well as what the items in the configuration file mean.