| Browser |
AJAX Spider relies on an external browser to crawl the targeted site. You can specify which one you want to use. For more details on supported browsers refer to “Selenium” add-on help pages. |
Firefox Headless |
| Number of Browser Windows to Open |
You can configure the number of windows to be used by AJAX Spider. The more windows, the faster the process will be. |
Num cores |
| Maximum Crawl Depth |
The maximum depth that the crawler can reach. Zero means unlimited depth. |
10 |
| Maximum Crawl States |
The maximum number of states that the crawler should crawl. Zero means unlimited crawl states. |
0 (unlimited) |
| Maximum Duration |
The maximum time that the crawler is allowed to run. Zero means unlimited running time. |
60 minutes |
| Event Wait Time |
The time to wait after a client side event is fired. |
1000 ms |
| Reload Wait Time |
The time to wait after URL is loaded. |
1000 ms |
| Enable Browser Extensions |
When enabled, any browser extensions added by other add-ons will be enabled in the browsers used for crawling. |
False |
| Click Elements Once |
When enabled, the crawler attempts to interact with each element (e.g., by clicking) only once. If this is not set, the crawler will attempt to click multiple times. Unsetting this option is more rigorous but may take considerably more time. |
True |
| Use Random Values in Form Fields |
When enabled, inserts random values into form fields. Otherwise, it uses empty values. |
True |
| Click Default Elements Only |
When enabled, only elements “a”, “button” and “input” will be clicked during crawl. Otherwise, it uses the table below to determine which elements will be clicked. For more in depth analysis, disable this and configure the clickable elements in the table. |
True |
| Select elements to click during crawl (table) |
The list of elements to crawl. This table only applies when “click default elements only” is not enabled. Use “enable all” for a more in depth analysis, though it may take somewhat longer. |
All enabled |
| Allowed Resources (table) |
The list of allowed resources. The allowed resources are always fetched even if out of scope, allowing to include necessary resources (e.g. scripts) from 3rd-parties. |
|