Navigation
index
modules
|
Scrapy v documentation
»
Global Module Index
S
S
scrapy
scrapy.conf
Settings manager
scrapy.contrib.closespider
Close spider extension
scrapy.contrib.corestats.corestats
Core stats collection
scrapy.contrib.debug
Extensions for debugging Scrapy
scrapy.contrib.downloadermiddleware
scrapy.contrib.downloadermiddleware.cookies
Cookies Downloader Middleware
scrapy.contrib.downloadermiddleware.defaultheaders
Default Headers Downloader Middleware
scrapy.contrib.downloadermiddleware.httpauth
HTTP Auth downloader middleware
scrapy.contrib.downloadermiddleware.httpcache
HTTP Cache downloader middleware
scrapy.contrib.downloadermiddleware.httpcompression
Http Compression Middleware
scrapy.contrib.downloadermiddleware.httpproxy
Http Proxy Middleware
scrapy.contrib.downloadermiddleware.redirect
Redirection Middleware
scrapy.contrib.downloadermiddleware.retry
Retry Middleware
scrapy.contrib.downloadermiddleware.robotstxt
robots.txt middleware
scrapy.contrib.downloadermiddleware.stats
Downloader Stats Middleware
scrapy.contrib.downloadermiddleware.useragent
User Agent Middleware
scrapy.contrib.exporter
Item Exporters
scrapy.contrib.exporter.jsonlines
JsonLines Item Exporter
scrapy.contrib.linkextractors
Link extractors classes
scrapy.contrib.linkextractors.sgml
SGMLParser-based link extractors
scrapy.contrib.loader
Item Loader class
scrapy.contrib.loader.processor
A collection of processors to use with Item Loaders
scrapy.contrib.memdebug
Memory debugger extension
scrapy.contrib.memusage
Memory usage extension
scrapy.contrib.pipeline
Item Pipeline manager and built-in pipelines
scrapy.contrib.pipeline.fileexport
scrapy.contrib.pipeline.images
Images Pipeline
scrapy.contrib.schedulermiddleware
scrapy.contrib.schedulermiddleware.duplicatesfilter
Duplicates Filter Scheduler Middleware
scrapy.contrib.spidermiddleware
scrapy.contrib.spidermiddleware.depth
Depth Spider Middleware
scrapy.contrib.spidermiddleware.httperror
HTTP Error Spider Middleware
scrapy.contrib.spidermiddleware.offsite
Offiste Spider Middleware
scrapy.contrib.spidermiddleware.referer
Referer Spider Middleware
scrapy.contrib.spidermiddleware.requestlimit
Request limit Spider Middleware
scrapy.contrib.spidermiddleware.urlfilter
URL Filter Spider Middleware
scrapy.contrib.spidermiddleware.urllength
URL Length Spider Middleware
scrapy.contrib.spiders
Collection of generic spiders
scrapy.contrib.statsmailer
StatsMailer extension
scrapy.contrib.webconsole
Contains most built-in web console extensions
scrapy.contrib.webconsole.enginestatus
Engine status web console extension
scrapy.contrib.webconsole.livestats
Spider live stats web console extension
scrapy.contrib.webconsole.scheduler
Scheduler queue web console extension
scrapy.contrib.webconsole.stats
Stats dump web console extension
scrapy.core.exceptions
Core exceptions
scrapy.core.signals
Signals definitions
scrapy.extension
The extension manager
scrapy.http
Request and Response classes
scrapy.item
Item and Field classes
scrapy.log
Logging facility
scrapy.mail
Helpers to easily send e-mail.
scrapy.management.telnet
The Telnet Console
scrapy.management.web
Web management console
scrapy.selector
XPath selectors classes
scrapy.spider
Spiders base class, spider manager and spider middleware
scrapy.stats.collector
Basic Stats Collectors
scrapy.stats.collector.simpledb
Simpledb Stats Collector
scrapy.stats.signals
Stats Collector signals
scrapy.utils.trackref
Track references of live objects
Quick search
Enter search terms or a module, class or function name.
Navigation
index
modules
|
Scrapy v documentation
»