Skip to content

Update spider.py to fix Issue # 29#30

Open
jetvillegas wants to merge 1 commit intorubys:masterfrom
jetvillegas:patch-1
Open

Update spider.py to fix Issue # 29#30
jetvillegas wants to merge 1 commit intorubys:masterfrom
jetvillegas:patch-1

Conversation

@jetvillegas
Copy link

Add a 'user agent' field to threaded spider jobs

Add a 'user agent' field to threaded spider jobs
@jetvillegas jetvillegas changed the title Update spider.py Update spider.py to fix Issue # 29 May 21, 2014
@reedloden
Copy link

Dupe of #22

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants