mechanize: Net::HTTP::Persistent::Error: too many connection resets (due to Connection reset by peer - Errno::ECONNRESET) after 2 requests on 14759220
I am trying to do some simple screen scraping on etrade’s website but am getting a similar issue that was reported by someone earlier. I read through that message thread but it doesn’t look like it was ever resolved.
Here is the error I am getting back:
Net::HTTP::Persistent::Error: too many connection resets (due to Connection reset by peer - Errno::ECONNRESET) after 2 requests on 14759220
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/net-http-persistent-1.8/lib/net/http/persistent.rb:446:in `rescue in request'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/net-http-persistent-1.8/lib/net/http/persistent.rb:422:in `request'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/mechanize-2.0.1/lib/mechanize/http/agent.rb:204:in `fetch'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/mechanize-2.0.1/lib/mechanize.rb:628:in `post_form'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/mechanize-2.0.1/lib/mechanize.rb:520:in `submit'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/mechanize-2.0.1/lib/mechanize/form.rb:167:in `submit'
from (irb):74
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/railties-3.0.9/lib/rails/commands/console.rb:44:in `start'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/railties-3.0.9/lib/rails/commands/console.rb:8:in `start'
from /Users/benny/.rvm/gems/ruby-1.9.2-p180@taxhaven/gems/railties-3.0.9/lib/rails/commands.rb:23:in `<top (required)>'
from script/rails:6:in `require'
from script/rails:6:in `<main>'
Here is my code:
require 'rubygems'
require 'mechanize'
agent = Mechanize.new
login_page = agent.get("https://www.etrade.com")
form = login_page.form_with(:action => '/login.fcc')
form.USER = "test"
form.PASSWORD = "test12"
form.submit
Any ideas?
Thanks
About this issue
- Original URL
- State: closed
- Created 13 years ago
- Reactions: 1
- Comments: 104
Commits related to this issue
- Use the latest net-http-persistent with idle timeouts. Issue #123 — committed to sparklemotion/mechanize by drbrain 13 years ago
- Add Mechanize#retry_change_requests to allow users to say "POST is OK!". Issue #123 — committed to sparklemotion/mechanize by drbrain 13 years ago
- Set idle_timeout after the HTTP instance has been created. Issue #123 — committed to sparklemotion/mechanize by drbrain 13 years ago
- Allow disabling of keep-alive requests again via an update to net-http-persistent. Issue #123 — committed to sparklemotion/mechanize by drbrain 13 years ago
- Collect passages without tabs and newlines — committed to wfth/collector by fomentia 7 years ago
- Update Mechanize agent to TLSv1.2 See https://github.com/sparklemotion/mechanize/issues/123 — committed to snehankekre/the_hills1 by deleted user 6 years ago