Skip to content

Releases: tijme/not-your-average-web-crawler

1.2.3

Choose a tag to compare

@tijme tijme released this 02 Apr 22:12

Improvement(s):

  • Compatibility for Python 3.3, 3.4 & 3.5

Fixed bug(s):

  • Random order of query parameters in crawled URLs

PyPi: https://pypi.python.org/pypi/nyawc/1.2.3

1.2.2

Choose a tag to compare

@tijme tijme released this 26 Mar 16:56

New feature(s):

  • GitHub's contribution templates
  • PyPi classifiers

PyPi: https://pypi.python.org/pypi/nyawc/1.2.2

1.2.1

Choose a tag to compare

@tijme tijme released this 25 Mar 14:21

Fixed bug(s):

  • Undefined reference in CookieHelper

PyPi: https://pypi.python.org/pypi/nyawc/1.2.1

1.2.0

Choose a tag to compare

@tijme tijme released this 12 Mar 13:10

New feature(s):

  • XML scraping
  • Custom cookies
  • Custom user agent

Fixed bug(s):

  • Incorrect regex scraper URLs
  • Removed mailto link scraping
  • Crash on DNS exception
  • Crash on invalid Python version

PyPi: https://pypi.python.org/pypi/nyawc/1.2.0

1.1.0

Choose a tag to compare

@tijme tijme released this 09 Mar 20:27

New feature(s):

  • Multi-threading

Fixed bug(s):

  • Missing button element in form scraper
  • Incorrect regex scraper URLs

PyPi: https://pypi.python.org/pypi/nyawc/1.1.0

1.0.1

Choose a tag to compare

@tijme tijme released this 06 Mar 21:00

New feature(s):

  • Callbacks
  • Scope options
  • Link crawling in HTML and JavaScript
  • Form crawling in HTML (GET & POST)

PyPi: https://pypi.python.org/pypi/nyawc/1.0.1