Skip to content

@scrapinghub Scrapinghub

Change the repository type filter

All

    Repositories list

    183 repositories

    • web-poet

      Public
      Web scraping Page Objects core library
      pythonweb-scrapinghacktoberfest
      pythonweb-scrapinghacktoberfestpage-objects
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •19•105•17•15•Updated Apr 10, 2026Apr 10, 2026

    • autoextract-examples

      Public
      Jupyter Notebook
      •1•4•0•1•Updated Apr 10, 2026Apr 10, 2026

    • product-extraction-benchmark

      Public
      Jupyter Notebook
      •
      MIT License
      •1•16•0•1•Updated Apr 10, 2026Apr 10, 2026

    • article-extraction-benchmark

      Public
      Article extraction benchmark: dataset and evaluation scripts
      Python
      •
      MIT License
      •37•362•1•2•Updated Apr 10, 2026Apr 10, 2026

    • shub

      Public
      Scrapinghub Command Line Client
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •79•130•47•14•Updated Apr 10, 2026Apr 10, 2026

    • dateparser

      Public
      python parser for human readable dates
      hacktoberfest
      hacktoberfest
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •493•2.8k•299•51•Updated Apr 9, 2026Apr 9, 2026

    • scrapy-poet

      Public
      Page Object pattern for Scrapy
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •29•127•11•4•Updated Apr 9, 2026Apr 9, 2026

    • spidermon

      Public
      Scrapy Extension for monitoring spiders execution.
      testingmonitoringscraping
      testingmonitoringscrapingcrawlingspidershacktoberfestmonitoring-toolscrapinghub
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •102•552•43•8•Updated Apr 8, 2026Apr 8, 2026

    • scrapinghub-stack-scrapy

      Public
      Software stack with latest Scrapy and updated deps
      Dockerfile
      •
      BSD 3-Clause "New" or "Revised" License
      •20•64•1•1•Updated Apr 7, 2026Apr 7, 2026

    • python-scrapinghub

      Public
      A client interface for Scrapinghub's API
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •61•205•24•2•Updated Apr 7, 2026Apr 7, 2026

    • extruct

      Public
      Extract embedded metadata from HTML markup
      microformatssemantic-webrdfa
      microformatssemantic-webrdfajson-ldmicrodataopengraphhacktoberfest
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •119•961•39•17•Updated Apr 1, 2026Apr 1, 2026

    • scrapyrt

      Public
      HTTP API for Scrapy spiders
      pythoncrawlerscraper
      pythoncrawlerscrapercrawlingtwistedscrapywebcrawlerhacktoberfestwebcrawlinghacktoberfest2021
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •162•879•24•5•Updated Mar 20, 2026Mar 20, 2026

    • price-parser

      Public
      Extract price amount and currency symbol from a raw text string
      hacktoberfest
      hacktoberfest
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •54•345•17•9•Updated Mar 19, 2026Mar 19, 2026

    • andi

      Public
      Library for annotation-based dependency injection
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •6•24•5•1•Updated Mar 3, 2026Mar 3, 2026

    • scrapinghub-entrypoint-scrapy

      Public
      Scrapy entrypoint for Scrapinghub job runner
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •16•25•6•1•Updated Feb 26, 2026Feb 26, 2026

    • shub-workflow

      Public
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •14•14•2•1•Updated Jan 21, 2026Jan 21, 2026

    • python-crfsuite

      Public
      A python binding for crfsuite
      data-sciencecrfcrfsuite
      data-sciencecrfcrfsuite
      Python
      •
      MIT License
      •225•771•46•3•Updated Dec 23, 2025Dec 23, 2025

    • marathon-apps-collectd-plugin

      Public
      marathon-apps-collectd-plugin
      Python
      •
      GNU General Public License v2.0
      •96•2•0•1•Updated Nov 27, 2025Nov 27, 2025

    • hcf-backend

      Public
      Crawl Frontier HCF backend
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •6•8•2•1•Updated Oct 31, 2025Oct 31, 2025

    • docker-images

      Public
      Dockerfile
      •8•33•0•5•Updated Oct 20, 2025Oct 20, 2025

    • Formasaurus

      Public
      Formasaurus tells you the type of an HTML form and its fields using machine learning
      HTML
      •45•8•1•1•Updated Sep 4, 2025Sep 4, 2025

    • sklearn-crfsuite

      Public
      scikit-learn inspired API for CRFsuite
      Python
      •209•1•0•1•Updated Sep 4, 2025Sep 4, 2025

    • scrapy-frontera

      Public
      More flexible and featured Frontera scheduler for Scrapy
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •5•36•2•1•Updated Jun 6, 2025Jun 6, 2025

    • frontera

      Public
      A scalable frontier for web crawlers
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •216•1.3k•78•17•Updated Jun 6, 2025Jun 6, 2025

    • social-app-django

      Public
      Python Social Auth - Application - Django
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •394•2•0•1•Updated Nov 18, 2024Nov 18, 2024

    • number-parser

      Public
      Parse numbers written in natural language
      hacktoberfest
      hacktoberfest
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •25•126•14•6•Updated Oct 23, 2024Oct 23, 2024

    • streamparse

      Public
      streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.
      Python
      •
      Apache License 2.0
      •221•2•0•1•Updated Sep 20, 2024Sep 20, 2024

    • splash

      Public
      Lightweight, scriptable browser as a service with an HTTP API
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •520•4.2k•373•26•Updated Aug 2, 2024Aug 2, 2024

    • pgcontents

      Public
      A Postgres-backed ContentsManager implementation for IPython
      Python
      •
      Apache License 2.0
      •86•2•0•1•Updated Jul 18, 2024Jul 18, 2024

    • shublang

      Public
      Pluggable DSL that uses pipes to perform a series of linear transformations to extract data
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •8•16•23•6•Updated Jul 9, 2024Jul 9, 2024
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.