Skip to content

Commit 1490506

Browse files
authored
v0.4.9 (#345)
2 parents b9bc17b + 74c5848 commit 1490506

39 files changed

Lines changed: 268 additions & 57 deletions

.github/workflows/tests.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ jobs:
7373
- name: Install all browsers dependencies
7474
run: |
7575
python3 -m pip install --upgrade pip
76-
python3 -m pip install playwright==1.59.0 patchright==1.59.1
76+
python3 -m pip install playwright==1.60.0 patchright==1.60.1
7777
7878
- name: Get Playwright version
7979
id: playwright-version

CONTRIBUTING.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ There are many ways to contribute to Scrapling. Here are some of them:
1111
- Report bugs and request features using the [GitHub issues](https://github.com/D4Vinci/Scrapling/issues). Please follow the issue template to help us resolve your issue quickly.
1212
- Blog about Scrapling. Tell the world how you’re using Scrapling. This will help newcomers with more examples and increase the Scrapling project's visibility.
1313
- Join the [Discord community](https://discord.gg/EMgGbDceNQ) and share your ideas on how to improve Scrapling. We’re always open to suggestions.
14-
- If you are not a developer, perhaps you would like to help with translating the [documentation](https://github.com/D4Vinci/Scrapling/tree/docs)?
14+
- If you are not a developer, perhaps you would like to help with translating the [documentation](https://github.com/D4Vinci/Scrapling/tree/dev/docs)?
1515

1616
## Making a Pull Request
1717
To ensure that your PR gets accepted, please make sure that your PR is based on the latest changes from the dev branch and that it satisfies the following requirements:

README.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -209,7 +209,7 @@ MySpider().start()
209209

210210
<!-- /sponsors -->
211211

212-
<i><sub>Do you want to show your ad here? Click [here](https://github.com/sponsors/D4Vinci) and choose the tier that suites you!</sub></i>
212+
<i><sub>Do you want to show your ad here? Click [here](https://github.com/sponsors/D4Vinci) and choose the tier that suits you!</sub></i>
213213

214214
---
215215

@@ -471,7 +471,8 @@ Scrapling requires Python 3.10 or higher:
471471
pip install scrapling
472472
```
473473

474-
This installation only includes the parser engine and its dependencies, without any fetchers or commandline dependencies.
474+
> [!IMPORTANT]
475+
> This installation only includes the parser engine and its dependencies, without any fetchers or commandline dependencies. So importing anything from `scrapling.fetchers` or `scrapling.spiders`, like in the examples above, will raise `ModuleNotFoundError` with this installation alone. If you are going to use any of the fetchers or spiders, install the fetchers' dependencies first as shown below.
475476
476477
### Optional Dependencies
477478

agent-skill/Scrapling-Skill.zip

2 Bytes
Binary file not shown.

agent-skill/Scrapling-Skill/SKILL.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
name: scrapling-official
33
description: Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Python code to scrape/crawl; or write spiders.
4-
version: "0.4.8"
4+
version: "0.4.9"
55
license: Complete terms in LICENSE.txt
66
metadata:
77
homepage: "https://scrapling.readthedocs.io/en/latest/index.html"
@@ -40,7 +40,7 @@ Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers fo
4040

4141
Create a virtual Python environment through any way available, like `venv`, then inside the environment do:
4242

43-
`pip install "scrapling[all]>=0.4.8"`
43+
`pip install "scrapling[all]>=0.4.9"`
4444

4545
Then do this to download all the browsers' dependencies:
4646

agent-skill/Scrapling-Skill/examples/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ All examples collect **all 100 quotes across 10 pages**.
99
Make sure Scrapling is installed:
1010

1111
```bash
12-
pip install "scrapling[all]>=0.4.8"
12+
pip install "scrapling[all]>=0.4.9"
1313
scrapling install --force
1414
```
1515

agent-skill/Scrapling-Skill/references/mcp-server.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -208,7 +208,7 @@ Docker alternative:
208208

209209
```bash
210210
docker pull pyd4vinci/scrapling
211-
docker run -i --rm scrapling mcp
211+
docker run -i --rm pyd4vinci/scrapling mcp
212212
```
213213

214214
The MCP server name when registering with a client is `ScraplingServer`. The command is the path to the `scrapling` binary and the argument is `mcp`.

docs/README_AR.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -467,7 +467,8 @@ Scrapling ليس قوياً فحسب - بل هو أيضاً سريع بشكل م
467467
pip install scrapling
468468
```
469469

470-
يتضمن هذا التثبيت فقط محرك المحلل وتبعياته، بدون أي جوالب أو تبعيات سطر الأوامر.
470+
> [!IMPORTANT]
471+
> يتضمن هذا التثبيت فقط محرك المحلل وتبعياته، بدون أي جوالب أو تبعيات سطر الأوامر. لذلك، فإن استيراد أي شيء من `scrapling.fetchers` أو `scrapling.spiders`، كما في الأمثلة أعلاه، سيؤدي إلى خطأ `ModuleNotFoundError` مع هذا التثبيت وحده. إذا كنت ستستخدم أيًا من الجوالب أو العناكب، فقم أولًا بتثبيت تبعيات الجوالب كما هو موضح أدناه.
471472
472473
### التبعيات الاختيارية
473474

docs/README_CN.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -467,7 +467,8 @@ Scrapling 需要 Python 3.10 或更高版本:
467467
pip install scrapling
468468
```
469469

470-
此安装仅包括解析器引擎及其依赖项,没有任何 Fetcher 或命令行依赖项。
470+
> [!IMPORTANT]
471+
> 此安装仅包括解析器引擎及其依赖项,没有任何 Fetcher 或命令行依赖项。 因此,仅使用此安装时,像上面的示例那样从 `scrapling.fetchers``scrapling.spiders` 导入任何内容都会引发 `ModuleNotFoundError`。如果要使用任何 Fetcher 或 Spider,请先按照下面的说明安装 Fetcher 的依赖项。
471472
472473
### 可选依赖项
473474

docs/README_DE.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -467,7 +467,8 @@ Scrapling erfordert Python 3.10 oder höher:
467467
pip install scrapling
468468
```
469469

470-
Diese Installation enthält nur die Parser-Engine und ihre Abhängigkeiten, ohne Fetcher oder Kommandozeilenabhängigkeiten.
470+
> [!IMPORTANT]
471+
> Diese Installation enthält nur die Parser-Engine und ihre Abhängigkeiten, ohne Fetcher oder Kommandozeilenabhängigkeiten. Daher führt der Import von allem aus `scrapling.fetchers` oder `scrapling.spiders`, wie in den Beispielen oben, mit dieser Installation allein zu einem `ModuleNotFoundError`. Wenn Sie einen der Fetcher oder Spider verwenden möchten, installieren Sie zuerst die Fetcher-Abhängigkeiten wie unten gezeigt.
471472
472473
### Optionale Abhängigkeiten
473474

0 commit comments

Comments
 (0)