Skip to content

feat: add MrScraper components for Langflow #12542

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ai-mrscraper wants to merge 9 commits into
base: main
Choose a base branch
from
Open

feat: add MrScraper components for Langflow #12542

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
9cc2f2f
initial commit
riandradiva18 Apr 7, 2026
aa7f799
feat: add agent name mrscraper_ai_scraper
riandradiva18 Apr 7, 2026
8ba13dc
feat: add agent name mrscraper_ai_scraper
riandradiva18 Apr 7, 2026
0efc77e
[autofix.ci] apply automated fixes
autofix-ci[bot] Apr 7, 2026
89ccbfa
[autofix.ci] apply automated fixes (attempt 2/3)
autofix-ci[bot] Apr 7, 2026
43d4384
[autofix.ci] apply automated fixes (attempt 3/3)
autofix-ci[bot] Apr 7, 2026
f603f21
WIP: before rebase
riandradiva18 Apr 7, 2026
e152622
fix: component mrscraper_ai_scraper
riandradiva18 Apr 7, 2026
7345dcf
[autofix.ci] apply automated fixes
autofix-ci[bot] Apr 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Document Q&A.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1323,7 +1323,7 @@
},
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "googleapiclient",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Financial Report Parser.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -751,7 +751,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "trustcall",
Expand Down
74 changes: 43 additions & 31 deletions src/backend/base/langflow/initial_setup/starter_projects/Hybrid Search RAG.json
View file
Open in desktop

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Image Sentiment Analysis.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1109,7 +1109,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "trustcall",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Instagram Copywriter.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2076,7 +2076,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Invoice Summarizer.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1184,7 +1184,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
18 changes: 11 additions & 7 deletions src/backend/base/langflow/initial_setup/starter_projects/Knowledge Retrieval.json
View file
Open in desktop

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions src/backend/base/langflow/initial_setup/starter_projects/Market Research.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1196,7 +1196,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -1957,7 +1957,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "trustcall",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/News Aggregator.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1178,7 +1178,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Nvidia Remix.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -806,7 +806,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Pokédex Agent.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1243,7 +1243,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
4 changes: 2 additions & 2 deletions ...ackend/base/langflow/initial_setup/starter_projects/Portfolio Website Code Generator.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -932,7 +932,7 @@
},
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "googleapiclient",
Expand Down Expand Up @@ -2322,7 +2322,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "trustcall",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Price Deal Finder.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1612,7 +1612,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Research Agent.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2815,7 +2815,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
68 changes: 39 additions & 29 deletions src/backend/base/langflow/initial_setup/starter_projects/Research Translation Loop.json
View file
Open in desktop

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/SaaS Pricing.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -897,7 +897,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Search agent.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -944,7 +944,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
8 changes: 4 additions & 4 deletions src/backend/base/langflow/initial_setup/starter_projects/Sequential Tasks Agents.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -362,7 +362,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -950,7 +950,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -2395,7 +2395,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -2980,7 +2980,7 @@
},
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Simple Agent.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -943,7 +943,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
6 changes: 3 additions & 3 deletions src/backend/base/langflow/initial_setup/starter_projects/Social Media Agent.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -164,7 +164,7 @@
},
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -396,7 +396,7 @@
},
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -1293,7 +1293,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Text Sentiment Analysis.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3585,7 +3585,7 @@
},
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "googleapiclient",
Expand Down
6 changes: 3 additions & 3 deletions src/backend/base/langflow/initial_setup/starter_projects/Travel Planning Agents.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1671,7 +1671,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -2254,7 +2254,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down Expand Up @@ -2837,7 +2837,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
61 changes: 35 additions & 26 deletions src/backend/base/langflow/initial_setup/starter_projects/Vector Store RAG.json
View file
Open in desktop

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion src/backend/base/langflow/initial_setup/starter_projects/Youtube Analysis.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -505,7 +505,7 @@
"dependencies": [
{
"name": "pydantic",
"version": "2.12.5"
"version": "2.11.10"
},
{
"name": "lfx",
Expand Down
2 changes: 2 additions & 0 deletions src/backend/base/pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -312,6 +312,7 @@ scrapegraph = ["scrapegraph-py>=1.12.0"]
pydantic-ai = ["pydantic-ai>=0.0.19"]
apify = ["apify-client>=1.8.1"]
spider = ["spider-client>=0.0.27,<1.0.0"]
mrscraper = ["mrscraper-sdk>=0.1.2,<1.0.0"]

# ALTK (Agent Lifecycle Toolkit)
altk = ["agent-lifecycle-toolkit~=0.4.4"]
Expand Down Expand Up @@ -443,6 +444,7 @@ complete = [
"langflow-base[pydantic-ai]",
"langflow-base[apify]",
"langflow-base[spider]",
"langflow-base[mrscraper]",
# ALTK
"langflow-base[altk]",
# Additional LangChain integrations
Expand Down
1 change: 1 addition & 0 deletions src/backend/tests/unit/components/bundles/mrscraper/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
"""Unit tests for MrScraper Langflow components."""
12 changes: 12 additions & 0 deletions src/backend/tests/unit/components/bundles/mrscraper/conftest.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
"""Pytest hooks for MrScraper tests (optional SDK may be absent in minimal envs)."""

import sys
from types import ModuleType


def pytest_configure() -> None:
"""Register a minimal ``mrscraper`` module when ``mrscraper-sdk`` is not installed."""
if "mrscraper" not in sys.modules:
stub = ModuleType("mrscraper")
stub.MrScraper = object
sys.modules["mrscraper"] = stub
Loading
Loading