Skip to content

refactor!: Rewrite the FilesystemStorageClient to use apify/crawlee-storage#3762

Merged
janbuchar merged 57 commits into
v4from
rust-storages
Jul 5, 2026
Merged

refactor!: Rewrite the FilesystemStorageClient to use apify/crawlee-storage#3762
janbuchar merged 57 commits into
v4from
rust-storages

Conversation

@janbuchar

Copy link
Copy Markdown
Contributor

@janbuchar janbuchar added the t-tooling Issues with this label are in the ownership of the tooling team. label Jun 18, 2026
@janbuchar
janbuchar changed the base branch from v4 to centralize-kvs-value-semantics June 22, 2026 17:29
Base automatically changed from centralize-kvs-value-semantics to v4 June 24, 2026 15:40
Comment thread packages/fs-storage/src/resource-clients/key-value-store.ts Outdated
@janbuchar
janbuchar requested a review from barjin June 25, 2026 09:18
@B4nan

B4nan commented Jul 1, 2026

Copy link
Copy Markdown
Member

@B4nan

B4nan commented Jul 1, 2026

Copy link
Copy Markdown
Member

e2e tests are broken, not sure if they were working in v4 before, but this is exactly the kind of PR I would like to test through those

@janbuchar

Copy link
Copy Markdown
Contributor Author

e2e tests are broken, not sure if they were working in v4 before, but this is exactly the kind of PR I would like to test through those

About that... #3805 — I wouldn't block on fixing the complete E2E test suite 💀

@janbuchar
janbuchar changed the base branch from v4 to fix-storage-interface-inconsistencies July 3, 2026 10:49
Base automatically changed from fix-storage-interface-inconsistencies to v4 July 5, 2026 20:47
# Conflicts:
#	packages/fs-storage/src/cache-helpers.ts
#	packages/fs-storage/src/file-system-storage.ts
#	packages/fs-storage/src/resource-clients/key-value-store.ts
#	packages/fs-storage/src/resource-clients/request-queue.ts
#	packages/fs-storage/test/request-queue/dangling-forefront-on-reload.test.ts
#	packages/fs-storage/test/request-queue/forefront.test.ts
#	packages/fs-storage/test/request-queue/ignore-non-json-files.test.ts
@janbuchar
janbuchar merged commit 8a42262 into v4 Jul 5, 2026
8 checks passed
@janbuchar
janbuchar deleted the rust-storages branch July 5, 2026 21:39
barjin pushed a commit that referenced this pull request Jul 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

t-tooling Issues with this label are in the ownership of the tooling team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use apify/crawlee-storage to implement a filesystem-backed storage client

4 participants