| < Table of Contents | Installing ArchiveSpark with Jupyter > |
|---|
Around ArchiveSpark, a few related projects have emerged:
A Docker image with pre-configured Jupyter and ArchiveSpark to run on a local machine, server or cluster.
Server application that provides a Web service API for ArchiveSpark to be used by third-party applications to integrate temporal web archive data with a flexible, easy-to-use interface.
This library provides tools to convert ArchiveSpark records from web archives to RDF triples in Notation3 (N3) format.
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz, used by ArchiveSpark to load plain web archive data (WARC) without a metadata index. (not anymore, before 3.0)
If you do not have web archive data available to be used with ArchiveSpark, easily create your own from any collection of websites with Web2Warc.
The original implementation of the ArchiveSpark concept was powered by Apache Pig instead of Spark. The project was the inspiration for this one and can be found under ArchivePig. However, it is not actively being developed anymore, but can be used if you prefer Pig over Spark.
| < Table of Contents | Installing ArchiveSpark with Jupyter > |
|---|