Archived

This repository has been archived on 2021-12-10. You can view files and clone it. You cannot open issues or pull requests or push a commit.

Files

T

History

jebe8883 27af816057 Updated README

2021-12-10 12:13:32 +01:00

blacklisted_onion_urls.html

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

blacklisted_onion_urls.md5

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

d3-collector.py

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

onion_links_150.txt

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

onion_links.txt

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

README.md

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

start-d3-collector.sh

Added the rest of the toolset.

2021-12-10 11:59:36 +01:00

README.md

D3-Collector

This is the, currently very primitive, scraper of DIDECTS. It is triggered when a URL is added from the D3-Annotator add-on and D3-Centraliser invokes D3-Collector. D3-Collector then simply sends a URL request through torsocks and saves the returned web page to the configured database.

Licence

GPL-3 (see LICENCE file)