27 Commits (master)
 

Author SHA1 Message Date
rra 27a5c9b1d7 minor tweaks 5 years ago
rra 2278cd9d3d about_crawler now properly uses functions from fedicrawler 5 years ago
rra f62bff244c repairs 5 years ago
rra 65ddc49057 working on making the script importable by about_collector 5 years ago
rra 27a6fb1a0a now continues where it left off last time 5 years ago
rra 1b1e5b1e52 add info about new script 5 years ago
rra 3f5d2bbad0 minor tweaks to fedicrawler & scrape 05-05-2020 5 years ago
rra c003a6ae96 added new script to document mastodon about pages 5 years ago
rra 0429659306 update readme 5 years ago
rra 15d19e0435 update readme 5 years ago
rra 30fe54a03e april 30 2020 5 years ago
rra 1512278240 now based primarily on nodeinfo2, add socksproxy, filtering out weird stuff 5 years ago
rra 2ab9879118 29/4 2020 5 years ago
rra 26b4e4a868 april 2020 5 years ago
rra b4c5d50a77 updated with a way to get around gab.best enumeration and better error logging 5 years ago
rra ce613426d0 rerun scrape may 2019 6 years ago
rra e9c8e8341c rerun scrape march 2019 6 years ago
rra 59fd15dd7d small fixes 7 years ago
rra 381e44b2d9 scraper now uses parallelism 7 years ago
rra c2c1bbccaf scrape results of v2 on 07-06-2018 7 years ago
rra 09d76040eb crawler now scrapes in parallel threads 7 years ago
rra 776ac11b52 more info on methodology and where it is lacking 7 years ago
rra da97f04832 scrape with metadata on 30/5/2018 7 years ago
rra cb646ab40e made changes in file saving 7 years ago
rra 4cac59e445 crawler now looks for instance metadata, started to abstract collection into functions 7 years ago
rra d90366d4c6 gitignore and readme 7 years ago
rra abbb8a6dd7 first version, crawls only the announced peers 7 years ago