27 Commits (master)

Author SHA1 Message Date
  rra 27a5c9b1d7 minor tweaks 10 months ago
  rra 2278cd9d3d about_crawler now properly uses functions from fedicrawler 10 months ago
  rra f62bff244c repairs 10 months ago
  rra 65ddc49057 working on making the script importable by about_collector 10 months ago
  rra 27a6fb1a0a now continues where it left off last time 10 months ago
  rra 1b1e5b1e52 add info about new script 10 months ago
  rra 3f5d2bbad0 minor tweaks to fedicrawler & scrape 05-05-2020 10 months ago
  rra c003a6ae96 added new script to document mastodon about pages 10 months ago
  rra 0429659306 update readme 10 months ago
  rra 15d19e0435 update readme 10 months ago
  rra 30fe54a03e april 30 2020 10 months ago
  rra 1512278240 now based primarily on nodeinfo2, add socksproxy, filtering out weird stuff 10 months ago
  rra 2ab9879118 29/4 2020 10 months ago
  rra 26b4e4a868 april 2020 10 months ago
  rra b4c5d50a77 updated with a way to get around gab.best enumeration and better error logging 10 months ago
  rra ce613426d0 rerun scrape may 2019 1 year ago
  rra e9c8e8341c rerun scrape march 2019 1 year ago
  rra 59fd15dd7d small fixes 2 years ago
  rra 381e44b2d9 scraper now uses parallelism 2 years ago
  rra c2c1bbccaf scrape results of v2 on 07-06-2018 2 years ago
  rra 09d76040eb crawler now scrapes in parallel threads 2 years ago
  rra 776ac11b52 more info on methodology and where it is lacking 2 years ago
  rra da97f04832 scrape with metadata on 30/5/2018 2 years ago
  rra cb646ab40e made changes in file saving 2 years ago
  rra 4cac59e445 crawler now looks for instance metadata, started to abstract collection into functions 2 years ago
  rra d90366d4c6 gitignore and readme 2 years ago
  rra abbb8a6dd7 first version, crawls only the announced peers 2 years ago