|rra ce613426d0 rerun scrape may 2019||il y a 5 mois|
|.gitignore||il y a 1 an|
|README.md||il y a 1 an|
|fedicrawler.py||il y a 1 an|
|instance_scrape.json||il y a 5 mois|
|instances.txt||il y a 1 an|
Currently the script starts from https://post.lurk.org and queries
/api/v1/instance/peers to find servers it is peering with. For each of the peering servers it hasn’t seen before it does the same and in addition it tries to query
/api/v1/instance for meta data.
This method is a bit lacking because providing
/api/v1/instance is voluntary and specific to later versions of mastodon/activitypub fediverse. We should study the methodology of fediverse.network for better results.
When the request fails on a given instance it just logs it as ‘error’ now.
Latest scrape results can be found in