rra/lumbung-feed-aggregator
1
0
Fork 0
Code Issues 9 Pull Requests Projects Releases Wiki Activity

Updating: not all feeds publish etags or modified headers #6

New Issue
Open
opened 2021-10-06 07:07:10 +02:00 by rra · 0 comments
rra commented 2021-10-06 07:07:10 +02:00
Owner
Copy Link

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again.

rss_aggregator.py Line 150 in 16cbeaedb0
def grab_feed(feed_url):

Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again. https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/src/commit/16cbeaedb017e80fe162b4206325b296fd3ab4d8/rss_aggregator.py#L150 Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: rra/lumbung-feed-aggregator#6
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?