rra
/
lumbung-feed-aggregator
1
0
Fork 0
Code Issues 9 Pull Requests Projects Releases Wiki Activity
Labels Milestones
New Issue

Updating: not all feeds publish etags or modified headers #6

Open
opened 3 years ago by rra · 0 comments
rra commented 3 years ago
Owner

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again.

16cbeaedb0/rss_aggregator.py (L150)

Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again. https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/src/commit/16cbeaedb017e80fe162b4206325b296fd3ab4d8/rss_aggregator.py#L150 Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
master
Labels
Apply labels
Clear labels
No items
No Label
Milestone
Set milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Assign users
Clear assignees
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Write Preview
Loading…
Cancel
Save
There is no content yet.
Delete Branch '%!s(MISSING)'

Deleting a branch is permanent. It CANNOT be undone. Continue?

No
Yes