22
Any RSS services with deduplication? (lemmy.sdf.org)
submitted 1 year ago by zebus@lemmy.sdf.org to c/selfhosted@lemmy.world
9 comments fedilink hide all child comments

I’m getting around to setting up and trying to use RSS for the first time. I like it so far, except for one thing, the time efficiency of it. When there is a new story picked up by all outlets I have to hit mark read 5+ times for near identical copy/pastes of the same story.

Currently using miniflux but wasn’t sure if there where any other solutions. Honestly almost has me considering just spending $5/mo for a paid service like Inoreader or Feedly since deduplication is a big feature they advertise. Main thing stopping me is the fact they don’t index sites without RSS that I use RSS-Bridge for such as AP News, and I’m hesitant to share my selfhosted RSS-Bridge URLs with a public site.

all 10 comments
sorted by: hot top controversial new old
[-] ericjmorey@programming.dev 3 points 1 year ago

I thought AP news had an RSS feed

[-] zebus@lemmy.sdf.org 2 points 1 year ago

Nope, unfortunately a lot of places now a days either don’t, are dropping support for it, or just don’t have good options. They want you on dem apps $$.

Fortunately tools like RSS-Bridge and RSShub make it an easy fix.

[-] xtremeownage@lemmyonline.com 2 points 1 year ago

I don't know about dedup, but, freshrss is pretty good for a self hosted solution.

[-] ech0@lemmy.world 1 points 1 year ago

Honestly FreshRSS is pretty trash. Don't understand why it's so popular.

This is 10x better https://github.com/ssddanbrown/rss

[-] xtremeownage@lemmyonline.com 1 points 1 year ago

Eh,

When you have 50+ feeds, it has a lot of handy features.

Like... blacklisting posts with keywords/regex, tracking things in categories, etc... And- it has a TON of options for configuring things.

The ability to whitelist/blacklist certain posts is quite handy itself. For example- taking a feed like This one and being able to only grab the "update / releases", and ignore all of the sales, giveaways, and other crap.

The uh, configuration options for the reader you linked are pretty limited in comparison.

Although, it does look nice, its missing the features to boot.

[-] bernard@lemmy.film 1 points 1 year ago

I deal with this by subscribing to very few mainstream media sources since they typically report the same thing in unison with slight variation. The slight variation makes deduplication technically difficult. I use Nextcloud News, and maybe their future LLM models could accomplish this.

this post was submitted on 15 Aug 2023
22 points (100.0% liked)

Selfhosted

39700 readers
778 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
ruud@lemmy.world
CannaVet@lemmy.world
Loki@lemmy.world
HybridSarcasm@lemmy.world
devve@lemmy.world
HybridSarcasm@lemmy.hybridsarcasm.xyz