99
submitted 1 year ago by rikudou to c/asklemmy@lemmy.world

Regardless of the kind of news. I'm working on a TLDR bot and I'd like it to support the most used sites on Lemmy.

you are viewing a single comment's thread
view the rest of the comments
[-] rikudou 4 points 1 year ago

Can you send some link to an archive.org article? Can't find any there.

[-] NotSpez@lemm.ee 2 points 1 year ago
[-] rikudou 2 points 1 year ago

Oh I see, no, that's sadly not possible to do universally, I have to evaluate the structure of each site to find the text content and archive basically copies the structure of the target website, meaning there's no single structure for achive.org.

[-] ZapBeebz_@lemmy.world 1 points 1 year ago

Would it be possible to use the structure for the NYTimes on archive.org, as a way of bypassing the account and JavaScript requirements? Or am I misunderstanding how that would work

[-] rikudou 2 points 1 year ago

I think it would be possible, yes.

[-] NotSpez@lemm.ee 1 points 1 year ago

That’s what I was afraid of. I was hoping the site itself would format the content in a way to make it possible. Thanks for the effort!

this post was submitted on 01 Aug 2023
99 points (97.1% liked)

Ask Lemmy

26673 readers
1564 users here now

A Fediverse community for open-ended, thought provoking questions

Please don't post about US Politics.


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 1 year ago
MODERATORS