938

Google decimates Twitter search results after Elon Musk imposes limits on reading tweets (www.rawstory.com)

submitted 1 year ago by DevCat@lemmy.world to c/technology@lemmy.world

334 comments fedilink hide all child comments

Google has reportedly removed much of Twitter's links from its search results after the social network's owner Elon Musk announced reading tweets would be limited.

Search Engine Roundtable found that Google had removed 52% of Twitter links since the crackdown began last week. Twitter now blocks users who are not logged in and sets limits on reading tweets.

According to Barry Schwartz, Google reported 471 million Twitter URLs as of Friday. But by Monday morning, that number had plummeted to 227 million.

"For normal indexing of these Twitter URLs, it seems like these tweets are dropping out of the sky," Schwartz wrote.

Platformer reported last month that Twitter refused to pay its bill for Google Cloud services.

you are viewing a single comment's thread
view the rest of the comments

[-] FlagonOfMe@sh.itjust.works 24 points 1 year ago

There's nothing about the content being federated that makes it hard or impossible to index. Each instance is just a website with a public webpage that a bot can read. That all a search engine needs to index it. The worst case scenario is the bot will find the same content on multiple instances.

I did read that the website is loaded entirely through JavaScript and that maybe the Google bot doesn't execute JavaScript so can't see the text. I don't know if that's still a problem in 2023, though.

This article says it's not a problem, but I didn't read past the tl;dr, so maybe there's a caveat. Like maybe it has to use a popular framework like React or something to work.

https://searchengineland.com/tested-googlebot-crawls-javascript-heres-learned-220157

[-] void_wanderer@lemmy.world 5 points 1 year ago

Googlebot does execute Javascript, but since rendering JS needs much more resources, JS crawling will happen significantly less then simple http crawling. That's why all big sites still return server side rendered content.

[-] darkevilmac@vlemmy.net 2 points 1 year ago

Rendering with JS definitely makes a difference, it's part of the reason SSR is such a big deal for SEO.

this post was submitted on 03 Jul 2023

938 points (97.3% liked)

Technology

60003 readers

2524 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS