Are search engines indexing the fediverse? (lemmy.world)

submitted 1 year ago by filister@lemmy.world to c/asklemmy@lemmy.world

9 comments fedilink hide all child comments

I was wondering if the search engines are indexing the fediverse. Because recently Google search became so bad so I was always putting Reddit at the end to get some not so generic results and I haven't even noticed to get any replies pointing to the fediverse ever. So I was wondering if search engines were actually indexing the content here?

you are viewing a single comment's thread
view the rest of the comments

[-] octt@feddit.it 3 points 1 year ago* (last edited 1 year ago)

Some platforms like Mastodon allow individual users to discourage search engines from indexing their profile. But, by default, as far as I know all platforms allow indexing. Lemmy seems to not provide any option to control this kind of thing so everything should get indexed.

The thing is, using "thingtosearch reddit" you're not using any search engine properly, that's kind of a hack. What you would do is actually "thingtosearch site:reddit.com" to limit searches to a specific site. This works with any site, of course, so you could for example do "thingtosearch site:feddit.it" (that's my instance), and you will get specific results (which actually might include results from other instances, due to how this indexing works, even though they will be displayed from the site of the instance you specified). (I just noticed btw that DuckDuckGo doesn't list anything for site:myinstance... well, that's strange, Google has no problem.)

[-] cmat273@sh.itjust.works 2 points 1 year ago

DuckDuckGo uses their own web crawlers along with a few others (but not google's). Probably just haven't indexed it yet.

this post was submitted on 13 Jul 2023

39 points (93.3% liked)

Ask Lemmy

26753 readers

1477 users here now

A Fediverse community for open-ended, thought provoking questions

Please don't post about US Politics. If you need to do this, try !politicaldiscussion@lemmy.world

Rules: (interactive)

1) Be nice and; have fun

Doxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them

2) All posts must end with a '?'

This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?

3) No spam

Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.

4) NSFW is okay, within reason

Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com. NSFW comments should be restricted to posts tagged [NSFW].

5) This is not a support community.

It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.

Reminder: The terms of service apply here too.