883

Google won’t comment on a potentially massive leak of its search algorithm documentation (www.theverge.com)

submitted 5 months ago by Bishma@discuss.tchncs.de to c/technology@lemmy.world

140 comments fedilink hide all child comments

A purported leak of 2,500 pages of internal documentation from Google sheds light on how Search, the most powerful arbiter of the internet, operates.

The leaked documents touch on topics like what kind of data Google collects and uses, which sites Google elevates for sensitive topics like elections, how Google handles small websites, and more. Some information in the documents appears to be in conflict with public statements by Google representatives, according to Fishkin and King.

you are viewing a single comment's thread
view the rest of the comments

[-] flappy@lemm.ee 98 points 5 months ago

Can't wait for selfhosted web search to become better.

[-] paraphrand@lemmy.world 3 points 5 months ago

What are the current contenders?

[-] brbposting@sh.itjust.works 13 points 5 months ago

What it looks like beyond Google and Bing

It would be much harder to know what exists beyond "GBY" (Google, Bing, Yandex) and how it all works without the work of Rohan “Seirdy” Kumar. For three years, Kumar has been updating a heavily annotated list of search engines with their own indexes. It is 7,000 words, but only a portion of it deals with engines offering general indexing, in the English language. You can read Kumar's evaluation methodology for a better understanding of how he compared and assessed sites.

What stands out? Mojeek ("it's not bad… I'd live") and Stract ("a useful supplement to more major engines") are two of Kumar's favorites. Right Dao has "very fast, good results," in part because its crawler starts off from Wikipedia. Yep reaches farther out, showing results that link to and back from sites related to your query and also promises to share ad revenue with creators. All of them show promise, but you get the sense that they're a second car, or a third bicycle, rather than a primary transport.

There are far smaller-scoped engines in other sections of Kumar's post. If you're wondering where that one other search engine you've heard about is, it's probably in the "Semi-independent indexes" section, because it uses a GBY index when its own results are not strong enough. Here, you'll find cryptocurrency-friendly, controversy-courting-founder-having Brave, a few engines that either "resell" GBY results or stuff affiliate links into them, and "the most interesting entry," according to Kumar, Kagi.

Kagi requires an account and uses its own index, Teclis, in combination with Google, Bing, Yandex, Mojeek, and others, including, notably, Brave. Kagi's founder has strong opinions on the AI-based future of search and responding to harmful searches in ways that are not "scalable." How much of that does or does not bother you will vary, but it's worth noting that Kagi also suffers when the GBY triumvirate is restricted.

Ars Technica this week: Bing outage shows just how little competition Google search really has

The referenced search engine comparison by Rohan “Seirdy” Kumar

[-] Mojeek@lemmy.ml 5 points 5 months ago

can't emphasise too much that this piece is a very necessary read for anyone who wants to know about search; not just because it says good things about us, but because of the depth of research which has been put in here. Most times you encounter an article about indexes they are just taking whatever a (meta)search engine says about themselves, not even looking at privacy policies for "relationships with microsoft" etc. or doing any comparative work.

load more comments (2 replies)

load more comments (6 replies)

load more comments (36 replies)

this post was submitted on 28 May 2024

883 points (99.8% liked)

Technology

59390 readers

2540 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS