24
The GPT-3 Architecture, on a Napkin (dugas.ch)
submitted 2 years ago by saint@group.lt to c/artificial_intel@lemmy.ml
2 comments fedilink hide all child comments

Inside the GPT-3

top 2 comments
sorted by: hot top controversial new old
[-] behohippy@lemmy.world 4 points 1 year ago

I've got a background in deep learning and I still struggle to understand the attention mechanism. I know it's a key/value store but I'm not sure what it's doing to the tensor when it passes through different layers.

[-] kromem@lemmy.world 3 points 1 year ago

What are you eating which needs that large of a napkin?

this post was submitted on 16 Dec 2022
24 points (96.2% liked)

AI

4006 readers
1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago