Attention Is All They Need

Posted2 months agoActive2 months ago

tamnd

1 points

3 comments

opencv.mdTechstory

calmmixed

Debate

20/100

Attention MechanismAI ResearchTech Trends

Key topics

Attention Mechanism

AI Research

Tech Trends

The post discusses the 'Attention Is All You Need' paper and its impact, with commenters reflecting on the paper's title and the broader implications of attention-seeking in tech.

Snapshot generated from the HN discussion

Discussion Activity

Light discussion

First comment

17m

Peak period

0-1h

Avg / period

Key moments

01Story posted
Nov 6, 2025 at 3:16 AM EST
2 months ago
Step 01
02First comment
Nov 6, 2025 at 3:33 AM EST
17m after posting
Step 02
03Peak activity
3 comments in 0-1h
Hottest window of the conversation
Step 03
04Latest activity
Nov 6, 2025 at 3:57 AM EST
2 months ago
Step 04

Generating AI Summary...

Analyzing up to 500 comments to identify key contributors and discussion patterns

Discussion (3 comments)

Showing 3 comments

eimrine

2 months ago

1 reply

I still can not understand the name of "attention is what you need" study.

yorwba

2 months ago

The "attention is all you need" paper did not invent attention mechanisms. It showed that existing models that were already using attention could have their non-attention parts removed and still worked. So those other parts were unnecessary and only attention was needed.

JSR_FDED

2 months ago

Cute riff on the title of the Google paper. Kind of like abusing "GOTO considered harmful". Ironic though because it's a way of drawing attention, which he denounces in his article:

> Real technology isn’t being built by this new cohort of founders, and we’ve entered into an era of hyper competitive degeneracy, fighting for attention.

(I agree with his point though)

View full discussion on Hacker News

ID: 45832770Type: storyLast synced: 11/17/2025, 7:54:50 AM

Want the full context?

Jump to the original sources

Read the primary article or dive into the live Hacker News thread when you're ready.

Open link View on HN