Not
Hacker
News
!
Home
Hiring
Products
Companies
Discussion
Q&A
Users
Attention Mechanism | Trending Topic on Hacker News | Not Hacker News!
Not
Hacker
News
!
Home
Hiring
Products
Companies
Discussion
Q&A
Users
Home
/
Discussion
/
Attention Mechanism
Back to Discussion
Attention Mechanism
Loading...
12 stories
•
24h:
0%
•
7d: 0
•
74 comments
Top contributors:
blackcat201
umjunsik132
sonabinu
amai
Roritharr
Stories
Related Stories
12 stories tagged with attention mechanism
Kimi Linear: an Expressive, Efficient Attention Architecture
217
47 comments
by blackcat201
•
27d ago
AI architecture
attention mechanism
large language models
I Unified Convolution and Attention Into a Single Framework
80
18 comments
by umjunsik132
•
2mo ago
Deep Learning
Convolution
Attention Mechanism
Expected Attention: Kv Cache Compression by Estimating Attention
20
3 comments
by sonabinu
•
1mo ago
AI
LLMs
Attention Mechanism
Attention Is a Smoothed Cubic Spline
11
0 comments
by amai
•
2mo ago
attention mechanism
cubic spline
machine learning
Power Retention – Drop-in Replacement for Flash_attention
7
1 comments
by Roritharr
•
2mo ago
AI Optimization
Deep Learning
Attention Mechanism
Multi-Head Latent Attention
4
0 comments
by ModelForge
•
1mo ago
LLMs
Attention Mechanism
Machine Learning
How to Scale AI Without Using Nuclear Reactors (adaptive Attention)
4
0 comments
by unconsciousllm
•
29d ago
AI scaling
Attention mechanism
GPU optimization
Towards Unlimited Contexts: Faster-Than-GPU Sparse Logarithmic Attention on CPU [video]
3
0 comments
by mfiguiere
•
11d ago
AI
CPU
GPU
Attention Mechanism
A Minimal Route to Transformer Attention
2
0 comments
by nsomani
•
28d ago
Transformer Models
Attention Mechanism
Deep Learning
Tlinformer, a Path to Exact, Full Context-Aware Linear Attention
2
0 comments
by P_qRs
•
2mo ago
AI
Attention Mechanism
Linear Attention
Powerretention: a Drop-in Replacement for Flashattention in Llms
2
2 comments
by dvrp
•
2mo ago
LLMs
Attention Mechanism
AI Optimization
Attention Is All They Need
1
3 comments
by tamnd
•
20d ago
attention mechanism
AI research
tech trends