Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
transformers
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Research Paper Deep Dive: Flash Attention 2 — Optimizing Transformer Attention
Soham Sharma
Soham Sharma
Soham Sharma
Follow
Oct 28
Research Paper Deep Dive: Flash Attention 2 — Optimizing Transformer Attention
#
ai
#
transformers
#
research
#
hardware
Comments
Add Comment
3 min read
Moderation
How Hugging Face's Transformers Added UltraBERT with Layer-Specific Rotary Embeddings
Priyadarshan Singh
Priyadarshan Singh
Priyadarshan Singh
Follow
Oct 16
How Hugging Face's Transformers Added UltraBERT with Layer-Specific Rotary Embeddings
#
transformers
#
pytorch
#
nlp
#
modelarchitecture
Comments
Add Comment
2 min read
Moderation
Your Agent Benchmark Pauses the World. Production Doesn't.
Vikas Srivastava
Vikas Srivastava
Vikas Srivastava
Follow
Oct 18
Your Agent Benchmark Pauses the World. Production Doesn't.
#
transformers
#
agents
#
benchmark
#
testing
Comments
Add Comment
4 min read
Moderation
When AI Reviewers Find More Bugs Than Teams Can Fix
Vikas Srivastava
Vikas Srivastava
Vikas Srivastava
Follow
Oct 18
When AI Reviewers Find More Bugs Than Teams Can Fix
#
transformers
#
rag
#
promptengineering
#
postgres
Comments
Add Comment
4 min read
Moderation
Build a Tiny Causal Transformer from Scratch
Vikas Srivastava
Vikas Srivastava
Vikas Srivastava
Follow
Oct 18
Build a Tiny Causal Transformer from Scratch
#
transformers
#
pytorch
#
languagemodels
Comments
Add Comment
7 min read
Moderation
Detectar volatilidad anĂłmala en los mercados con un Temporal Fusion Transformer
Adrian
Adrian
Adrian
Follow
Sep 17
Detectar volatilidad anĂłmala en los mercados con un Temporal Fusion Transformer
#
deeplearning
#
transformers
#
finanzascuantitativas
#
seriestemporales
Comments
Add Comment
2 min read
Moderation
They Put 7 Attention Mechanisms on a Latin Square. Then Removed Them One by One.
ai maya
ai maya
ai maya
Follow
Sep 18
They Put 7 Attention Mechanisms on a Latin Square. Then Removed Them One by One.
#
machinelearning
#
architecture
#
transformers
#
research
Comments
Add Comment
5 min read
Moderation
Masked Self-Attention, Explained Through Avengers: Endgame
Ishita Garg
Ishita Garg
Ishita Garg
Follow
Aug 15
Masked Self-Attention, Explained Through Avengers: Endgame
#
machinelearning
#
deeplearning
#
nlp
#
transformers
1
 reaction
Comments
Add Comment
6 min read
Moderation
Puzzle Solution Revealed - Transformer: Need for Position Embedding
Tech-Aarvam
Tech-Aarvam
Tech-Aarvam
Follow
Sep 15
Puzzle Solution Revealed - Transformer: Need for Position Embedding
#
llm
#
transformers
#
machinelearning
#
ai
Comments
1
 comment
13 min read
Moderation
Depth-Attention: Opening an Attention Channel Between Transformer Layers
AICDragon
AICDragon
AICDragon
Follow
Aug 10
Depth-Attention: Opening an Attention Channel Between Transformer Layers
#
deeplearning
#
transformers
#
machinelearning
#
ai
Comments
Add Comment
11 min read
Moderation
Attention Is All You Need: The Translation Problem That Led to ChatGPT
Syed Abdullah Saad
Syed Abdullah Saad
Syed Abdullah Saad
Follow
Sep 1
Attention Is All You Need: The Translation Problem That Led to ChatGPT
#
ai
#
machinelearning
#
programming
#
transformers
Comments
2
 comments
8 min read
Moderation
Self-attention, explained without the heavy math
Divyakush Punjabi
Divyakush Punjabi
Divyakush Punjabi
Follow
Aug 15
Self-attention, explained without the heavy math
#
ai
#
machinelearning
#
transformers
#
deeplearning
3
 reactions
Comments
Add Comment
3 min read
Moderation
The KV Cache Is the Bottleneck: A 2026 Field Guide to Attention Variants
ai maya
ai maya
ai maya
Follow
Aug 9
The KV Cache Is the Bottleneck: A 2026 Field Guide to Attention Variants
#
ai
#
llm
#
machinelearning
#
transformers
1
 reaction
Comments
2
 comments
4 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account