DEV Community

#pytorch

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Running Captum on Cloud TPUs with TorchTPU: a work log

Running Captum on Cloud TPUs with TorchTPU: a work log

Comments
19 min read
An ExecuTorch .pte has no pickle. Its risk is every size and offset

An ExecuTorch .pte has no pickle. Its risk is every size and offset

Comments
4 min read
TorchTitan's October update is out. I fixed 2 bugs in its quick-start script

TorchTitan's October update is out. I fixed 2 bugs in its quick-start script

Comments
6 min read
torch.compile vs eager for training a 468M Llama-style model on four GPUs: step time, memory and compile cost

torch.compile vs eager for training a 468M Llama-style model on four GPUs: step time, memory and compile cost

Comments
5 min read
Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

Comments
3 min read
Full fine-tune vs LoRA vs QLoRA on one L40S: Qwen2.5-1.5B, memory, speed and held-out loss, measured

Full fine-tune vs LoRA vs QLoRA on one L40S: Qwen2.5-1.5B, memory, speed and held-out loss, measured

Comments
6 min read
PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers

PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers

Comments
9 min read
How PyTorch Became the Socket Every AI Chip Plugs Into

How PyTorch Became the Socket Every AI Chip Plugs Into

5
Comments
4 min read
LoRA on a 16 GB card: what fits and what does not

LoRA on a 16 GB card: what fits and what does not

Comments
5 min read
Blackwell quantisation on my own card

Blackwell quantisation on my own card

Comments
5 min read
Two PyTorch ops that stopped a CUDA text model on an Apple GPU

Two PyTorch ops that stopped a CUDA text model on an Apple GPU

Comments
5 min read
PyTorch Explained: Machine Learning You Can Watch Learn

PyTorch Explained: Machine Learning You Can Watch Learn

Comments
2 min read
How do you train a PyTorch model on multiple GPUs?

How do you train a PyTorch model on multiple GPUs?

Comments
8 min read
SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile

SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile

Comments
6 min read
4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.