Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
Follow
User actions
ifnodoraemon
404 bio not found
Joined
Joined on
Sep 20, 2026
github website
More info about @ifnodoraemon
Post
71 posts published
Comment
0 comments written
Tag
36 tags followed
InfiniBand AI Cluster Networking in Practice: Fat-Tree Topologies, Rail-Optimized Architecture, Adaptive Routing (AR)...
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
InfiniBand AI Cluster Networking in Practice: Fat-Tree Topologies, Rail-Optimized Architecture, Adaptive Routing (AR)...
#
fattreeadaptiverouting
#
networking
#
ai
#
programming
Comments
Add Comment
8 min read
Moderation
Modern Data Center Network Architecture First Principles: Clos Topologies, Leaf-Spine Fabrics, BGP Underlay, and...
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Modern Data Center Network Architecture First Principles: Clos Topologies, Leaf-Spine Fabrics, BGP Underlay, and...
#
datacenterleafspine
#
networking
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
Application & Transport Layer Bridges: DNS Resolution, Sockets, Ports, and UDP vs TCP Foundations
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Application & Transport Layer Bridges: DNS Resolution, Sockets, Ports, and UDP vs TCP Foundations
#
transportlayerbridgedns
#
networking
#
ai
#
programming
Comments
Add Comment
8 min read
Moderation
TCP Congestion Control Evolution & High-Performance Transport: From Reno and Cubic to BBR Mathematical Models, and HTTP/2 to HTTP/3 (QUIC)
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
TCP Congestion Control Evolution & High-Performance Transport: From Reno and Cubic to BBR Mathematical Models, and HTTP/2 to HTTP/3 (QUIC)
#
congestioncontrolquic
#
networking
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
RDMA High-Performance Networking Foundations: Kernel Bypass, Zero-Copy, Queue Pairs, and Lossless RoCEv2 (PFC/ECN) Architecture
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
RDMA High-Performance Networking Foundations: Kernel Bypass, Zero-Copy, Queue Pairs, and Lossless RoCEv2 (PFC/ECN) Architecture
#
rdmarocev2
#
networking
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Mapping the NVIDIA GPU Driver Stack: From Kernel Modules to Container Runtimes
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Mapping the NVIDIA GPU Driver Stack: From Kernel Modules to Container Runtimes
#
gpudriverstack
#
ai
#
programming
Comments
Add Comment
11 min read
Moderation
Network & Transport Layers in Depth: IP Routing, CIDR, TCP 11-State Machine, and Sliding Window First Principles
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Network & Transport Layers in Depth: IP Routing, CIDR, TCP 11-State Machine, and Sliding Window First Principles
#
iproutingtcpstatemachine
#
networking
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
Computer Networking from Scratch: Bits, Physical Media, Hub Collision Domains, and Switch MAC Addressing First Principles
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Computer Networking from Scratch: Bits, Physical Media, Hub Collision Domains, and Switch MAC Addressing First Principles
#
zerofoundationnetworkinglayer2
#
networking
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
Multimodal AI Models Starter Guide
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Multimodal AI Models Starter Guide
#
multimodalllms
#
ai
#
programming
Comments
Add Comment
6 min read
Moderation
Deep Dive into AI Agent Architecture Evolution: From Prompt to Loop Engineering
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Deep Dive into AI Agent Architecture Evolution: From Prompt to Loop Engineering
#
loopengineering
#
ai
#
programming
Comments
Add Comment
6 min read
Moderation
Reject Benchmark Hacking: How to Build an LLM Evaluation System for Your Business (LLM-as-a-Judge)
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Reject Benchmark Hacking: How to Build an LLM Evaluation System for Your Business (LLM-as-a-Judge)
#
llmevaluation
#
ai
#
programming
Comments
Add Comment
7 min read
Moderation
Linux Kernel Networking Subsystem in Depth: From NIC Drivers, NAPI, and Ring Buffers to eBPF XDP Wire-Speed Forwarding
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Linux Kernel Networking Subsystem in Depth: From NIC Drivers, NAPI, and Ring Buffers to eBPF XDP Wire-Speed Forwarding
#
linuxkernelebpfnetworking
#
networking
#
ai
#
programming
Comments
Add Comment
7 min read
Moderation
Kimi KDA, DeepSeek MLA and V4 CSA/HCA: Long-Context Cache and GPU Memory
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Kimi KDA, DeepSeek MLA and V4 CSA/HCA: Long-Context Cache and GPU Memory
#
architectureevolution
#
ai
#
programming
Comments
Add Comment
3 min read
Moderation
Kubernetes Storage Architecture: CSI Specification, Dynamic PV/PVC Provisioning, and StatefulSet Guarantees
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Kubernetes Storage Architecture: CSI Specification, Dynamic PV/PVC Provisioning, and StatefulSet Guarantees
#
k8sstorage
#
datascience
#
devops
#
ai
Comments
Add Comment
8 min read
Moderation
Hacking the Kubernetes Scheduler: Custom Plugins via Scheduling Framework, Volcano DRF Math, and Descheduler Dynamic Rebalancing
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Hacking the Kubernetes Scheduler: Custom Plugins via Scheduling Framework, Volcano DRF Math, and Descheduler Dynamic Rebalancing
#
schedulercustomization
#
devops
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Hacking Kubernetes Nodes & Runtimes: Breaking PLEG Bottlenecks, NRI Plugins, Kata/gVisor Sandboxes, and cgroups v2 Tuning
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Hacking Kubernetes Nodes & Runtimes: Breaking PLEG Bottlenecks, NRI Plugins, Kata/gVisor Sandboxes, and cgroups v2 Tuning
#
noderuntimecustomization
#
devops
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Kubernetes Extensibility: The Operator Pattern, Custom Resource Definitions (CRD), and KubeBuilder in Production
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Kubernetes Extensibility: The Operator Pattern, Custom Resource Definitions (CRD), and KubeBuilder in Production
#
operatorpattern
#
devops
#
ai
#
programming
Comments
Add Comment
8 min read
Moderation
Kubernetes Networking Panorama: CNI Specification, Calico BGP, Cilium eBPF, and Gateway API Architecture
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Kubernetes Networking Panorama: CNI Specification, Calico BGP, Cilium eBPF, and Gateway API Architecture
#
k8snetworking
#
networking
#
devops
#
ai
Comments
Add Comment
9 min read
Moderation
2026 AI Computing Infrastructure: Kubernetes GPU Operator, MIG Partitioning, Topology-Aware Scheduling, and Auto-scaling Inference Engines
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
2026 AI Computing Infrastructure: Kubernetes GPU Operator, MIG Partitioning, Topology-Aware Scheduling, and Auto-scaling Inference Engines
#
aigpuscheduling
#
devops
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
Production Databases and Storage on Kubernetes: Local NVMe Passthrough, RocksDB/WAL Tuning, and Fencing Split-Brain Protection
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Production Databases and Storage on Kubernetes: Local NVMe Passthrough, RocksDB/WAL Tuning, and Fencing Split-Brain Protection
#
databasestorage
#
datascience
#
devops
#
ai
Comments
Add Comment
7 min read
Moderation
Hacking the Kubernetes Control Plane: WatchCache Internals, Aggregated APIServers, APF Shuffle Sharding, and 10k-Node etcd Sharding
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Hacking the Kubernetes Control Plane: WatchCache Internals, Aggregated APIServers, APF Shuffle Sharding, and 10k-Node etcd Sharding
#
controlplanecustomization
#
devops
#
ai
#
programming
Comments
Add Comment
8 min read
Moderation
Kubernetes Control Plane Deep Dive: Declarative APIs, etcd Consensus, Scheduler, and Controller Reconciliation Loops
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Kubernetes Control Plane Deep Dive: Declarative APIs, etcd Consensus, Scheduler, and Controller Reconciliation Loops
#
k8scontrolplane
#
devops
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Application Networking on Kubernetes: The gRPC Load Balancing Trap, Service Mesh, and Zero-Downtime Draining Sequences
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Application Networking on Kubernetes: The gRPC Load Balancing Trap, Service Mesh, and Zero-Downtime Draining Sequences
#
applicationnetworking
#
networking
#
devops
#
ai
Comments
Add Comment
8 min read
Moderation
IP Addressing and Subnetting First Principles: Binary Arithmetic, Subnet Masks, CIDR, and Default Gateway Routing
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
IP Addressing and Subnetting First Principles: Binary Arithmetic, Subnet Masks, CIDR, and Default Gateway Routing
#
ipaddressingsubnetmask
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Production InfiniBand Deployment, Cluster Operations, and NCCL Tuning: OFED Drivers, OpenSM HA, ibdiagnet Fabric Auditing, and GPUDirect RDMA
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Production InfiniBand Deployment, Cluster Operations, and NCCL Tuning: OFED Drivers, OpenSM HA, ibdiagnet Fabric Auditing, and GPUDirect RDMA
#
productionopsnccltuning
#
networking
#
ai
#
programming
Comments
Add Comment
8 min read
Moderation
InfiniBand Architecture First Principles: Physical Link Rates, Credit-Based Link Flow Control, and Subnet Manager Fabric Orchestration
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
InfiniBand Architecture First Principles: Physical Link Rates, Credit-Based Link Flow Control, and Subnet Manager Fabric Orchestration
#
infinibandsubnetmanager
#
networking
#
ai
#
programming
Comments
Add Comment
8 min read
Moderation
Beyond Simple Prompts: How Environment Scaling Is Reshaping Autonomous Agents in 2026
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Beyond Simple Prompts: How Environment Scaling Is Reshaping Autonomous Agents in 2026
#
environmentscaling
#
agents
#
ai
#
programming
Comments
Add Comment
3 min read
Moderation
Enterprise LAN Infrastructure: VLAN Segmentation (802.1Q), Dynamic DHCP, and NAT Port Forwarding
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Enterprise LAN Infrastructure: VLAN Segmentation (802.1Q), Dynamic DHCP, and NAT Port Forwarding
#
lanvlaninfrastructure
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Kimi K3 vs GLM-5.3 vs DeepSeek-V4: Architecture, Benchmarks and Deployment
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Kimi K3 vs GLM-5.3 vs DeepSeek-V4: Architecture, Benchmarks and Deployment
#
chinesellms
#
ai
#
programming
Comments
Add Comment
3 min read
Moderation
Lightweight Cluster Orchestration: Docker SwarmKit Architecture, Raft Consensus, and Ingress Routing Mesh
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Lightweight Cluster Orchestration: Docker SwarmKit Architecture, Raft Consensus, and Ingress Routing Mesh
#
clusterorchestration
#
devops
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Docker Internals from First Principles: Linux Namespaces, cgroups v2, and OverlayFS Union Mounts Deep Dive
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Docker Internals from First Principles: Linux Namespaces, cgroups v2, and OverlayFS Union Mounts Deep Dive
#
containerinternals
#
devops
#
ai
#
programming
Comments
Add Comment
11 min read
Moderation
Context Engineering Guide: Managing Context Window like RAM
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Context Engineering Guide: Managing Context Window like RAM
#
contextengineering
#
ai
#
programming
Comments
Add Comment
4 min read
Moderation
Container Networking Deep Dive: veth-pair, Linux Bridge, iptables NAT, and Cross-Host Topology
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Container Networking Deep Dive: veth-pair, Linux Bridge, iptables NAT, and Cross-Host Topology
#
containernetworking
#
networking
#
devops
#
ai
Comments
Add Comment
9 min read
Moderation
Deep Dive into 11 AI Foundation Model Trends in 2026
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Deep Dive into 11 AI Foundation Model Trends in 2026
#
techtrends
#
ai
#
programming
Comments
Add Comment
11 min read
Moderation
The Critical Crossroads in AI History: Why Was *That One* Chosen Every Time?
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
The Critical Crossroads in AI History: Why Was *That One* Chosen Every Time?
#
techevolution
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
Evolving Models at Runtime: From Basic Reflection to MCTS-based Test-Time Compute
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Evolving Models at Runtime: From Basic Reflection to MCTS-based Test-Time Compute
#
selfcorrection
#
agents
#
ai
#
programming
Comments
Add Comment
4 min read
Moderation
2026 AI Paradigm Shift: Distributed Agent Orchestration & Evals to Combat Error Compounding
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
2026 AI Paradigm Shift: Distributed Agent Orchestration & Evals to Combat Error Compounding
#
orchestrationevals
#
agents
#
ai
#
programming
Comments
Add Comment
5 min read
Moderation
Agent Observability & Debugging: The Path from Black Box to White Box
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Agent Observability & Debugging: The Path from Black Box to White Box
#
observability
#
agents
#
ai
#
programming
Comments
Add Comment
4 min read
Moderation
Inside DeepSeek's Trillion-Token Engine: DeepInfer and deepseek-recipe Architecture from Silicon to Protocol Layer
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Inside DeepSeek's Trillion-Token Engine: DeepInfer and deepseek-recipe Architecture from Silicon to Protocol Layer
#
inferencearchitecture
#
ai
#
programming
Comments
Add Comment
29 min read
Moderation
Production Deployment of DeepSeek-V4 and Kimi K3: 32-GPU Topologies, Memory Math, and Real-World Troubleshooting
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Production Deployment of DeepSeek-V4 and Kimi K3: 32-GPU Topologies, Memory Math, and Real-World Troubleshooting
#
clusterdeployment
#
ai
#
programming
Comments
Add Comment
17 min read
Moderation
2026 Mainstream Foundation Models Comparison: GPT-5.4 vs Claude Opus 4.6 vs Gemini 3.1 Pro
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
2026 Mainstream Foundation Models Comparison: GPT-5.4 vs Claude Opus 4.6 vs Gemini 3.1 Pro
#
modelbenchmark
#
ai
#
programming
Comments
1
comment
4 min read
Moderation
Communication Protocols and Concurrency Control in Multi-Agent Systems
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Communication Protocols and Concurrency Control in Multi-Agent Systems
#
multiagent
#
agents
#
ai
#
programming
Comments
Add Comment
5 min read
Moderation
Building a Lightweight Agent Framework from Scratch: State Machines and Event Streams
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Building a Lightweight Agent Framework from Scratch: State Machines and Event Streams
#
architecture
#
agents
#
ai
#
programming
Comments
Add Comment
5 min read
Moderation
Advanced Tool Use in Agent Architecture: Dynamic Discovery, Sandboxing, and Self-Healing Recovery
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Advanced Tool Use in Agent Architecture: Dynamic Discovery, Sandboxing, and Self-Healing Recovery
#
tooluse
#
agents
#
ai
#
programming
Comments
Add Comment
5 min read
Moderation
Prompt Engineering Practice Guide
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Prompt Engineering Practice Guide
#
promptengineering
#
ai
#
programming
Comments
Add Comment
7 min read
Moderation
Retrieval-Augmented Generation (RAG) in Practice: Strategies & Production Best Practices
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Retrieval-Augmented Generation (RAG) in Practice: Strategies & Production Best Practices
#
ragarchitecture
#
datascience
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
LLM Fine-Tuning Guide: How It Works, Real-World Use Cases, and Workflows
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
LLM Fine-Tuning Guide: How It Works, Real-World Use Cases, and Workflows
#
finetuning
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
LLM Quantization Precision Guide: From FP32 to 1-bit, How Much Quality Do You Actually Lose?
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
LLM Quantization Precision Guide: From FP32 to 1-bit, How Much Quality Do You Actually Lose?
#
quantizationprecision
#
performance
#
ai
#
programming
Comments
Add Comment
4 min read
Moderation
LLM Quantization Hands-On Guide: Four Routes from Zero to Production
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
LLM Quantization Hands-On Guide: Four Routes from Zero to Production
#
quantizationhandson
#
performance
#
ai
#
programming
Comments
Add Comment
10 min read
Moderation
Skills Deep Dive: Give Your AI Coding Assistant a Professional Brain
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Skills Deep Dive: Give Your AI Coding Assistant a Professional Brain
#
agentskills
#
ai
#
programming
Comments
Add Comment
11 min read
Moderation
AI Agent Memory Architecture: From Working Memory to Episodic Memory & Hierarchical Graph RAG
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
AI Agent Memory Architecture: From Working Memory to Episodic Memory & Hierarchical Graph RAG
#
agentmemory
#
agents
#
ai
#
programming
Comments
Add Comment
12 min read
Moderation
The Future of LLM Inference: Test-Time Compute, Reasoning Scheduling, and Tiered Cluster Storage
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
The Future of LLM Inference: Test-Time Compute, Reasoning Scheduling, and Tiered Cluster Storage
#
futurearchitectures
#
machinelearning
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Production LLM Inference Engines Teardown: vLLM v1 vs. SGLang vs. TensorRT-LLM vs. llama.cpp Internals
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Production LLM Inference Engines Teardown: vLLM v1 vs. SGLang vs. TensorRT-LLM vs. llama.cpp Internals
#
inferenceengines
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
Prefill-Decode (P/D) Disaggregation Architecture: Compute-Memory Decoupling, RDMA Distributed KV Cache Transfer, and Cluster-Scale Pooling
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Prefill-Decode (P/D) Disaggregation Architecture: Compute-Memory Decoupling, RDMA Distributed KV Cache Transfer, and Cluster-Scale Pooling
#
inferencesystems
#
ai
#
programming
Comments
Add Comment
13 min read
Moderation
MoE Inference Internals: Expert Parallelism (EP), Dynamic Routing Gating, and All-to-All Overlapping
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
MoE Inference Internals: Expert Parallelism (EP), Dynamic Routing Gating, and All-to-All Overlapping
#
moesparsity
#
ai
#
programming
Comments
Add Comment
14 min read
Moderation
Model Architecture Driving Inference Systems: From MHA/GQA to DeepSeek MLA Matrix Absorption and Memory Minimalism
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Model Architecture Driving Inference Systems: From MHA/GQA to DeepSeek MLA Matrix Absorption and Memory Minimalism
#
attentionarchitecture
#
ai
#
programming
Comments
Add Comment
11 min read
Moderation
Evolution of Attention Kernels: From FlashAttention-1/2/3 SRAM Tiling to FlashInfer Unified Heterogeneous Serving
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Evolution of Attention Kernels: From FlashAttention-1/2/3 SRAM Tiling to FlashInfer Unified Heterogeneous Serving
#
kerneloptimization
#
ai
#
programming
Comments
Add Comment
13 min read
Moderation
Prefix Caching and State Reuse: From Hash Block Addressing to SGLang RadixAttention and Dynamic Tree Eviction
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Prefix Caching and State Reuse: From Hash Block Addressing to SGLang RadixAttention and Dynamic Tree Eviction
#
prefixcaching
#
ai
#
programming
Comments
Add Comment
11 min read
Moderation
Evolution of High-Concurrency Batching: From Continuous Batching to Chunked Prefill Eliminating Head-of-Line Blocking
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Evolution of High-Concurrency Batching: From Continuous Batching to Chunked Prefill Eliminating Head-of-Line Blocking
#
batchingscheduling
#
ai
#
programming
Comments
Add Comment
14 min read
Moderation
Memory Virtualization in Inference Engines: PagedAttention and the Elimination of Memory Fragmentation
ifnodoraemon
ifnodoraemon
ifnodoraemon
Follow
Oct 21
Memory Virtualization in Inference Engines: PagedAttention and the Elimination of Memory Fragmentation
#
memoryvirtualization
#
ai
#
programming
Comments
Add Comment
9 min read
Moderation
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account