DEV Community

#localllm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I added a LOCAL MODELS channel to my retro dev TV, and Ollama has no API for it
shouvik12 profile

I added a LOCAL MODELS channel to my retro dev TV, and Ollama has no API for it

#ollama #localllm #opensource #javascript
1
Comments 1
3 min read
Local AI system for business: what local models can and cannot do
cortexai profile

Local AI system for business: what local models can and cannot do

#localllm #privateai #ollama #smallbusiness
Comments
4 min read
Meet Kowalski
yarenty profile

Meet Kowalski

#opensource #rust #ai #localllm
Comments
4 min read
OpenJev benchmarks against a value it never explains
randomchaos profile
RC

OpenJev benchmarks against a value it never explains

#localllm #logits #browserml
Comments
3 min read
Local models can now search the web and fetch pages
someone_somewhere_05cad9e profile

Local models can now search the web and fetch pages

#openspec #ai #localllm #opensource
Comments
2 min read
Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s
jamilxt profile

Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s

#ai #localllm #performance #llm
1
Comments
7 min read
Orquesta CLI: Local LLM Management with Dashboard Sync
orquesta_live profile

Orquesta CLI: Local LLM Management with Dashboard Sync

#orquestacli #localllm #dashboardsync #ollama
Comments
6 min read
What broke when we ran agents on small local models
beesbot profile
Bees

What broke when we ran agents on small local models

#localllm #ai #agents #opensource
1
Comments 2
6 min read
EmbeddingGemma 2 puts multimodal search on a phone
techaiwire profile

EmbeddingGemma 2 puts multimodal search on a phone

#google #openweights #localllm #huggingface
5
Comments
4 min read
Qwen3.8-27B on one RTX 3090, and the setting its README says chat clients should leave at default
renolu profile

Qwen3.8-27B on one RTX 3090, and the setting its README says chat clients should leave at default

#vllm #localllm #speculativedecoding #quantization
Comments
4 min read
Qwen3.8-Flash-Next vs Claude Opus 5.5: Six-way benchmark on a real Rust feature
deepu105 profile

Qwen3.8-Flash-Next vs Claude Opus 5.5: Six-way benchmark on a real Rust feature

#ai #qwen38flashnext #localllm #qwen38
8
Comments 3
15 min read
Still carrying the diagnosis
thekilteddev profile

Still carrying the diagnosis

#localllm #debugging #buildinpublic #opensource
Comments
8 min read
Claude CLI 401 Unauthorized Refresh Token Issue
devlog profile

Claude CLI 401 Unauthorized Refresh Token Issue

#clitools #localllm #troubleshooting
Comments
3 min read
Discord bot not responding but still running: how to catch it
devlog profile

Discord bot not responding but still running: how to catch it

#automation #localllm #macos
Comments
3 min read
Claude Code MCP setup and usage rules
devlog profile

Claude Code MCP setup and usage rules

#clitools #macos #localllm
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.