System Design & Scalability

Capacity planning, sharding, multi-region, and cost/perf trade-offs.

  • 5 Tracked terms
  • Last 30 days Feed window

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.

Latest in System Design & Scalability


dev.to > qweezyy > one-field-in-the-request-made-our-agent-3x-cheaper-and-8x-faster-5e8c

One field in the request made our agent 3x cheaper and 8x faster

1+ day, 3+ hour ago   (694+ words) This is the third post about the project: the first is about snapshots and running tests before "done", the second about cutting a browser agent's tokens by 58%. We ran the agent on a cheap reasoning model (glm-5.3-flash) and read…...


dev.to > amankumar_apiclaw > 6-guardrails-that-stopped-my-coding-agent-from-burning-through-api-budget-jh8

6 Guardrails That Stopped My Coding Agent From Burning Through API Budget

1+ day, 10+ hour ago   (309+ words) Coding agents are great until you look at the bill. A single "fix the failing tests" task can turn into 40+ model calls, each one re-sending the system prompt, file snippets and the previous tool output. Here are the six guardrails…...


benchlm.ai > compare > decision-index-0-3-jevfire-vs-kimi-k2-5

Jevfire vs Kimi K2.5: Benchmarks & Cost

3+ day, 13+ hour ago   (69+ words) Updated October 6, 2026. We do not rank this pair: at least one has no public score. Public scores include evidence status and uncertainty. Jevfire vs Kimi K2.5 Supported · Public rank #80 Jevfire has no comparable published API token rate. Jevfire is not ranked…...


benchlm.ai > compare > decision-index-0-3-jevfire-vs-kimi-k2-7-code

Jevfire vs Kimi K2.7 Code: Benchmarks & Cost

3+ day, 13+ hour ago   (70+ words) Updated October 6, 2026. We do not rank this pair: at least one has no public score. Public scores include evidence status and uncertainty. Jevfire vs Kimi K2.7 Code Estimated · Public rank #79 Jevfire has no comparable published API token rate. Jevfire is not…...


benchlm.ai > compare > decision-index-0-3-jevfire-vs-kimi-2-6

Jevfire vs Kimi K2.6: Benchmarks & Cost

3+ day, 13+ hour ago   (69+ words) Updated October 6, 2026. We do not rank this pair: at least one has no public score. Public scores include evidence status and uncertainty. Jevfire vs Kimi K2.6 Estimated · Public rank #52 Jevfire has no comparable published API token rate. Jevfire is not ranked…...


medium.com > @kenmazaika > how-much-does-it-cost-to-run-an-ai-agent-my-30-day-receipt-d1fefe84612f

How Much Does It Cost to Run an AI Agent? My 30-Day Receipt

2+ day, 23+ hour ago   (493+ words) Short answer: $50.93 a month for my normal setup. The scary number was a meter I chose, not the agent. The short answer is $50.93 a month: my $20 ChatGPT premium subscription plus $30.93 of metered DeepSeek. I already had the subscription, so if…...


dev.to > karmendra_pandey_43ac6983 > i-found-a-cost-blind-spot-in-an-open-source-agent-framework-34b9

I Found a Cost Blind Spot in an Open-Source Agent Framework

3+ day, 8+ hour ago   (365+ words) I was building cost attribution for AI agents on AWS when I ran into a gap in the open-source Strands Agents SDK: the framework knew how to talk to Amazon Bedrock models, but it didn't know which family some of…...


dev.to > leojulieta > boost-ai-training-speed-homa-low-latency-transport-42al

Boost AI Training Speed: Homa Low‑Latency Transport

4+ day, 15+ hour ago   (89+ words) All tests run on NVIDIA DGX‑H100 nodes with 100 Gbps Ethernet; baseline is TCP Cubic. Both clouds expose the Homa port (11211) through their security‑group rules; make sure to allow UDP traffic between all training nodes. If you use OpenMPI: Deploy…...


dev.to > dekita > your-agent-loop-has-no-cost-ceiling-here-is-the-fix-1mjo

Your agent loop has no cost ceiling. Here is the fix.

5+ day, 3+ hour ago   (1133+ words) Agent workflows are not expensive because the model is expensive. They are expensive because nothing in the loop stops the loop. A chatbot query is one request. An agent task is a chain: plan, read, edit, test, read the error,…...


dev.to > manveer-banxal > ai-agent-cost-per-month-the-token-maths-worked-out-4e35

AI Agent Cost per Month: The Token Maths, Worked Out

6+ day, 5+ hour ago   (988+ words) A four-message support chat with a tool-using AI agent can send the model more than 45,000 input tokens. That's about twelve times Anthropic's own estimate of roughly 3,700 tokens for a support conversation (Anthropic pricing). Nothing is broken: each turn simply resends…...