Cloud AI

Featured

Rows of servers in a data center connected by network cables, representing GPU worker nodes waiting for autoscaling decisions

GPU Autoscaling by Queue Depth: The Full KEDA Setup

Nov 10, 2026

GPU autoscaling for asynchronous inference should key off queue depth, not CPU utilization. KEDA’s aws-sqs-queue trigger reads an Amazon SQS queue and turns its backlog into a replica-count metric, using a per-replica queue target...

Rows of GPU servers in a data center rack, the shared hardware that multi-LoRA serving allocates across many fine-tuned adapters

Artificial Intelligence

Multi-LoRA Serving: Sharing One GPU Across Adapters

Nov 9, 2026

Rows of memory modules inside a data center server, representing the memory footprint of a vector index

Artificial Intelligence

HNSW Tuning in Practice: m, ef_construction, ef_search

Nov 8, 2026

Insights for your day

Rows of GPU accelerator servers in a data center rack used for LLM inference

Artificial Intelligence

KV Cache Memory Sizing for Long-Context LLM Serving

Nov 7, 2026

KV cache memory — not model weights — is usually the constraint that decides how many long-context requests a GPU can serve concurrently. The key-value cache for each request is huge and grows and...

Rows of GPU servers installed in a data center rack for AI inference workloads

Artificial Intelligence

Cloud Run GPU Inference: Limits, Cold Starts, Costs

Nov 6, 2026

Cloud Run GPU attaches an NVIDIA accelerator to a fully managed container service: no drivers to install, no reservations to book, and a service that can scale down to zero between requests. For bursty...

Fresh perspectives

Rows of servers inside a locked data center rack representing confidential computing infrastructure

Artificial Intelligence

Confidential Computing Attestation for AI Inference

Nov 5, 2026

Confidential computing attestation is the cryptographic handshake that lets a key service decide whether the code requesting your model weights or customer data is the exact workload you built. AWS Nitro Enclaves issue signed...

Artificial Intelligence

OpenAI agent pipeline: 948 Linux root exploits in 30h

Nov 5, 2026

OpenAI has published the details of an agentic security pipeline that, in a single 30-hour October run using an upcoming cyber-focused model, triaged 2,308 candidate Linux kernel findings, dynamically reproduced 1,724 vulnerabilities, and produced...

Close-up of a modern server unit in a blue-lit data center environment.

Cloud Computing

AWS Training in Brazil: What Reddit Reveals About the Real Experience

Nov 4, 2026

Brazilian cloud engineers and DevOps practitioners have turned Reddit into one of the most honest feedback loops on AWS training available anywhere.

Ethernet cables connecting racks of servers in a data center, representing streamed token delivery over plain HTTP

Artificial Intelligence

Streaming LLM Tokens: SSE vs WebSocket in Production

Nov 4, 2026

For streaming LLM tokens from a hosted model API to a client, server-sent events over plain HTTPS is the right default — it is the transport the providers themselves ship. Anthropic’s Messages API streams...