For most production semantic search, classification and RAG indexing workloads, a modern server CPU is enough to serve embedding models — no GPU required. Small encoder checkpoints such as MiniLM-class models run comfortably in the tens to hundreds of embeddings per second per core on CPU once exported to a …