Why Can a Long Prompt Stall Active LLM Generation?
A vLLM report shows decode speed dropping to 0.5–5 tok/s during long prefills. Learn what the data proves, what it does not, and how to diagnose it.
Devika Ranganathan Editorial profile
EyesTech editorial profile covering context and retrieval. Articles distinguish source reporting, analysis and documented tests. EyesTech uses AI assistance; this coverage profile is not a verified professional résumé. Corrections: https://eyestech.in/contact/
OpenAI’s “o” Leak: What Dots Now Confirms
OpenAI announced Dots on September 29. Its documented goals, app access and approval rules replace earlier speculation about filters and biometric controls.
Vector Indexing at Scale: HNSW vs. IVF-PQ in 100M-Vector Repositories
An empirical systems audit of HNSW vs. IVF-PQ indexing across 100 million 1536-dimensional vectors. Benchmarking Qdrant, OpenSearch, Milvus, and Faiss on RAM footprint, Recall@10, QPS throughput, and NVMe disk-spilling economics.