KV-psi, using Linux PSI to to trim an LLM KV cache

developer-tools / Show HN
47
SCORE

KV-psi uses Linux Pressure Stall Information (PSI) to intelligently trim LLM key-value caches. It monitors system memory pressure to optimize cache management for large language model inference workloads.

VISIT PRODUCT →

Sources (1)

Show HN
https://news.ycombinator.com/item?id=48702538
2 PTS

Score Breakdown

Traction
raw 2.00 · weight 35%
5.6pts
Novelty
0 days old · weight 20%
20.0pts
Source diversity
1 source · weight 10%
3.3pts
AI quality
raw 52.00 · weight 35%
18.2pts

Clever niche optimization for LLM inference using Linux PSI, but zero traction and narrow use case limits broader appeal.

Final Score47/100

Similar Products

devspace
DEVELOPER-TOOLS · GITHUB
84
SCORE
eve
DEVELOPER-TOOLS · GITHUB
84
SCORE
coreai-models
AI-TOOLS · GITHUB
84
SCORE
kage
DEVELOPER-TOOLS · GITHUB
84
SCORE
launch-your-agent
DEVELOPER-TOOLS · GITHUB
83
SCORE
MiMo-Code
DEVELOPER-TOOLS · GITHUB
82
SCORE
SUPPORT THE PROJECT →
← ALL PRODUCTS© 2026 MARKETHUNT