Gemma 3 inference in pure C++ with Metal acceleration

developer-tools / Show HN
45
SCORE

A C++ implementation for running Gemma 3 language model inference with Metal GPU acceleration on Apple hardware. The project provides a lightweight, dependency-minimal approach to local LLM inference without requiring Python or large ML frameworks. It targets macOS devices with Apple Silicon or Metal-compatible GPUs.

VISIT PRODUCT →

Sources (1)

Show HN
https://news.ycombinator.com/item?id=48786298
1 PTS

Score Breakdown

Traction
raw 1.00 · weight 35%
3.5pts
Novelty
2 days old · weight 20%
20.0pts
Source diversity
1 source · weight 10%
3.3pts
AI quality
raw 52.00 · weight 35%
18.2pts

Technically interesting niche tool for Apple Silicon LLM inference, but zero traction and competes with llama.cpp which dominates this space.

Final Score45/100

Similar Products

devspace
DEVELOPER-TOOLS · GITHUB
84
SCORE
eve
DEVELOPER-TOOLS · GITHUB
84
SCORE
kage
DEVELOPER-TOOLS · GITHUB
84
SCORE
launch-your-agent
DEVELOPER-TOOLS · GITHUB
83
SCORE
MiMo-Code
DEVELOPER-TOOLS · GITHUB
82
SCORE
vorssaint-utils
DEVELOPER-TOOLS · GITHUB
82
SCORE
SUPPORT THE PROJECT →
← ALL PRODUCTS© 2026 MARKETHUNT