HN OsamaJaber 8d ago

Build You Own Model

RunInfra benchmarks and optimizes LLM model serving. Compares inference engines, GPU allocation, latency, throughput, and provides deployment kits.

HN Gedxx 8d ago

Transcribe.cpp

transcribe.cpp: Open-source C/C++ speech-to-text inference library with GPU support. Portable STT tool similar to llama.cpp.