Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricBunPython (CPython)llama.cppDockerOpen WebUIKoboldCpp
ScoreB+76B71C+63C-54F41F38
TypeLanguageLanguageContainer
Executionjitinterpretedaothybridhybridhybrid
Interfaceclicliclicliguigui
Cold Start3ms50ms100ms500ms3000ms1500ms
Memory25MB15MB50MB50MB500MB400MB
Startup1ms10ms10ms200ms1000ms300ms
Isolationprocessprocessprocesscontainercontainerprocess
Maturitystableproductionproductionproductionstablestable
LanguagesJavaScript, TypeScript, JSX, TSXPythonC, C++AnyPython, TypeScriptC++, Python
LicenseMITOtherMITApache-2.0MITAGPL-3.0
Links