Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricWasmtimePython (CPython)llama.cppGoogle Cloud FunctionsDockerKoboldCpp
ScoreA88B71C+63C59C-54F38
TypeWebAssemblyLanguageServerlessContainer
Executionaotinterpretedaothybridhybridhybrid
Interfacecliclicliplatformcligui
Cold Start1ms50ms100ms300ms500ms1500ms
Memory5MB15MB50MB128MB50MB400MB
Startup<1ms10ms10ms50ms200ms300ms
Isolationprocessprocessprocesscontainercontainerprocess
Maturityproductionproductionproductionproductionproductionstable
LanguagesRust, C, C++, Go, Python, AssemblyScriptPythonC, C++Python, JavaScript, TypeScript, Go, Java, Ruby, PHPAnyC++, Python
LicenseApache-2.0OtherMITProprietaryApache-2.0AGPL-3.0
Links