Compare Runtimes

Select runtimes to compare side by side. Click chips below to toggle selection.

MetricPython (CPython)containerdNode.jsGoogle Cloud FunctionsText Generation InferenceKoboldCpp
ScoreB71B-66B-65C59F39F38
TypeLanguageContainerLanguageServerless
Executioninterpretedhybridjithybridhybridhybrid
Interfacecliplatformcliplatformapigui
Cold Start50ms100ms50ms300ms10000ms1500ms
Memory15MB20MB40MB128MB2000MB400MB
Startup10ms20ms20ms50ms5000ms300ms
Isolationprocesscontainerprocesscontainercontainerprocess
Maturityproductionproductionproductionproductionproductionstable
LanguagesPythonAnyJavaScript, TypeScriptPython, JavaScript, TypeScript, Go, Java, Ruby, PHPRust, PythonC++, Python
LicenseOtherApache-2.0MITProprietaryApache-2.0AGPL-3.0
Links