CTransformers

Python bindings for GGML models with GPU acceleration

D
Score: 46/100
Type
Execution
hybrid
Interface
sdk

About

CTransformers provides Python bindings for the Transformer models implemented in C/C++ using GGML library. It supports CUDA and Metal acceleration, LangChain integration, and various GGML/GGUF models.

Performance

800ms
Cold Start
200MB
Base Memory
100ms
Startup Overhead

Last Verified

Date: Jan 18, 2026
Method: manual test

Manually verified

Languages

PythonC++

Details

Isolation
process
Maturity
stable
License
MIT

Links