gufo
A community open-source inference optimization engine for large models, providing custom optimizations targeting inference performance.
Timeline (last 90 days)
The community has custom inference engine projects such as gufo, halogen, strixite, and Strata.
A new batch of inference runtime projects is emerging, including Strata, ninfer, DwarfStar, Splash, llamAmpere, and gufo, which deliberately abandon general compatibility and focus on a small number of models or a single hardware family.
All Facts (2)
The community has custom inference engine projects such as gufo, halogen, strixite, and Strata.
50%UnverifiedA new batch of inference runtime projects is emerging, including Strata, ninfer, DwarfStar, Splash, llamAmpere, and gufo, which deliberately abandon general compatibility and focus on a small number of models or a single hardware family.
50%