Muffakir
An open-source RAG experiment runner that supports automated combinatorial experiments across dimensions including chunking strategy, embedding model, retrieval method, query transformation, reranking, top-k, and generation model. It provides quantitative comparisons of retrieval metrics, generation metrics, latency, and cost, with results exportable as Python code.
Timeline (last 90 days)
Muffakir is an open-source RAG experiment runner created by a developer.
Muffakir supports experimental comparison of RAG components across dimensions including chunking, embedding models, retrieval, query transformation, reranking, top-k, and generation models.
Muffakir automatically runs various RAG component combinations as reproducible trials.
Muffakir uses four dimensions—retrieval metrics, generation metrics, latency, and cost—to compare the results of each trial.
Muffakir allows users to export selected configurations as Python code for use in production environments.
Muffakir currently runs locally and is still in early development.
The new package version of Muffakir has not yet been published to PyPI, and at this stage it can only be installed from the source code in the GitHub repository.
The GitHub repository address for Muffakir is github.com/Mohamed28112003/Muffakir.
The developer's primary purpose in creating Muffakir was to solicit feedback from people who are actually building RAG systems.
All Facts (6)
Muffakir supports experimental comparison of RAG components across dimensions including chunking, embedding models, retrieval, query transformation, reranking, top-k, and generation models.
50%UnverifiedMuffakir automatically runs various RAG component combinations as reproducible trials.
50%UnverifiedMuffakir uses four dimensions—retrieval metrics, generation metrics, latency, and cost—to compare the results of each trial.
50%UnverifiedMuffakir allows users to export selected configurations as Python code for use in production environments.
50%UnverifiedThe GitHub repository address for Muffakir is github.com/Mohamed28112003/Muffakir.
50%UnverifiedMuffakir is an open-source RAG experiment runner created by a developer.
50%