-
Notifications
You must be signed in to change notification settings - Fork 180
Open
Description
Hi, and thanks for curating this GraphRAG list.
I would like to ask if a project called WFGY Problem Map could fit somewhere in this repo, maybe in a section about RAG debugging, evaluation, or failure analysis.
Short description
- Name: WFGY Problem Map (16-mode RAG / LLM failure map)
- Main entry: https://github.com/onestardao/WFGY/tree/main/ProblemMap/README.md
- Repo: https://github.com/onestardao/WFGY
- License: MIT
What it does
- Defines 16 recurring failure modes that show up in RAG and LLM pipelines, labelled as No.1 to No.16.
- Each mode has its own page with concrete symptoms and minimal fixes (for example hallucination with correct chunks, embedding mismatch, bootstrap ordering, pre-deploy config drift).
- The same 16 modes are used in a TXT-based debugger so users can paste prompts, answers, logs, or traces and get one primary Problem Map number plus suggested next steps.
- Everything is provider-agnostic. It works with any stack (GraphRAG included) because all diagnostics are done at the text and reasoning layer.
Why it might fit this list
- Most entries here help users build GraphRAG systems. WFGY focuses on what to do when those systems start to behave strangely under real traffic.
- The 16-mode map can be used as a checklist when debugging long context reasoning, retrieval drift, or infra ordering problems around GraphRAG workloads.
- It is fully open source and works as a drop-in “text firewall” in front of any RAG pipeline.
If this looks in scope, I am happy to open a small PR that adds one line for WFGY in the appropriate section.
If you feel it is out of scope, no problem, thanks for reading and for maintaining this list.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels