Defining the Role of AI in Odoo: Deterministic vs. Probabilistic Automation

[ayushin]

"LLMs WILL create technical debt for you, you WILL have to answer to your customers when they hallucinate, or when the action they 'decide' to perform is wrong. LLMs are probabilistic, not deterministic, so you're just gambling." – @aleuffre

AI in ERP systems must be reliable. One major concern is hallucinations—how do we ensure AI outputs are trustworthy?

All in all I think AI hallucinations is a wider problem, not specific to ERP and we have seen a huge progress in the space and different strategies dealing with this issue.

• Should we enforce strict guardrails, such as rule-based validation layers?
• What role does human oversight play in AI-assisted automation?
• How do we balance AI’s probabilistic nature with ERP reliability?
• Is there anything more ERP specific than a system prompt "say you don't know if you can't find the answer in ERP data"?

[diggy128]

Looking at it from the business point of view, I would say this (along with data security) is critical both for adaptation and acceptance.

My best bet would be deterministic results with probabilistic failure reasoning.

E.g.
There are no invoices issued for April, as there are sales orders that are not invoiced yet.
‐------‐deterministic result--------------------, -----------------------probabilistic failure reasoning---------------------‐----------------