Achieving meaningful business outcomes by combining process redesign with AI solution deployment
Bill Detwiler: And let's talk a little bit about that operational intelligence. You and I were talking before our interview, and let's talk about the importance of understanding what you just said, how work actually flows through an organization for Enterprise AI success. So as part of an AI transformation, how do you evaluate a workflow to determine which steps should be handle—we were talking about this earlier—deterministically if this, then that, which should belong to agents which can handle it a little more ambiguity. We were talking about unstructured data, agents can handle a little more decision and then where human decision making really provides the highest value. How does your team go about doing that?
Vas Moza: Yeah, so it's funny, I think Palantir popularized the idea of an ontology, which is basically creating a mapping of your entire company. And now we see that that is a very clear prerequisite to AI implementation. So what our team will do is we'll come in with forward deployed engineers on the ground for anywhere from four to six weeks for an entire department and we'll conduct interviews, yes, because tribal knowledge always exists in people's heads. We get this with every single company that we talk to. Yes, we do process mining agents on top of their systems of record. Yes, we do screen reporting agents as needed to map out their desktops, their computers to understand what the employees are doing. We also do document ingestion for their SharePoint, their Notion, their Google Drive, the process mining on their Salesforce, their NetSuite, their Dynamics, et cetera. But without also combining that with human interviews, you are always going to be missing the full picture.
And I think that's the beauty of what AI implementation, AI transformation should be is getting that full view, those three angles. From there, what we'll do is actually a lot of co-creation with the company, with the stakeholders. So a lot of the reason that AI implementation, AI transformation has failed in the past is because stakeholders are not brought along that journey. The head of accounts payable, for example, will be very against the solution that these "consultants" or forward deployed engineers propose. If you're basically ripping apart their baby, which they've been running for 10 years and redesigning it, they should have a say in the matter, especially if they're the ones who are expecting to use this agent system in the future. So a lot of it is co-creation with them, spinning up workflows, UIs for them to respond to, and also making sure that we build inside the systems of record.
So we're not here to make a new surface for you to interact with. That's the feedback that we've gotten from a lot of our clients. They would rather us build the agents inside their NetSuite, inside their Salesforce, inside their dynamics, and then when they need to get pinged, it's in their Slack or in their teams. And then finally, to your point of how we decide what should be deterministic, agentic or human in the loop or flat out deleted, oftentimes if it is strictly cycle time, meaning you're going from one team to the next, we view that as a step that should be deleted. AI should be the reason that you consolidate the amount of people involved in a workflow, not the reason that you keep one person for GL coding, one person for invoice approval, one person for line item parsing. That's how you're left with the same length and cycle time of the process.
So those steps are very frequently deleted. Now for deterministic code, it's in the name, it's where it's a very clearly defined set of steps. So if you have an invoice come in, we need to send it to this group of people in Slack, for example, that's deterministic. There's no need for an agent. There's only one group of people, there's only one type of invoice, send it forward. And this is very common in, for example, invoice parsing where that can just be a simple call to OCR. You don't actually need to call an LLM here. Now there's benefits and drawbacks, but that's a conversation for another time. Agentic calling is where you have enough historical data and slight judgment involved to where you can make a reasonable assumption as to what the outcome should be. GL coding is my favorite example here. If you have a thousand past examples of, hey, staples or iPhone or desktops or monitors that are bought for the office, you know what category, what book those should be applied to.
And then finally, human in the loop is where there's either not enough past historical data or there is too much risk involved in using this step, so you're going to have a human to sign off on it before anything happens. I know that was a mouthful, but that's kind of the rundown.
Bill Detwiler: Yeah, no, and I think that last point about risk is really important. But you talked a little bit about the example that you gave before about a large enterprise with multiple systems spread across different geographies I think is so true. So many leaders assume they need to consolidate on a single ERP or CRM before starting an AI initiative. In my experience, before I was in the media and at Celonis, I was in IT myself, and so this is neither possible nor really practical, especially today. And AI makes this, or is helping make this, unnecessary.
Read more: Sweet $10M success: How we’re building towards self-healing processes at Mondelēz International