← All insights

How One Team Replaced 4 Tools With a Single Custom AI System

· Panda AI
How One Team Replaced 4 Tools With a Single Custom AI System

Most tool sprawl doesn't happen because someone made a bad decision. It happens because teams solve problems one at a time, and each solution makes sense in isolation. A project management tool here, a reporting dashboard there, a customer data platform somewhere else, and a transcription service stitched in with a webhook and good intentions. Before long, you have four subscriptions, four logins, four places where information lives, and nobody quite sure which version of the truth is the right one. This is a walkthrough of how one operations team identified that problem, made the case to fix it, and built a single custom AI system to replace the mess—step by step.

Step 1: Auditing What the Four Tools Actually Did

Before anything could be built or replaced, the team needed an honest picture of what each tool was genuinely being used for, not what it was sold as. They ran a two-week audit across the four platforms: a customer feedback aggregator, a manual reporting tool, a task assignment system, and a call transcription service.

The finding that surprised them most was overlap. The feedback aggregator was being used to store notes that should have lived in the task system. The reporting tool was pulling data manually from the transcription service because no integration existed. Two of the four tools were essentially functioning as workarounds for the limitations of the other two. The audit produced a single document listing every real job each tool performed, which became the foundation for what the replacement system needed to do.

Step 2: Mapping the Workflows That Crossed Tool Boundaries

Once the team knew what each tool did, the next step was identifying the workflows that required someone to move between tools. These handoff points were where time was being lost and where errors were most likely to appear. A customer call would be transcribed in tool four, then someone would manually copy action items into tool three, then a manager would pull from tool three to build a report in tool two. Three human touches on information that should have moved automatically.

The team mapped six cross-tool workflows in total. Each one was documented as a current-state flow and a desired-state flow. This exercise was not about building the system yet—it was about making clear what the system needed to make seamless. It also helped stakeholders understand why replacing the tools mattered, because the waste became visible in a way that subscription costs alone had not communicated.

Step 3: Defining What "Custom" Actually Meant for Them

Custom AI system is a phrase that means very different things depending on who is saying it. For this team, it did not mean building a large language model from scratch. It meant designing a system where AI capabilities—specifically language understanding, summarisation, and classification—were connected to their specific data, their specific workflows, and their specific outputs, rather than being a generic off-the-shelf product they had to adapt their behaviour to fit.

They worked with an AI development partner to scope the system in three layers. The first layer was data ingestion: the system needed to receive call transcripts, customer feedback submissions, and task updates in real time. The second layer was intelligence: the system would classify feedback by theme, extract action items from transcripts, and flag priority issues without human intervention. The third layer was output: a single dashboard where managers could see everything they previously had to hunt across four platforms to find. Defining these three layers before writing a line of code kept the build focused.

Step 4: Building in Phases, Not All at Once

One of the clearest decisions the team made was to not attempt a full replacement on day one. They agreed on a phased approach where the new system ran in parallel with the existing tools for the first six weeks. During this period, outputs from the new system were checked against what the old tools would have produced. This was not a lack of confidence in the build—it was a deliberate way to catch edge cases before they caused real problems.

Phase one covered data ingestion and the feedback classification engine. Phase two added the transcript processing and action item extraction. Phase three connected the output dashboard and began the process of switching users over. Each phase had a defined sign-off criteria. The parallel running period also gave the team time to train staff on the new system without the pressure of a hard cutover deadline forcing behaviour change before people were ready.

Step 5: Handling the Messy Reality of Legacy Data

No implementation walkthrough is complete without acknowledging that historical data is almost always a problem. The team had three years of customer feedback, transcripts, and task records sitting across the four platforms in different formats, different naming conventions, and different states of completeness. Migrating all of it was not realistic, and trying to would have added months to the timeline.

The decision they made was to define a clean data start date and migrate only the records that were genuinely needed for ongoing work—open tasks, unresolved feedback threads, and the previous six months of transcripts. Everything older was archived in a read-only format that staff could access if needed but that sat outside the active system. This was not a perfect solution, but it was a practical one. Letting the pursuit of perfect data migration delay a working system would have been the worse outcome.

Step 6: Measuring Whether It Actually Worked

The team identified three measures before the build started: time spent moving information between tools, the average lag between a customer call happening and an action item reaching the responsible person, and the number of reporting errors flagged per month. These were chosen because they were measurable in the existing state and would be measurable in the new state, making comparison straightforward.

Six months after full deployment, the time spent on manual data movement had dropped significantly. The lag on action item assignment fell from an average of around two days to same-day in most cases. Reporting errors dropped to near zero because the data was no longer being copied by hand. The team also retired three of the four tool subscriptions entirely—one was retained in a limited capacity for a specific compliance function that fell outside the new system's scope. The outcome was not perfect, but it was a meaningful improvement that could be traced directly to specific decisions made during the build.

One platform runs an accounting practice

From invoice OCR to filed Thai tax returns — the platform behind these articles runs real operations in Thailand every day.

Explore the platform →