Bilingual AI Voice IVR on Amazon Connect for a Regulated US Fintech Lender
IndustryFinTech
RegionUSA
Duration16-20 Weeks

Bilingual AI Voice IVR on Amazon Connect for a Regulated US Fintech Lender

We built a bilingual AI IVR on Amazon Connect for a US fintech lender, automating 65% of calls while meeting PCI DSS, Reg E, and UDAAP.

Overview

We designed and delivered a natural language AI layer on top of an existing Amazon Connect IVR for a mid-size US fintech lender running a 24/7 bilingual (English/Spanish) customer support line. Before the project, every caller navigated a fixed DTMF keypad menu to reach basic services. After it, they simply say what they need. Card freezes, balance checks, travel notifications, and frequently asked questions all resolve through secure self-service. Agents handle only what genuinely needs a human. The regulatory controls that governed the original system, including PCI DSS recording pause, Regulation E dispute timestamping, and UDAAP wording approval, remain fully intact. A compliance governance console gives the lender's own team direct control over every word the assistant says, without waiting on engineering.

The Challenge

Client Overview

The client is a mid-size US fintech lender running a 24/7 bilingual customer support line across card services, account management, dispute intake, and general banking inquiries. Rapid customer growth had pushed inbound call volume well past what their agent team could comfortably absorb. Leadership knew automation was the right move but had consistently delayed IVR modernisation because of the regulatory complexity involved. They needed a partner who understood that the compliance constraints were the design brief, not the obstacle.

Key Pain Points

  • Every caller navigated the same fixed DTMF keypad menu regardless of their request. Spanish-speaking callers had a particularly poor experience, with no natural language capability in either language and no way to speak their need rather than guess which number to press.
  • A large share of inbound calls were simple automatable requests: balance inquiries, card freezes, branch hours, routing numbers. Each consumed the same agent time as a complex dispute or fraud case.
  • Operations staff could not update IVR content without a full engineering release cycle and a compliance review that took weeks. A branch hours change required a developer, a deployment, and a written approval process with no defined SLA.
  • Three regulatory obligations governed every word the IVR spoke: PCI DSS required recording to pause before any card number entry, Regulation E required the dispute clock to start at first IVR contact rather than agent connection, and UDAAP required all customer-facing wording to be compliance-approved before going live.
  • There was no analytics layer on the existing IVR. The operations team could not measure intent accuracy, call completion rates, or compliance events. They were making decisions about one of their highest-volume customer touchpoints completely blind.

Our Solution

Architecture Overview

Rather than replacing the client's existing IVR, we enhanced it with a secure conversational AI layer that intelligently routes customer requests. Amazon Lex V2 identifies caller intent, directing FAQ requests to an Amazon Bedrock knowledge base while routing transactional operations through AWS Lambda and the client's core banking APIs. This hard architectural boundary ensures sensitive customer data never reaches the LLM. Contact Lens provides real-time analytics and compliance monitoring, while the governance console enables controlled content updates with full auditability and one-click rollback.

Natural Language Front Door on Amazon Connect

We added a conversational AI layer directly to the existing Amazon Connect instance using Amazon Lex V2 for bilingual intent recognition in English and Spanish. Callers now hear: "Say what you need, or press a number from the menu." Both inputs are handled simultaneously in a single Connect block. Lex classifies the caller's intent and routes them to the correct flow. A confidence threshold gate ensures that uncertain matches fall back to the DTMF menu rather than guessing. This is the right tradeoff for a regulated environment: a missed intent that falls to DTMF is a minor inconvenience; a misrouted action in a financial IVR is a compliance incident.

Hard LLM Boundary Architecture

The most important architectural decision in the project was where to draw the line between AI-generated and compliance-reviewed responses. We placed Amazon Bedrock with a curated Knowledge Base exclusively in the FAQ lane: branch hours, current rates, product descriptions, and routing numbers. Bedrock answers only from documents the lender's compliance team has reviewed and approved. If an answer is not found in those documents, the system returns a safe fallback and offers an agent transfer. It never synthesises an answer. Every transactional flow, including balance reads, card operations, payments, and dispute intake, runs through AWS Lambda calling the Program API directly. The LLM never sees account data, card numbers, or authentication credentials. This boundary is enforced architecturally, not by prompt instruction. You cannot accidentally cross it because the two paths never intersect.

Compliance-First Engineering

The client’s strict compliance challenges drove us to implement automated technical controls across PCI DSS, Regulation E, and UDAAP. For PCI DSS, AWS Lambda automatically pauses call recordings before sensitive data entry and resumes after confirmation. This control is rigorously verified by regression tests in every build. To address Regulation E, Lambda instantly logs a timestamp and generates a ticket upon IVR intent detection, ensuring the 10-day statutory clock starts at first contact while providing agents with pre-populated screen pops. Finally, the governance console enforces UDAAP compliance by technically blocking any customer-facing wording from reaching production without written approval.

Program API Integration

The client's core banking operations run on third party Program API, providing real-time REST endpoints for balance reads, transaction history, card activation, card freeze and unfreeze, lost and stolen card processing, payments, and statement requests. Lambda functions call a third party system directly over HTTPS with credentials retrieved from AWS Secrets Manager at runtime. No credentials are hardcoded anywhere in the codebase.

Compliance Governance Console

We built a browser-based admin console deployed in the client's own AWS tenancy, authenticated via SSO, that gives operations and compliance staff direct control over IVR content without requiring engineering involvement or a code release. Changes follow a five-stage workflow: draft, internal review, compliance approval, canary deployment, and full rollout. No change can reach production without a written compliance officer approval record attached to it. That record is immutable once created and stored in an append-only audit log backed by AWS CloudTrail and S3. Rollback is a single-click action that restores the previous live version across all three service layers in under five minutes, with no code change and no engineering involvement required.

Contact Lens Analytics and Accuracy Monitoring

Amazon Connect Contact Lens provides real-time transcription, sentiment detection, and post-call analytics across every call. We built a weekly accuracy dashboard drawing from Contact Lens intent logs, Lambda fulfillment success flags, and post-call CSAT scores. Any week where the wrong action rate exceeds 0.5% triggers an automatic investigation and a mandatory NLU retraining review within five business days. This gave the lender something they had never had: genuine visibility into what their IVR was doing and whether it was doing it correctly.
Key Features

Enterprise-Grade Architecture & Compliance

Built for highly regulated environments, balancing seamless bilingual experiences with uncompromising data security and strict compliance governance.

Natural Language and DTMF in One Flow

Natural Language and DTMF in One Flow

Callers speak or press at any point. Both inputs are handled simultaneously in a single Amazon Connect block with no separate routing logic required.

Bilingual at Full Parity

Bilingual at Full Parity

English and Spanish built natively with separate Lex V2 training sets using real native-speaker utterances, not auto-translated English. Both languages hit the same accuracy targets.

Hard LLM Boundary

Hard LLM Boundary

Bedrock is scoped to FAQ only. Transactional flows never invoke the LLM. No account data, card number, or authentication credential ever reaches a language model.

PCI DSS Recording Pause

PCI DSS Recording Pause

Lambda-triggered recording pause before every card and account number entry, with automated regression testing of this control in every build before deployment.

Regulation E Dispute Timestamping

Regulation E Dispute Timestamping

Dispute contact timestamp written at first IVR touch, not at agent connection. Support ticket created with SLA timer at the moment of intent detection.

UDAAP Governance Workflow

UDAAP Governance Workflow

Five-stage compliance approval pipeline with a mandatory written approval record. No unapproved wording can reach production. Full immutable audit trail in CloudTrail and S3.

One-Click Rollback

One-Click Rollback

Any deployment can be reverted across Lex, Bedrock, and Connect prompt layers simultaneously in under five minutes. No code release, no engineering call required.

Real-Time Accuracy Dashboard

Real-Time Accuracy Dashboard

Contact Lens-powered weekly reporting on intent recognition rate, correct action rate, and wrong action rate per intent, with a continuous NLU retraining pipeline built in.

Technology Stack

Built with Modern Tech

We leverage cutting-edge technologies to build scalable, secure, and high-performance applications that grow with your business.

Amazon ConnectAmazon Connect
Amazon Lex V2Amazon Lex V2
Amazon BedrockAmazon Bedrock
Amazon Polly (Neural) Amazon Polly (Neural)
AWS LambdaAWS Lambda
AWS Step FunctionsAWS Step Functions
DynamoDBDynamoDB
Amazon Connect Contact LensAmazon Connect Contact Lens
 AWS Secrets Manager AWS Secrets Manager
AWS PrivateLinkAWS PrivateLink
AWS SNSAWS SNS
AWS CloudTrailAWS CloudTrail
AWS S3AWS S3
AWS S3AWS S3
Business Impact

Measurable Results

Real outcomes that transformed our client's operations and delivered significant ROI.

Call Automation
Up to 65%

Call Automation

Eligible call volume successfully automated through secure self-service, covering card services and FAQs without agent involvement.

Intent Accuracy
92%+

Intent Accuracy

Intent recognition accuracy target successfully met against a 500-utterance golden test set covering both English and Spanish.

Response Time
Under 2 seconds

Response Time

Target IVR response time achieved for all self-service flows, strictly validated by load testing at 3 times the average peak volume.

Time to Market
16 weeks

Time to Market

Delivered full production from kickoff, establishing the natural language front door and all bilingual transactional operations.

Deployment SLA
Under 30 minutes

Deployment SLA

Time required to move from compliance officer approval to 100% live deployment, including the canary monitoring window.

Rollback Speed
Under 5 minutes

Rollback Speed

Full system rollback SLA met across all service layers without requiring any code change or engineering involvement.

Bilingual Delivery
2 languages

Bilingual Delivery

Delivered English and Spanish at full parity from day one, complete with bilingual compliance controls and prompts.

LLM Data Exposure
Zero

LLM Data Exposure

Absolute architectural enforcement guaranteeing sensitive data, including card numbers and dates of birth, never reached the LLM.

Our Process

Project Delivery Approach

A proven methodology that ensures quality delivery, on time and on budget.

Weeks 1-2: Discovery and Compliance Mapping

Reviewed the existing IVR script, call volume data by intent, and the three regulatory obligations governing the system. Established a 500-utterance golden test set in English and Spanish. Confirmed Program API sandbox access and resolved the IVR authentication service architecture question that had blocked earlier attempts.

Weeks 3-4: Architecture Design and LLM Boundary Definition

Designed the Amazon Connect Contact Flow structure, defined the hard LLM boundary between FAQ and transactional flows, and mapped every PCI DSS, Reg E, and UDAAP control to a specific technical implementation. Reviewed the full architecture with the client's compliance and IT security teams before any build work began.

Weeks 5-8: Core Build, Connect, Lex, and Bilingual NLU

Built the Amazon Connect Contact Flows, trained the Amazon Lex V2 bilingual model with native-speaker Spanish utterances, and developed the authentication Lambda. Ran the full golden test set at the end of this phase. English accuracy reached 93%. Spanish accuracy at 77%, on track for target.

Weeks 9-11: Fulfillment Layer, Lambda, and Compliance Controls

Built fulfillment Lambda functions and Step Functions workflows for all Phase 1 operations. Integrated the Program API. Implemented PCI recording pause with automated regression testing. Implemented Reg E dispute timestamping and support system integration. Loaded the Bedrock Knowledge Base with content reviewed and approved by the client's compliance team.

Weeks 12-13: Governance Console and Audit Trail

Delivered the browser-based compliance governance console with the five-stage approval workflow. Built the immutable audit trail backed by CloudTrail and S3. Trained operations and compliance staff on the admin console. Ran an end-to-end governance test: draft to approval to canary to live to rollback, all verified by the client's compliance officer.

Weeks 14-15: UAT, Soft Launch, and Load Testing

Two weeks of structured UAT on test phone numbers covering every call category in both languages. Soft launch on a subset of real calls with manual review of all incomplete flows. Load test at 3× average peak volume. All three accuracy targets met before full go-live was approved.

Weeks 16-20: Full Go-Live and Hypercare

Full production rollout with 24/7 monitoring for the first two weeks. Spanish accuracy reached 85% by Week 18 as live call data improved the model. Handed over the NLU retraining playbook and monthly accuracy review process to the client's operations team.

Start Your Project

Ready to Build a Scalable Platform Like This?

Let's discuss your idea and turn it into a successful product. Our team of experts is ready to help you achieve your digital transformation goals.

200+
Projects Delivered
98%
Client Satisfaction
10+
Years Experience
24/7
Support Available