Skip to main content

Smart Bank – AI Powered Banking Assistant


Role-Based Dashboards using Semantic Kernel, Azure OpenAI, MySQL & OpenTelemetry
Banking customers now expect instant, conversational, and personalized service, while banks must keep every interaction secure, auditable, and compliant. Smart Bank answers both needs: an AI-powered banking assistant built on role-based dashboards for customers and administrators, orchestrated by Semantic Kernel, reasoning with Azure OpenAI, backed by a MySQL core data store, and observed end-to-end with OpenTelemetry.
Smart Bank AI Powered Banking Assistant Architecture diagram
Figure 1: The complete Smart Bank architecture, from role-based user access through the FastAPI application layer, Semantic Kernel orchestration, Azure OpenAI reasoning, MySQL persistence, and full-stack observability.

1. What Is Smart Bank?

Smart Bank is a reference architecture for an intelligent banking assistant that lets users converse naturally with their bank instead of navigating dozens of screens. It is not a single product but a composition of cloud-native services that turn natural-language requests like "show my last five transactions," "what is my EMI due date," or "raise a complaint" into safe, governed actions against real banking data.

The platform is organized around three ideas: role-based access so customers and administrators each see only what they should; AI orchestration that translates intent into plugin-driven operations; and continuous observability so every request, query, and AI call is traced, measured, and audited.

  • Conversational: a chat assistant replaces complex navigation for everyday banking tasks.
  • Role-aware: distinct experiences for Customers and Bank Admins, enforced by RBAC.
  • Grounded: answers are based on the bank's own data and documents, not guesswork.
  • Secure: JWT authentication, MFA, and least-privilege permissions throughout.
  • Observable: OpenTelemetry traces, metrics, and logs feed Azure monitoring and alerting.

2. Users and Role-Based Access

Two primary roles drive the entire experience. The architecture deliberately keeps their capabilities separate so that a single platform can serve very different needs without compromising security.

Role Scope of Access
Customer Own accounts, transactions, loans, cards, and complaints (self-service only).
Bank Admin All customers, analytics, reports, operations, and branch data (organization-wide).

The same conversational assistant adapts to the signed-in role: a customer asks about their own balance, while an admin asks the platform to analyze portfolios and act across the bank.

3. Authentication & Access Control

Every session begins at the security boundary. Credentials are verified, a token is issued, and a role-based engine decides what the authenticated identity is allowed to do.

Login

Users authenticate with a username or ID, password, and multi-factor authentication (MFA) for an additional layer of identity assurance.

JWT Token

On success, the platform issues a short-lived access token and a refresh token, enabling stateless, scalable session management across services.

RBAC Engine

A Role-Based Access Control engine maps roles (Customer and Admin) to a granular set of permissions, ensuring least-privilege access on every request.

Why It Matters

Authentication proves who you are; authorization decides what you can do. Together they keep sensitive banking operations protected end-to-end.

4. Role-Based Dashboards

Once authenticated, each role lands on a tailored dashboard. Both dashboards embed the same AI Banking Assistant, but its scope and verbs differ by role.

Customer Dashboard

  • Account Summary & balances
  • Transactions history
  • Loan details and EMIs
  • Credit cards and limits
  • Complaints register & tracking
  • AI Banking Assistant: chat with the bank
  • Profile management

Bank Admin Dashboard

  • Customer & account management
  • Transactions & analytics
  • Loan & credit card management
  • Complaint management
  • Branch performance
  • Reports & operational analytics
  • AI Banking Assistant: ask, analyze, act

5. The Application Layer (FastAPI)

A set of focused, independently scalable services, built with FastAPI, exposes the bank's capabilities as clean APIs. Each service owns a single domain, making the system easier to reason about, test, and evolve.

Service Responsibility
Auth Service Login, MFA, and token issuance & validation.
User Service Profile, preferences, and role management.
Account Service Accounts, balances, and summaries.
Transaction Service Transactions and payments.
Loan Service Loans, EMIs, and dues.
Card Service Cards, limits, and payments.
Complaint Service Register, track, and resolve complaints.
Analytics Service Reports, insights, and dashboards.
Chat Assistant API Send/receive messages and maintain conversation session state.

6. MySQL Database: The Core Data Store

A relational MySQL database is the system of record. A normalized schema links identities, roles, and financial entities through primary and foreign keys, keeping data consistent and queryable.

Table Key Fields Purpose
users user_id (PK), username, password_hash, role_id (FK) Authentication identities.
roles role_id (PK), role_name, description RBAC role definitions.
customers customer_id (PK), name, email, phone, address Customer master data.
accounts account_id (PK), customer_id (FK), account_type, balance Bank accounts & balances.
transactions transaction_id (PK), account_id (FK), amount, status Money movement records.
loans loan_id (PK), customer_id (FK), loan_amount, emi_amount Loan lifecycle & dues.
credit_cards card_id (PK), customer_id (FK), credit_limit, available_limit Card limits & usage.
complaints complaint_id (PK), customer_id (FK), type, status Complaint tracking.
branches branch_id (PK), branch_name, location, manager_id Branch & operations data.

7. Semantic Kernel Orchestration Layer

The intelligence of Smart Bank lives in the Semantic Kernel orchestration layer. It sits between the chat interface and the bank's capabilities, turning a free-form request into a precise, governed sequence of operations.

Intent Detection

Interprets what the user actually wants from natural language.

Prompt Management

Builds and templates the prompts that guide the model's reasoning.

Function Calling

Selects and invokes the right banking function for the intent.

Context & Memory

Maintains conversation context so multi-turn dialogue stays coherent.

Plugin Invocation

Routes the request to the correct banking capability plugin.

Response Generation

Composes a clear, grounded answer to return to the user.

8. Plugins, Knowledge Search & Azure OpenAI

Three capabilities power the assistant's reasoning: a library of banking plugins for actions, a retrieval-augmented knowledge base for grounding, and Azure OpenAI for language understanding.

Plugins (Banking Capabilities)

Plugins expose safe, typed operations the assistant can call: Account, Transaction, Loan, Card, Complaint, Analytics, Customer, and Payment plugins. Each plugin maps directly to an application-layer service.

Knowledge & Search (RAG)

To answer policy and procedural questions accurately, the assistant uses Retrieval-Augmented Generation over Azure AI Search (vector search) across policy documents, FAQs, statements, and bank guidelines, so responses are grounded in the bank's own content.

Azure OpenAI Service

GPT-4o / GPT-4.1 models, paired with an embeddings model, provide chat completion, function calling, and response generation: the linguistic engine behind every conversation.

9. External Integrations & Document Storage

Smart Bank does not operate in isolation. It connects to the broader banking ecosystem and stores documents durably in the cloud.

External Integrations

  • Payment Gateway
  • SMS / Email Service
  • KYC / AML Service
  • Credit Bureau API
  • Core Banking System

Document & File Storage

Azure Blob Storage holds statements, documents, KYC files, loan agreements, and bank policies and forms, keeping large unstructured artifacts separate from the transactional database.

10. Observability & Telemetry (OpenTelemetry)

Observability is the feedback loop that keeps the platform healthy. OpenTelemetry instruments the entire stack and pipes signals into Azure monitoring, audit logging, and alerting.

Pipeline: Instrumentation (traces, metrics, logs, events) → OTel Collectors → Telemetry Data → Azure Monitoring → Audit & Security Logging → Alerting & Notifications
  • Instrumentation: captures request/response traces, DB query performance, API latency, and AI token usage.
  • Collectors: the OTel Collector gathers and forwards telemetry to backends.
  • Azure Monitoring: Application Insights dashboards, workbooks, alerts, and performance views.
  • Audit & Security Logging: login attempts, RBAC changes, data-access logs, and compliance trails.
  • Alerting & Notifications: email, Teams/Slack, SMS alerts, and incident escalation.

Without observability the team flies blind; with it, every AI call and database query becomes measurable, auditable, and improvable.

11. End-to-End Data Flow

Bringing every layer together, a single request travels a clear, traceable path from the user interface to the AI and back, while telemetry is captured at every hop.

Flow: User → React UI (Dashboard / Chat) → JWT Auth → FastAPI APIs → Semantic Kernel (Orchestration) → Plugins / Functions → MySQL DB (Data Retrieval) → Azure OpenAI (Response Generation) → Response to UI → Telemetry Captured

Conclusion

Smart Bank shows how modern AI can be woven into banking without sacrificing security or control. Role-based dashboards keep experiences tailored and safe; Semantic Kernel and Azure OpenAI turn natural language into grounded action; MySQL provides a trustworthy system of record; and OpenTelemetry ensures the whole platform is observable and auditable. Every component is a managed, cloud-native service that integrates natively with the others, eliminating the friction of stitching together disparate tools and positioning the bank to deliver intelligent service that is fast, secure, and reliable.