Challenges:
- – Every product line uses multiple data sources.
- – Each banking application maintains the data in different retention periods.
- – Very difficult auditing process.
- – Inaccessibility of data within the organization due to missing APIs.
- – Technical downtimes due to inefficient infrastructure on AWS.
Solution:
- – Extract and Load various data sources data into a single data source.
- – Data Transformations to perform cleansing, ensure quality, archival needs, and historical needs
- – Data Reconciliation to validate the completeness from source to destination.
- – Leveraging blue-green deployment to enable minimum downtime of the database.
- – Consistency in data collection and processing ensuring better visibility to leadership.
- – Better visibility and trend analysis via PowerBI dashboards.
Impact:
- – Better visibility and accessibility of data.
- – Batch – ODS (Combined data from FIS, Q2, Signature Core
- – Realtime – Signature Core for real-time data
- – AWS DynamoDB for transactional activities
- – Security Layer – Okta integration for securing REST endpoints
- – Network maintenance and management of all infrastructure, creating VPC, subnet.
- – Maintaining and using RDS, S3, DynamoDB, ECR, EKS, CI/CD pipeline, Repositories,IAM, etc. services to create and build robust AWS infrastructure.