Data
Agentic AI and Data Management
Generative AI has given rise to Agentic AI. While ChatGPT is primarily a chatbot that can generate text responses, AI agents can execute complex tasks autonomo…
Read More »
DataChanging historical data records
When migrating data to a new platform, for example from on premises to cloud, you should fix-forward, meaning, that any data record changes are of current, not…
Read More »
AzureMigrating On prem CRM, SFA to Azure
Azure deployment, CRM and a SaaS front end application for end users. Migration of data to Azure and the Azure Data Lake. Necessary Data Migrations 1-On Premis…
Read More »
Cloud Benefits, TrendsProjects in the Cloud should be self-financing
Instead of large firms spending absurd money on external parties to implement a system, or provide ‘consultancy’, against a fixed hourly rate and m…
Read More »
AWS TechnologyAWS Data Lake, Streaming Architecture summary
Example project deployment at a Financial Institution. Creation of a Data Lake with a streaming/real time data ingestion requirement. AWS Data Architecture Des…
Read More »
DataAWS Redshift, a summary
Amazon Redshift Redshift is a fully managed data warehousing service designed for online analytical processing (OLAP) workloads. It is optimized for high-perfo…
Read More »
AWS TechnologyAWS S3 Iceberg Tables
Amazon S3 Iceberg Tables introduced fully managed Apache Iceberg table support to S3, optimizing the storage and querying of tabular data for analytics. By cre…
Read More »
AWS TechnologyRelational, Document, Key Value Databases: summary, use cases
There are a wide variety of databases. With cloud and hybrid architectures often see the following: Relational DB A structured format with rows and columns, re…
Read More »
AWS TechnologyBatching and AWS S3 on prem to S3 cloud
A useful architecture to move data from on-premises to AWS is to consider using AWS S3 outputs and move data directly over a Direct Connect to S3 in AWS. This …
Read More »