AWS Technology
DataOps and ML Ops
The data (pre-)processing part of MLOps focuses on moving data from the source to ML model, without necessarily including how the model executes on the data it…
Read More »
AWS TechnologyS3 Tables and AI
Amazon S3 Tables provide S3 storage that’s optimized for analytics workloads, with features designed to continuously improve query performance and reduce stora…
Read More »
DataChanging historical data records
When migrating data to a new platform, for example from on premises to cloud, you should fix-forward, meaning, that any data record changes are of current, not…
Read More »
DataData issues when integrating a SaaS with a CRM system
When integrating different systems, the data details are important to understand and mitigate. An example would be integrating an industry specific SaaS applic…
Read More »
AWS TechnologyAWS Glue and Databricks
AWS Glue and Databricks Unity Catalog are both data management tools, but they have some key differences in focus and functionality: AWS Glue Focus: ETL (Extra…
Read More »
AWS TechnologyAWS Glue Use Case examples
AWS Glue can serve a wide array of data engineering use cases. Loading Data To The Data Warehouse: One of Glue’s earliest and most popular use cases is loading…
Read More »- AWS Technology
AWS, ETL with Glue
AWS Glue was designed based on these principles: Provide customers the ability to solve problems when the system can not satisfy their needs. Examples include …
Read More » 
AWS TechnologyMigrating ‘Big Data’ processes to AWS
Migrating ‘ Big Data’ pipelines and data processes to AWS will allow organizations to: Scale Seamlessly: AWS services like EMR (to replace Hadoop),…
Read More »
AWS TechnologyAWS Data Lake, Streaming Architecture summary
Example project deployment at a Financial Institution. Creation of a Data Lake with a streaming/real time data ingestion requirement. AWS Data Architecture Des…
Read More »