2024-08-13 Consolidation

0. Terraform

1. Analyze

   1. Architecture

   2. Microservices

   3. Data Model

2. Parallelize

   1. News

   2. ProcureCrawl

   3. Lambda

   4. Batch

3. Federate

   1. Athena

      1. Pre-Consolidation

      2. Post-Consolidation

4. Migrate

   1. Elastic → S3

   2. Elastic → Image

5. Modularize

   1. Phone Apps

   2. Extension

   3. Event Report

   4. Newsletter

Then to Vector Database!!

2024-09-04 Final Note on Consolidation:

The batch Cortext job now stores data in the semi-structured data model, in S3 cold storage… AWS is doing it’s job by keeping me in the ecosystem - with LocalStack and OpenSearch Serverless: the latter being a lucene head on cold storage - allowing for pay-per-drink.