Reconcile mismatching data in AWS DynamoDB and Elasticsearch (OpenSearch)

In this article, we are going to see how to reconcile the mismatching data in AWS DynamoDB and AWS OpenSearch (Elasticsearch) with the help of Amazon Redshift. In case you are wondering how to migrate the DynamoDB data to Elasticsearch in the first place, then take a look at this article. Note: This reconcile method … Read more

ETL – Migrate the entire AWS DynamoDB table to Amazon S3 as CSV

In this article, I will show my method of migrating the entire AWS DynamoDB table to Amazon S3 as CSV. It can further be uploaded to Amazon Redshift using the COPY command. You can also find this code on my GitHub repository. In case you are going to run this code on the local machine, … Read more

ETL – Complete guide to migrate an entire Elasticsearch index to Amazon S3 as CSV

If you are someone using Elasticsearch then you may come across a situation where you need to get the entire Elasticsearch data and store it somewhere for further validation. In this article, I will help you to migrate your Elasticsearch index to Amazon S3 as a CSV file. In case you wonder why should you … Read more

ETL – Complete guide to migrate AWS DynamoDB to AWS Elasticsearch

If you are someone using AWS DynamoDB for your application and looking for ways to speed the query drastically then you could possibly arrive at AWS Elasticsearch. So you will have to migrate your existing DynamoDB data to Elasticsearch as well as keep both the databases in sync. That is exactly what I am going … Read more