I am currently working on a project that migrates data from SQL Server to Aurora Postgres. I have more than 5 tasks including several validation tasks as well. A total of 70+ tables were migrating with data in millions. Everything was working fine until we were planning to few more tables and create a new … Read more
In this article, we are going to see how to reconcile the mismatching data in AWS DynamoDB and AWS OpenSearch (Elasticsearch) with the help of Amazon Redshift. In case you are wondering how to migrate the DynamoDB data to Elasticsearch in the first place, then take a look at this article. Note: This reconcile method … Read more
In this article, I will show my method of migrating the entire AWS DynamoDB table to Amazon S3 as CSV. It can further be uploaded to Amazon Redshift using the COPY command. You can also find this code on my GitHub repository. In case you are going to run this code on the local machine, … Read more
If you are someone using Elasticsearch then you may come across a situation where you need to get the entire Elasticsearch data and store it somewhere for further validation. In this article, I will help you to migrate your Elasticsearch index to Amazon S3 as a CSV file. In case you wonder why should you … Read more
Recently, I came across a situation where I needed to access a google sheet programmatically. I was pretty happy since I have done this before using my personal account. I also have an article written on it. Check it out here. So during the process when I shared the client_email to the google sheet, I … Read more
Recently, in one of my projects I have had this small task where I need to split a list into multiple lists and save it as a file in Amazon S3. In this article, I will share the solution along with the code. So, the straight solution is the following piece of code. Let us … Read more
AWS Lambda provides an amazing feature called the layer which allows you to add your custom library. It allows you to stop code repetition. In this article, we are going to see how to achieve this. In case you are someone new to AWS then take a look at this article to know what AWS … Read more
Let us see how to send a webpage as an email along with an attachment file using python SMTP. Previously, I have covered how to send plain text email using python SMTP. Import statement import smtplib from email.mime.multipart import MIMEMultipart from email.mime.application import MIMEApplication from email.mime.text import MIMEText import os The smtplib is responsible for … Read more
Google sheets are commonly used by many people. In this article, I am going to show you how I used python in order to automate the google sheets. Let’s get started!! In my previous article, I shared how to use your Gmail to send emails programmatically. Let’s imagine you have a google sheet named, “Daily … Read more
Sending an email will be a useful feature in any of the applications. In this article, I am going to show you how to send email using your Gmail account programmatically for free with the help of python. Gmail configurations Saving credentials in environment variables Python code Gmail configurations There are two ways to get … Read more