Measuring object size with getsizeof

One of my colleague was running a batch to insert records in AWS firehose stream and getting service unavailable exception continuously. Probably, batch was inserting more data than allowed per second. So We thought of adding a log statement which prints the size of records which are sent to firehose.…

How to update athena table with glue

I was working on an application where data was stored in s3 bucket and athena was used to query this data. Since data was frequently updated (on an average, every 30 min or so), which wipes the data in s3 folder and writes new set of data,  I had to…