How to completely block your DynamoDB stream processing

How an simple mistake blocked my stream processing and had me debugging something that I was sure was working for the past week. Simple bug breaks down my whole article processing pipeline When I created my DynamoDB stream, I knew that I will be only adding articles, I was not considering removing records from the table at all. As such, I created a python lambda function, that always checks the NewImage field in the incomming records and processes it....

September 10, 2023

Configuring a DynamoDB stream

How I configured the DynamoDB stream that sends newly created articles to a lambda function for processing. Goal Whenever I insert a new article into my table, I want a lambda function to read the record and process it. Processing includes: extracting header, abstract and date noting last change from the stream event metadata compiling the markdown content to html Creating the table Creating a table in AWS SAM is really easy, it is just a few lines in the template....

September 5, 2023