🚀 Event-Driven Product Processing System (AWS Serverless)

This project demonstrates a serverless event-driven architecture using AWS services like API Gateway, Lambda, SQS, and DynamoDB.

🧩 Architecture Overview

Flow:

User → API Gateway → ProductProcess Lambda → SQS → ProductLoader Lambda → DynamoDB

Additional:

• CloudWatch → Logging & Monitoring

⚙️ Technologies Used

• AWS API Gateway
• AWS Lambda (Python Runtime)
• AWS SQS (Queue)
• AWS DynamoDB
• AWS CloudWatch
• IAM Roles & Policies
• Postman (Testing)

📁 Reference Code

GitHub Repository: 👉 https://github.com/ShubhamJoshi-dev/Event-Driven-Product-Processing-Lambda.git

🔧 Step-by-Step Setup

1️⃣ Create API Gateway

• Go to API Gateway
• Create API
• Create Resource (e.g., /product)
• Inside resource → Create Method → POST
• Enable CORS
• Deploy API

2️⃣ Create First Lambda (ProductProcess)

• Runtime: Python

• Create new IAM Role

• Add permissions for:

  • SQS
  • CloudWatch Logs

Lambda Configuration:

• Timeout: 15 minutes (General config)

• Add Environment Variables:

  • SQS_URL = your SQS queue URL
  • TABLE_NAME = DynamoDB table name

👉 Paste processor code from repo

3️⃣ Integrate API Gateway with Lambda

• Connect POST method to ProductProcess Lambda
• Deploy API

4️⃣ Test Using Postman

• Send POST request:

POST /product

• Check Lambda logs in CloudWatch

5️⃣ Create SQS Queue

• Go to SQS
• Create Queue
• Copy Queue URL
• Add URL to Lambda Environment Variable (SQS_URL)

6️⃣ Create Second Lambda (ProductLoader)

• Runtime: Python
• Create new IAM Role

Add Permissions:

• SQS
• DynamoDB
• CloudWatch

Configuration:

• Timeout: 2 minutes
• Add Environment Variables (if required)

👉 Paste loader code from repo

7️⃣ Connect SQS to Lambda (Trigger)

• Go to ProductLoader Lambda
• Add Trigger → SQS
• Select your queue

⚠️ If trigger not working:

• Reduce Lambda timeout first
• Attach trigger
• Then increase timeout if needed

8️⃣ Create DynamoDB Table

• Create table (e.g., Products)
• Add table name in ProductProcess Lambda ENV

✅ Final Flow Testing

POST Request

• Send POST request from Postman

• Flow:

  • API Gateway → Lambda → SQS → Loader Lambda → DynamoDB

✔ Data should be stored in DynamoDB

GET Request

• Add GET method in API Gateway
• Integrate with Lambda (optional)
• Fetch data from DynamoDB

📊 Monitoring

Use CloudWatch for:

• Logs
• Debugging
• Execution tracking

⚠️ Important Notes

• Always enable CORS in API Gateway
• Use environment variables instead of hardcoding
• Ensure correct IAM permissions
• Timeout settings matter for Lambda execution

🎯 Conclusion

This architecture ensures:

• Loose coupling (via SQS)
• Scalability
• Fault tolerance
• Serverless cost efficiency

🙌 Credits

Reference Implementation: https://github.com/ShubhamJoshi-dev/Event-Driven-Product-Processing-Lambda.git

🔥 Your event-driven system is now ready!