SkillsAboutProjectsInsights
DevOpsCloudShipped

Doomscroll: A Serverless, Least Privilege Job Ingestion Pipeline on AWS

I build an AWS email automation that scrapes job listings from multiple API's and filters them out based on my preferences.

The resultCuts down on time spent searching for jobs so I can focus on applying and interviewing.

Architecture thumbnail of a serverless AWS job ingestion pipeline: EventBridge Scheduler, Lambda, DynamoDB, and SNS reducing 3,596 job postings to 65 matches.
1 / 4

If you're job hunting, you're spending hours reading postings that were never going to fit.

  • The good roles are buried. One large employer had 2,725 open postings. Fewer than 1% fit an early career cloud or embedded engineer.
  • Keyword search can't read requirements. "Active TS/SCI required" and "able to obtain TS/SCI" look the same to a search box. One rules you out, the other is an open door.
  • You check every board, every day, or you miss things. New postings don't wait for you to remember.
  • Applications get lost. A folder of bookmarks can't tell you who you applied to, who's interviewing you, or who ghosted you.