Service Clouds: AWS, Azure, GCP, etc.

205 readers

5 users here now

A community for discussions related to all cloud service providers and the tools of the trade.

Related Communities:

General

DevOps

Tools

Platforms

Infrastructure Orchestration

Terraform

Programming

founded 2 years ago

MODERATORS

lxpw@lemmy.ca

need some idea for making a cloud-based project (lemmy.ca)

submitted 2 months ago by kionite231@lemmy.ca to c/service_clouds@lemmy.ca

6 comments fedilink hide all child comments

Hello, I want to create a project showcasing my Cloud platform skills, I don't know what should I host there? I can't just host random open source projects there and call it a day since it will not utilize all the functionality of the Cloud instead it will just utilize a single EC2 instance and that's it.

I have an idea though, I am thinking about making a youtube video using Java + yt-dlp so basically I will use Java (Spring boot) to create the API and yt-dlp to actually download the videos. It will also cache the videos so it will be utilizing S3 bucket to store/cache the downloaded youtube video so that when another person requests the same video we can just sent the video from the S3 bucked instead of fetching it from YouTube servers. so far this is the thing that came to my mind, This project will utilize EC2 instance and S3 bucket. if anyone has any good idea please do share 🙂

you are viewing a single comment's thread
view the rest of the comments

[–] bravemonkey@lemmy.ca 2 points 2 months ago

Having yt-dlp save the videos to S3 will just add to your costs - what benefit will it provide to your users to get the file from S3 compared to Youtube?

My suggestion would be a price checker - create a webpage where users can enter in a URL for a product, an email address and a scrape recurrence time like 24hours, then have Lambda scrape the page & email the price to the user on that schedule. Use DynamoDB (or a relational DB like Postgresql) to save the results, schedule, etc.

Try not to use EC2 at all if possible. Or instead of EC2, use EKS if scraping with Lambda is too difficult.

Most important things is getting the security right.