How to Run a data scraping workload on AWS EKS and visualize using Grafana

This post is my solution walkthrough for the bonus Acloud guru challenge from the Cloud resume book by Forrest Brazeal. The book can be found Here. This challenge is a good learning path for deploying workloads on Kubernetes cluster and spinning up a Kubernetes cluster. This post will describe how I completed the challenge and my approach towards the challenge solution. My challenge solution provides a good learning experience for these technologies:

  • Kubernetes and deploying to Kubernetes
  • App Development (I used Python but in theory it can be anything)
  • Data analysis and visualization using Prometheus and Grafana

For more details visit: https://amlanscloud.com/kubechallenge/

--

--

--

Cloud architect and DevOps engineer. Love to code and develop new stuff. A nerd by nature.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Feed file Generation from data stored in HDFS and exposed using Hive

Why should I invest in an integrated Data & AI platform ?

Knowledge Different Expectations of Evidence ForCases https://t.co/ETZ7WktXTA

Architecture for High-Throughput Low-Latency Big Data Pipeline on Cloud

Big data pipeline architecture on Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP).

Is Big Data Really That Big?

Microscope your dataset — look closer

Pandemic Effect on Crime Rates

Computation by a Population

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Amlan Chakladar

Amlan Chakladar

Cloud architect and DevOps engineer. Love to code and develop new stuff. A nerd by nature.

More from Medium

How to manage CI/CD Pipelines with Event-Driven Architecture on AWS

AWS Database Authentication with IAM

Architecting for sustainability on AWS

Istio Integration Project Calico on AWS — AWS Roadmap