In this lecture, I will teach you the principles of how to build a big data architecture that stores and processes 1 PB worth of data using different technologies (Redshift, Databricks, BigQuery, SQream).
What will you learn?
1. Challenges with such a big data scale.
2. Consideration set of the use case.
3. The architecture of each technology, relevant features for the use case, and pro/cons analysis.
4. Cost estimation.
5. Performance challenges.
Lecturer: Omid Vahdaty, CTO at Jutomate, a company that specializes in end-to-end data solutions
[ad_2]
source
