Use Case
Airflow -> Get List of ETFs -> Upload to MongoBD -> For each ETF Ticket in MongoDB -> Upload Historical Quote to S3
Use this program to uplaod historial ETFs quotes to S3.
Libraries/Tools Used
- Airflow
Session 1
- Get a list of ETF symbols from a data provider
- Upload the ETF symbols to MongoDB
- For each ETF ticker in the MongoDB get the historical quotes
- Upload the historical quotes JSON to S3
Dataflow Diagram
Video explanation of the code
