Problem
Creating a data pipeline Hide Assignment Information Instructions This homework will help you practice building an automated data pipeline. You are required to create the following: Cloud Scheduler job OpenSky-API. Triggers Cloud Function hourly Cloud Function opensky-data. Pulls data from OpenSky and drops in GCS Bucket Google Cloud Storage Data Lake. Stores OpenSky records as files DataFlow jobs gcs-to-pubsub-stream and pubsub-to-bigquery move data from GSC into BigQuery PubSub topic opensky-data has subscribers for DataFlow jobs Bigquery Dataset livedata and table liveflights store data for analysis BQML logistic and linear regression models to predict, for any two hour time window, for flights leaving ORD: write a logistic regression model to predict how many flights are ascending based on baro_altitude, heading, and velocity Create a linear regression model to predict velocity based on longitude, latitude, vertical rate and barometric altitude.