Data Pipeline

data pipeline

This streaming data pipeline consists of five stages. The tweets are fetched using the twitter stream API. The stream is consumed by AWS Kinesis Data Firehose and written to AWS S3 bucket. The S3 bucket is used as a staging layer for Snowflake. Snowpipe is used to load the data continuously in the table.

Step 1

Create the delivery stream using Kinesis Data Firehose.

Kingsly Roche

an odd brief blip

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store