#
Amazon Kinesis
Ingesting data into Aggregations.io from Amazon Kinesis is easy.
#
Prerequisites
To set up this integration you'll need to first:
- Set up an ingest:
- using the JSON Object with Events in an Array Property schema.
- The
Events Property Path
should be @.records.
- Create an API Key to use with this integration with
Write
permissions. We'd recommend creating a dedicated Org-Wide API Key. - Ensure you have permissions to create
Kinesis Data Firehose
resources in your AWS account.
#
Setting up Your Firehose
#
1 - Create a new Delivery Stream
Navigate to your AWS Console and search for Kinesis Data Firehose
in the region with your Kinesis stream.
You'll want to click Create Delivery Stream
- it's usually a big yellow button.
Source should be Amazon Kinesis Data Streams
Destination should be HTTP Endpoint
#
2 - Firehose Settings
#
Source Settings
Choose your source data stream from the options.
#
Delivery stream name
Give your new delivery stream a name that is memorable and represents its purpose. "Aggregations.io Events" would work 😃
#
3 - Destination Settings
HTTP endpoint URL is the POST URL from your ingest.
Access Key is your Aggregations.io Api Key.
Content Encoding select GZIP
.
Buffer Hints > Buffer Size Set to 1 MiB.
#
Conclusion
You're now ready to ingest your Kinesis data into Aggregations.io. With this integration, you can start analyzing data from a myriad of AWS services and data sources in real time.
#
Troubleshooting
#
Error Codes
See the Ingest Docs for common errors ingesting events.