Amazon Kinesis could make it simple to assemble, system, and assess actual-time, streaming information so you will get well timed insights and react shortly to new info and information. With Amazon Kinesis, you’ll be able to ingest serious-time information these as film, audio, utility logs, web website click on on streams, and IoT telemetry particulars for machine studying, analytics, and different apps. On this session, we are going to look at and reveal biggest procedures for streaming architectures, highlight services and products these as Amazon Kinesis, Amazon Kinesis Analytics, and Amazon Kinesis Firehose and dive deep into quite a lot of outstanding attributes these sorts of as instantly reworking info as it’s ingested by Amazon Kinesis Firehose and integrating AWS Lambda into your workflow to make a serverless streaming structure.
resource
Index
Kinesis Data Streams intro = 7:00
Lambda Poison messages = 10:18
Kinesis Enhanced Fan out = 15:09
Kinesis Firehose ITL = 19:25
Firehose with Glue catalog for schema/format conversion = 22:55
Glue catalog demo = 27:55
Using custom prefixes demo = 32:05
10:20 Poison Messages
What is better to use for parsing incoming data and transformation, update data in order to send all data to other application by API ? KDS + Kinesis Data Analytics ?
what i should use in case if i need to fetch all data in stream, convert , transform all data and send result by API ? is KDS support converting/transformation in real time or i have to use Firehose?
Good session! Thanks Randy…
Excellent video, entire session had multiple aspects learn.
Technical information overview no-doubt was good but below points added benefits –
a) conceptual thinking
b) how to reduce redundancy with EFO-Pipe
c) composed delivery of concept from start till end.