Stream Processing Design Patterns | Capital One

  Переглядів 15,669

Data Council

Data Council

День тому

Get the slides: www.datacouncil.ai/talks/stre...
ABOUT THE TALK:
Streaming applications can be designed to balance or favor one or more of latency, throughput, memory consumption, or CPU load. In order to scale growing real-time applications well, properties like replayability, at-least-once and exactly-once processing, and out-of-order processing drive decisions that need to be made inside the streaming application and by data producers and consumers.
This presentation discusses some useful design patterns for streaming applications that help deliver great value and an exceptional digital personalization experience to our customers, with personalized responses for Capital One's Eno chatbot as an example.
ABOUT THE SPEAKER:
Andreas Markmann is Manager of Data Engineering at Capital One and tech lead for the Potomac Clickstream project, where he works with engineers and partner teams to democratize strongly scaling data efficiently for the benefit of customer experience.
Before joining Capital One, he created efficient parallel classical and quantum dynamics algorithms for the simulation of laser-molecule and nuclear fusion reactions. He has a PhD in Theoretical Physics from University College London and an MSc in Pure Mathematics from Queen Mary and Westfield College London.
He financed his undergraduate degree improving his English as a sightseeing tour guide in Berlin, Germany and volunteered as a rock climbing, swimming, and programming coach for underserved communities.
ABOUT DATA COUNCIL:
Data Council (www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.
FOLLOW DATA COUNCIL:
Twitter: / datacouncilai
LinkedIn: / datacouncil-ai
Facebook: / datacouncilai
Eventbrite: www.eventbrite.com/o/data-cou...

КОМЕНТАРІ: 1
@AparneshGaurav
@AparneshGaurav 3 роки тому
Good content .
Normal vs Smokers !! 😱😱😱
00:12
Tibo InShape
Переглядів 18 млн
Voloshyn - ЗУСИЛЛЯ (прем'єра треку 2024)
06:17
VOLOSHYN
Переглядів 899 тис.
How Netflix Handles Data Streams Up to 8M Events/sec
54:53
Data Council
Переглядів 35 тис.
Martin Kleppmann - Event Sourcing and Stream Processing at Scale
51:34
Domain-Driven Design Europe
Переглядів 52 тис.
Scalable and Reliable Logging at Pinterest (DataEngConf SF16)
56:52
Data Council
Переглядів 31 тис.
Stream Processing System Design Architecture
11:24
ByteMonk
Переглядів 3,9 тис.
Processing Streaming Data with KSQL - Tim Berglund
48:59
Devoxx
Переглядів 55 тис.
System Design: Why is Kafka fast?
5:02
ByteByteGo
Переглядів 1 млн
APPLE УБИЛА ЕГО - iMac 27 5K
19:34
ЗЕ МАККЕРС
Переглядів 82 тис.
Компьютерная мышь за 50 рублей
0:28
dizzi
Переглядів 2,2 млн