![Flink Forward](/img/default-banner.jpg)
- Видео 549
- Просмотров 752 076
Flink Forward
Добавлен 26 мар 2015
Apache Flink® is a powerful and easy-to-use open-source system for data stream processing with a very active developer and user community, one of the most active big data projects in the Apache Software Foundation. Visit the Apache Flink website for more information: flink.apache.org/
Flink Forward is the conference for Apache Flink and the stream processing communities. Join core Flink committers, new and experienced users, and thought leaders to share experiences and best practices in stream processing, real-time analytics, event-driven applications, and managing mission-critical Flink deployments in production.
Be sure to check out www.flink-forward.org
Flink Forward is the conference for Apache Flink and the stream processing communities. Join core Flink committers, new and experienced users, and thought leaders to share experiences and best practices in stream processing, real-time analytics, event-driven applications, and managing mission-critical Flink deployments in production.
Be sure to check out www.flink-forward.org
Join Ververica at Flink Forward Berlin 2024!
Ververica is proud to be the organizers of global Flink Forward conferences, including the upcoming Flink Forward Berlin 2024!
Alex Walden, @ververica CEO, shares his thoughts about the 10 year anniversary of Apache Flink and what's in store for the streaming data community at Flink Forward this year.
Are you ready for expert Flink training, 2 days of speaker sessions, panels led by thought leaders, networking and celebration? Don't miss Flink Forward Berlin 2024 October 21-24th!
Register here: www.flink-forward.org/
Alex Walden, @ververica CEO, shares his thoughts about the 10 year anniversary of Apache Flink and what's in store for the streaming data community at Flink Forward this year.
Are you ready for expert Flink training, 2 days of speaker sessions, panels led by thought leaders, networking and celebration? Don't miss Flink Forward Berlin 2024 October 21-24th!
Register here: www.flink-forward.org/
Просмотров: 95
Видео
Interview with Gunnar Morling, Flink Forward Berlin Program Committee Member
Просмотров 1143 месяца назад
Join Kaye and Gunnar Morling, Senior Staff Software Engineer at Decodable and one of this year’s Program Committee Members for Flink Forward Berlin 2024! Call for Papers is open until 30 May Tune in to this insightful discussion to get to know Gunnar! Understand from one of the Call for Presentations (CFP) reviewers themselves the tips and tricks for submitting a great talk! Do you have a data ...
Interview with Giannis Polyzos, Flink Forward Berlin Program Committee Member
Просмотров 1373 месяца назад
Description: Join Kaye and Giannis in a discussion about streaming technologies and the upcoming Flink Forward conference. Giannis shares his journey with Kafka, Pulsar, and Spark, expressing excitement for Apache Flink. As a program committee member, Giannis discusses key themes for Flink Forward, from unified streaming to architectures empowered by Flink. Discover challenges in modernizing da...
Interview with Xintong Song, Flink Forward Berlin Program Committee Member
Просмотров 1244 месяца назад
Description: Recently, Ververica sat down with Xintong Song, a Flink Forward Berlin Program Committee Member, to discuss why Flink Forward is a special event for the Apache Flink® community, and get his tips on how to submit a winning talk to join the stage in Berlin. Hear first hand what he thinks the major talk trends will be, and get hints about the types of talks the Program Committee is lo...
Use Cases Breakout Track Sessions - Flink Forward 2023
Просмотров 1264 месяца назад
The Apache Flink® Conference returns to Berlin, Germany 21 - 24 October 2024 Ververica is proud to celebrate Apache Flink's 10-year anniversary - right back to the heart of where it all started - Berlin! To celebrate our 10-year anniversary, we’re bringing you a very special program this year - 2 days of training, followed by 2 days of conference. Learn more about Flink Forward: www.flink-forwa...
Technology Breakout Track Sessions - Flink Forward 2023
Просмотров 744 месяца назад
The Apache Flink® Conference returns to Berlin, Germany 21 - 24 October 2024 Ververica is proud to celebrate Apache Flink's 10-year anniversary - right back to the heart of where it all started - Berlin! To celebrate our 10-year anniversary, we’re bringing you a very special program this year - 2 days of training, followed by 2 days of conference. Learn more about Flink Forward: www.flink-forwa...
Operations Breakout Track Sessions - Flink Forward 2023
Просмотров 624 месяца назад
The Apache Flink® Conference returns to Berlin, Germany 21 - 24 October 2024 Ververica is proud to celebrate Apache Flink's 10-year anniversary - right back to the heart of where it all started - Berlin! To celebrate our 10-year anniversary, we’re bringing you a very special program this year - 2 days of training, followed by 2 days of conference. Learn more about Flink Forward: www.flink-forwa...
Industry Breakout Track Sessions - Flink Forward 2023
Просмотров 664 месяца назад
The Apache Flink® Conference returns to Berlin, Germany 21 - 24 October 2024 Ververica is proud to celebrate Apache Flink's 10-year anniversary - right back to the heart of where it all started - Berlin! To celebrate our 10-year anniversary, we’re bringing you a very special program this year - 2 days of training, followed by 2 days of conference. Learn more about Flink Forward: www.flink-forwa...
Ecosystem Breakout Track Sessions - Flink Forward 2023
Просмотров 464 месяца назад
The Apache Flink® Conference returns to Berlin, Germany 21 - 24 October 2024 Ververica is proud to celebrate Apache Flink's 10-year anniversary - right back to the heart of where it all started - Berlin! To celebrate our 10-year anniversary, we’re bringing you a very special program this year - 2 days of training, followed by 2 days of conference. Learn more about Flink Forward: www.flink-forwa...
Highlights of Flink Forward Seattle 2023
Просмотров 4766 месяцев назад
Ververica is proud to host Flink Forward! Check out all the highlights from Flink Forward Seattle 2023. Hear what featured attendees from Evoura, Apple, and LinkedIn have to say about their key takeaways from the conference. Want more? Catch up on all the recordings from Flink Forward Seattle 2023, free on-demand at Ververica Academy: www.ververica.academy/app/videos Curious about Sponsoring fu...
Keynote: Quo Vadis Stream Processing? Dude, where is this streaming to?
Просмотров 3176 месяцев назад
Keynote: Quo Vadis Stream Processing? Dude, where is this streaming to? Hear from Ververica CEO Alex Walden, as he dives into the past and future state of Apache Flink® and introduces Ververica Cloud, a fully managed Flink-as-a-Service offering. Ready for a fully managed, cloud-native service that easily runs your Apache Flink® applications? Try Ververica Cloud for FREE. www.ververica.com/cloud...
Keynote: Flink Unveiled - Journeying from DataStream to Streamhouse
Просмотров 7506 месяцев назад
Keynote: Flink Unveiled - Journeying from DataStream to Streamhouse In this presentation, Jing Ge, Head of Engineering at Ververica and Apache Flink® Committer, announces Streamhouse. Learn how Streamhouse significantly improves latency and allows for flexibility and real-time streaming while minimizing the costs usually associated with real-time streaming. Learn more about Streamhouse on the V...
Keynote: The Vision and Practice of Stream and Batch Unification - LinkedIn's Story
Просмотров 6296 месяцев назад
Keynote: The Vision and Practice of Stream and Batch Unification - LinkedIn's Story Becket Qin, Apache Flink® and Apache Kafka PMC Member and Streams Infrastructure at LinkedIn shares why LinkedIn chose Flink to handle their batch and streaming unification project. Read more about how organizations use Apache Flink® and Ververica Platform for their stream processing needs. www.ververica.com/use...
Keynote: Riding the Streams: Powering Stream Processing at Cash App with Ververica
Просмотров 4326 месяцев назад
Keynote: Riding the Streams: Powering Stream Processing at Cash App with Ververica In this keynote co-presented by Rashmi Shamsundar and Karel Alfonso Sague (both Software Engineers at Block,) learn why Block chose Ververica to help power their stream processing for CashApp, a mobile payment service that allows users to transfer money with one another on a mobile app. Read more about how organi...
Sponsor Session: Stream Processing in AWS by Example
Просмотров 1336 месяцев назад
Sponsor Session: Stream Processing in AWS by Example Representing Amazon Web Services, a Platinum Sponsor of Flink Forward Seattle 2023, watch Todd McGrath, Principal Streaming Solution Architect present a practical demonstration showcasing real-time stream processing in AWS using Apache Flink®, Apache Kafka®, Amazon Aurora, and Debezium in: “Stream Processing in AWS by Example”. Experience fir...
Sponsor Session: Real-Time Marketing Segmentation and Product Journey Computation at Business Scale
Просмотров 886 месяцев назад
Sponsor Session: Real-Time Marketing Segmentation and Product Journey Computation at Business Scale
Sponsor Session: Building an Integrated Data Streaming Platform with Pulsar and Flink Operations
Просмотров 896 месяцев назад
Sponsor Session: Building an Integrated Data Streaming Platform with Pulsar and Flink Operations
Flink Forward San Francisco 2022 - Highlight reel
Просмотров 1,8 тыс.Год назад
Flink Forward San Francisco 2022 - Highlight reel
Flink Forward SF 2022 Keynote: One SQL, Unified Analytics
Просмотров 1,3 тыс.2 года назад
Flink Forward SF 2022 Keynote: One SQL, Unified Analytics
Flink Forward SF 2022: Keynote: Apache Flink as a security data processing engine at Booking.com
Просмотров 9362 года назад
Flink Forward SF 2022: Keynote: Apache Flink as a security data processing engine at Booking.com
Flink Forward San Francisco August 2022
Просмотров 1,8 тыс.2 года назад
Flink Forward San Francisco August 2022
SPONSORED Interactive Session: AMA | Pulsar and Flink for Unified Data Processing
Просмотров 4272 года назад
SPONSORED Interactive Session: AMA | Pulsar and Flink for Unified Data Processing
SPONSORED Interactive Session: Beam and Beam on Flink general roadmap discussion and AMA
Просмотров 2612 года назад
SPONSORED Interactive Session: Beam and Beam on Flink general roadmap discussion and AMA
SPONSORED Interactive Session: Optimising data streaming pipelines on Flink and Kafka
Просмотров 6492 года назад
SPONSORED Interactive Session: Optimising data streaming pipelines on Flink and Kafka
SPONSORED Interactive Session: Running Flink SQL jobs in production
Просмотров 5202 года назад
SPONSORED Interactive Session: Running Flink SQL jobs in production
SPONSORED Session: From concept to production; the fastest way to develop & deploy Apache Flink jobs
Просмотров 1 тыс.2 года назад
SPONSORED Session: From concept to production; the fastest way to develop & deploy Apache Flink jobs
SPONSORED Interactive Session: Flink on Autopilot with Splunk
Просмотров 4882 года назад
SPONSORED Interactive Session: Flink on Autopilot with Splunk
Birds of a Feather Session - Stateful Functions
Просмотров 4382 года назад
Birds of a Feather Session - Stateful Functions
KEYNOTE | Expert Panel: Current & Future State of the Art in Real-Time Data Infrastructure
Просмотров 1,1 тыс.2 года назад
KEYNOTE | Expert Panel: Current & Future State of the Art in Real-Time Data Infrastructure
Storing State Forever: Why It Can Be Good For Your Analytics
Просмотров 2,8 тыс.2 года назад
Storing State Forever: Why It Can Be Good For Your Analytics
Great insights
the accent!!!!!!!!!!!!
I am confused. How is this different from Kafka Streams and KTable?
If you have multiple fraud-counter http servers or multiple merchant-scorer http servers running (for high-availability), does the storage synced across those servers? If so, how does the syncing works?
The question about partial deserializing wasn't bad. Interesting.
where can I find the link of demo at the description? @8:38
Very prescient talk
I'll build on this
Good talk but the audio is not that great.
no wonder 781 people watched this in last 3 years....
Very useful introduction of Apache Flink. I was able to test Flink features using Google Colab.
Hi, is there a way to improve the subtitles ? It's very hard to understand the audio and subtitles don't help at all.
What's the disadvantage of solving this problem with Kafka stream?
운전점수 확인 정말 유용하게 사용 중인데 엄청난 기술력이 있었네요.
cool
Please an update of pyflink processing kafka topics
Hi, that's really interesting! I have 2 questions: How do you handle race conditions? In the example, if the counter and merchant functons respond at the same time, they could both think they're the first to answer and we end up with both in cache but not sent to the model, or does the context run one message at a time guarantied, like in Akka? How do you handle resilience? THe 30 days delay on a message is a great feature made simple here, but let say the app dies, and is rebooted, is it going to be lost? Is there a sync to something like S3 for the state?
I guess from 30:00 onwards Flink have addressed this with HybridSource? Havent used it yet but seen a few talks on it
The second guy is brilliant
Noice.
Thank you for sharing the video. However, it seems that Flink is not performing well in terms of application upgrade. For instance, if we have a lambda that consumes Kinesis stream, a lambda update won't result in any downtime or duplicate records and everything will be handled smoothly. On the other hand, Flink application requires us to handle several aspects such as save point, checkpoint, blue-green deployment, dual stack, and duplicate data on our own. Even Amazon Managed Flink and KDA may experience downtime during application upgrade. I am optimistic that Flink can do better than current one
This is amazing, we have a similar usecase in our company and i was confused between feast, sagemaker. I was also worried about explaining the infrastructure requirements to PMs, managers if we chose Feast. This has simplified the whole setup and ideal usecases for small startups.
Hello, thank you for the video
Whether there is need to install RocksDB in kubernates cluster or just adding state.backend: rocksdb ... these line in conf/flink_conf.yaml is enough?
Hi, thanks for course. I have a question about first demo, there is no output when "table.limit(10).execute().print()" code runned. Have you got any iade about this problem ?
Great Presentation!! Neatly sequenced with how the problems were conquered and the way forward.
What kind of join do you propose between 2 streams if there are more than 1 key possible. For the example you explained suppose one needs to join 2 streams, order and sale, either on sale_id or userid.
Great video! Thanks
Can you please create a sample project on this..
How does Flink CEP Manages it state? We take patterns in real time.... but flink does not removes pattern from state whose window time is over?.. is there any solution
0.75x speed should be a lot better
This is just a brilliant piece of information!
How does unordered input cause checkpoint failure. Can you please elaborate on the use case which caused this failure. My understanding is that even if you add allowed lateness to consider unordered event, even then checkpoint will keep happening to store current state.
does anyone know where I can find the state management processes that TableAPI uses, I understand that is under the hood and is being done automatically, but was hoping to understand further how it does so, such that I could use it in my own project.
How does the flink application in blue environment catch-up with the lag introduced due to re-deployment ?
Thank you for the video. A quick honest feedback. Presentation is disorienting. I would like to hear it like: * What Flink is * Who uses it? why? (not generic, specific) * What you are introducing in this video, (story, expectation) * Demo * show requirements * show the solution * show what's implemented * explain what you do the things you do * Conclude * What if you don't use flink (flink vs hard way to do it)
agreed. this is very poor compared to confluent kafka tutorials.
Very useful and there is not such less learned content about Flink implementation sharing. Wandering about the new version of Flink will resolve any of those issues yet ?
only keep last 2 checkpoints . Is is configurable for incremental checkpoint ??
It feels not correct that the optionally scaling apply to any of the "Aggregation" and "Windowed Retention" as the state size is promotional to the number of keys which may varies depending on the input. If we say the group-by keys space are finite and we have an estimate for that, then it can fit in optionally scaling.
I installed flink but can not access the UI.
great talk
Hello, this is excellent video. Very helpful. I have e requirements to insert data into Parent and Child table, can you please suggest or share a reference o how to do this?
Flink Forward is becoming my favourite conference of all. To the point, tech stuff and no jargon’s. Thank you Brent for all the valuable points.
This was really informative, appreciate the troubleshooting scenarios. Cheers David!
would love for this to be open sourced. Flink (and hudi) seem to be adopted by large companies, but public documentation and tooling is lacking
Realy good!
Far too much info about their company and not enough about Flink :(
where can I find the demos that you mentioned Olena doing?
Unclear why it was not stated... but this is basically the KappaPlus Architecture.