Data Architecture 101 for Your Business

Get the slides: www.datacouncil.ai/talks/data...
ABOUT THE TALK
Setting up your data architecture can be tricky and confusing without knowing what the future holds for your company’s growth. Some might have attempted to sell you out of the shelf solutions or you could have been overwhelmed by hearing about unlimited different technologies, concepts, big data engines that are scalable without a limit... Right? Or just go with Google Analytics since your marketing team is already keen on that? Do you have a hunch of what you should use?
I have worked and built multiple data architectures for companies with different sizes from only few thousands to billions of active users; and used all modern technologies such as Azure SQL Data Warehouse, Redshift, Presto, Hive, Spark, Airflow, Kinesis Data Firehose. From my experiences at Facebook and Microsoft, I know how these tools can be used efficiently and what are the best practices of the industry.
In this talk I will guide you what solutions are available for all company sizes, when is the right time to add or replace architecture elements for better scaling and/or better engineering. What are the caveats and deep technical tricks to get the most out of these tools. Moreover, I will answer how to avoid building or setting up overcomplicated systems, and when should you hire data scientists or data engineers.
ABOUT THE SPEAKER
Bence Faludi is passionate about building data architectures and making reusable datasets that can help businesses to grow and understand their audiences. He likes simplicity, and elegant but flexible solutions for all problems.
He works as an independent consultant for various clients simultaneously to set up their Big Data platform. Nowadays, he is helping Wowcher to optimize their data processing.
Bence has worked at Facebook, Microsoft, Wunderlist as a Data Engineer; published a few open source libraries such as mETL, night-shift; and worked for a few months as a consultant for eyeo - the company behind Adblock Plus.
ABOUT DATA COUNCIL:
Data Council (www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.
FOLLOW DATA COUNCIL:
Twitter: / datacouncilai
LinkedIn: / datacouncil-ai
Facebook: / datacouncilai
Eventbrite: www.eventbrite.com/o/data-cou...

[@tomknight]

Not sure you guys know what 101 means

[@tarunaditya4151]

you are a part of MSFT ops but completely use AWS ? isnt there a conflict ?

[@JoHeN1990]

Tarun Aditya the microsoft ops is the conference place

[@kenigiri]

I think those lines are becoming thinner and thinner these days

[@AlexM006]

This talk has nothing to do with data architecture. I doubt the speaker knows his stuff. Total waste of time!