Very nice work on outline of the framework... I don't see a lot of people going into these details of what is needed to move from the traditional EDW frameworks. It seems with the stats you have created your own dataframes... not that you will ever see this comment but any thoughts on using the spark DF/DS models? I would assume the limitations are not enough to enjoy the positive aspects like tungsten / pipelining... just going from the nature of your data.
Very nice work on outline of the framework... I don't see a lot of people going into these details of what is needed to move from the traditional EDW frameworks. It seems with the stats you have created your own dataframes... not that you will ever see this comment but any thoughts on using the spark DF/DS models? I would assume the limitations are not enough to enjoy the positive aspects like tungsten / pipelining... just going from the nature of your data.
Real presentation .