Modern Data Estate
What does it actually mean?
I find it useful to start by thinking through definitions describing, hopefully in plain english, a given concept (otherwise, it may simply be viewed as yet another industry buzzword). So, here’s what came to [my] mind:
Modern Data Estate is the infrastructure that enables an organization to systematically collect, manage, process, analyze, and consume data in near real time.
The “Modern” part, while doesn’t have to equal “Cloud”, often does. Cloud vendors provide integrated platforms that partly abstract complexity; support capacity, performance, and scalability requirements; and generally deliver on a promise of cloud computing’s consumption based model with its economies of scale.
One platform to rule them all? Probably not, but convergence is underway and data silos are under siege.
Important Observations
I’ve been reading on and pondering the subject of Modern Data Estate for a while when I came across this short, but insightful article — “Forget databases. You need a data platform”. I definitely agree with the observation of the trend towards mutualistic symbiosis of the following categories of systems that often hold the bulk of organizations’ business related data:
- Systems of Record
- Systems of Engagement
- Systems of Insight
So, the Data Platform needs to accommodate for the eventual convergence.
Another great observation is that with increased frequency it’s machines that are processing and analyzing the deluge of data, asking initial questions before getting human operators involved in reasoning and decision making.
So, the Data Platform needs to support these [machine + human] use cases.
Back to Basics
One additional point that I would like to make is that to ensure lasting success all of this convergence and Big Data flows need to be safeguarded by a strong Governance, Risk, and Compliance (GRC) program and supported by an overall Enterprise Architecture (EA).
And don’t forget that Data has Gravity 💫🙂
Peopleware
And finally, when breaking down the walls and dismantling the silos remember — it is more about People (i.e. culture) than Technology! Modernize your Data Estate, but don’t forget about your people! Remember the “People, Process, Technology” mantra and repeat it often (and you might want to add Policy to the mix):
“If you want to go fast, go alone; but if you want to go far, go together.”
References
- Planet Technologies, “Modernizing the Data Estate with Microsoft’s Enterprise Data Strategy” by Miguel Wood, https://go-planet.com/perspectives-blog/modernizing-the-data-estate-with-microsofts-enterprise-data-strategy/
- InfoWorld, “Forget databases. You need a data platform” by Matt Asay, https://www.infoworld.com/article/3611403/forget-databases-you-need-a-data-platform.html
- “Peopleware: Productive Projects and Teams” by Tom DeMarco and Tim Lister
- Microsoft, “Modern Data Warehouse Architecture”, https://docs.microsoft.com/en-us/azure/architecture/solution-ideas/articles/modern-data-warehouse
- Microsoft Learn — Data Analyst/Engineer/Scientist