Data management within data mesh framework
Abstract
Organisations are facing challenges with data management as traditional solutions struggle to handle the complexity and volume of data. Three key stakeholders are involved: data producers who create data, data consumers who rely on its quality and data teams tasked with maintaining it. Generally, there are more producers and consumers than data teams, leading to strain on the data teams when issues arise. Often, data producers feel responsible for the data, making it harder to address quality problems that affect consumers. A new approach known as data mesh aims to improve this situation by emphasising decentralisation and domain-driven design. In a data mesh, responsibility for data is distributed among domain teams, not centralised in a single team. These teams are accountable for delivering high-quality data to others, treating it like a product. Additionally, a self-serve data infrastructure platform is proposed to support these teams by offering necessary tools and systems. The scalability, improved collaboration and agility offered by the data mesh paradigm, may contribute largely to the success of projects and programmes within an organisation. This article is also included in The Business & Management Collection which can be accessed at https://hstalks.com/business/.
The full article is available to subscribers to the journal.
Author's Biography
Rajib Chakravorty is a results-driven and confident Senior Data Management/Strategy Leader with 32 years of effective delivery in business to consumer (B2C), business to business (B2B), technology, banking and financial services. He is a practitioner and Foundation-certified Agile PM with a collaborative transformational IT leadership style. He has successfully engaged with C-level/Board and third-party stakeholders via excellent communication, networking and client relationship management. Rajib’s business leadership skills include inspiring global data strategy and IT development teams to accomplish aspirational goals and create technology-enabled business transformation. He has extensive experience in data management, data strategy and solution design, having worked with HSBC, Lloyds, RBS, Temenos, Oracle and Teradata. His key skills include executive IT leadership, global programme and project portfolio management, enterprise architecture and business intelligence (BI), business transformation and change management, strategic data management, governance and quality, requirements gathering and functional specifications, data warehouse design and implementation, data lineage, mapping, modelling and migration, solution architecture and application development for various sectors. As a Senior Data Modeller at Beazley Insurance, Rajib translated business demands into scalable data models and engaged users. In his previous role as Schroders’ Lead Solution Data Architect, he collaborated with business stakeholders and aligned solution data architecture with corporate data strategy to solve data problems. Rajib has managed change management, data management strategies, digital transformation, data storage and security and compliance at FCA, HSBC, Lloyds and RBS. He has a BTech in chemical engineering from the Indian Institute of Technology, Kharagpur, and a PGDM (MBA) in financial management from Indian Institute of Management Lucknow.
