It’s a day before your company’s quarterly business review and you receive an urgent email from the e-commerce team – the website sales numbers are unusually impressive. That sets off alarm bells for you as a data engineer. You know that when something seems too good to be true, it probably is. After doing some…
In large organizations across all domains, the importance of data is the one constant. Data drives decision-making and generates critical operational insights across organizations. Having access to powerful search & discovery tools helps catalyze the impact that data can have on an organization. DataHub integrates many different data sources together to form the ultimate search…
DataHub aims to empower users to discover, trust and take action on data in their organizations. Understanding where a data product comes from and how it is being used is critical for these goals. To give these insights to data professionals, we built the DataHub Lineage Explorer. DataHub Lineage Explorer This means DataHub can trace the…
Introduction This is the second post covering monthly project updates for the open-source metadata platform, LinkedIn DataHub . This post captures the developments for the month of March in 2021. To read the February 2021 edition, go here . Since everyone is observing Spring festivities, we also have an Easter egg included in this post. Read all the way to the…
Background LinkedIn DataHub is an open-source metadata platform that I founded and architected at LinkedIn and is in wide use at many companies. We hold monthly town-hall meetings to share new developments, hear from the community about their adoption journeys and plan together for the future. I’m starting a journal to “catalog” the evolution of the project for…
