From ee733e257e1379e38a80704aee4025a4a3a5509b Mon Sep 17 00:00:00 2001 From: Shirshanka Das Date: Wed, 31 Mar 2021 08:48:24 -0700 Subject: [PATCH] docs: Update next townhall details, fixup links and misc docs (#2321) --- README.md | 32 +++++++----------- docs/faq.md | 28 +++------------- docs/townhall-history.md | 23 +++++++++++-- docs/townhalls.md | 72 +++------------------------------------- 4 files changed, 42 insertions(+), 113 deletions(-) diff --git a/README.md b/README.md index 16a5be1b0609b..175565ed48fd5 100644 --- a/README.md +++ b/README.md @@ -51,14 +51,15 @@ HOSTED_DOCS_ONLY--> --- -> 📣 Next DataHub town hall meeting on Mar 19th, 7am-8am PDT ([convert to your local time](https://greenwichmeantime.com/time/to/pacific-local/)) +> 📣 Next DataHub town hall meeting on Apr 23rd, 9am-10am PDT ([convert to your local time](https://greenwichmeantime.com/time/to/pacific-local/)) > - Topic Proposals: [submit here](https://docs.google.com/forms/d/1v2ynbAXjJlqY97xE_X1DAntNrXDznOFiNfryUkMPtkI/) > - Signup to get a calendar invite: [here](https://docs.google.com/forms/d/1r9bObXKS3tgKpISqqO3rw4yQog5zwuaFxg8IrJGUbvQ/) -> - VC link: https://linkedin.zoom.us/j/4698262890 +> - Town-hall Zoom link: [zoom.datahubproject.io](https://zoom.datahubproject.io) > - [Meeting details](docs/townhalls.md) & [past recordings](docs/townhall-history.md) > ✨ Latest Update: -> - Monthly project update: [Feb 2021 Edition](https://medium.com/datahub-project/linkedin-datahub-project-updates-february-2021-edition-338d2c6021f0). +> - Monthly project update: [Mar 2021 Edition](https://medium.com/datahub-project/linkedin-datahub-project-updates-697f0faddd10?source=friends_link&sk=9888633c5c7219b875125e87a703ec4d). +> - Unleashing Excellent DataOps with LinkedIn DataHub: [DataOps Unleashed Talk](https://www.youtube.com/watch?v=ccsIKK9nVxk). > - Latest blog post [DataHub: Popular Metadata Architectures Explained](https://engineering.linkedin.com/blog/2020/datahub-popular-metadata-architectures-explained) @ LinkedIn Engineering Blog. > - We've released v0.7.0. You can find release notes [here](https://github.com/linkedin/datahub/releases/tag/v0.7.0) > - We're on [Slack](docs/slack.md) now! Ask questions and keep up with the latest announcements. @@ -85,17 +86,6 @@ There's a [hosted demo environment](https://datahubproject.io/docs/demo) where y ## Documentation We have documentation available at [https://datahubproject.io/docs/](https://datahubproject.io/docs/). -* [DataHub Developer's Guide](docs/developers.md) -* [DataHub Architecture](docs/architecture/architecture.md) -* [DataHub Onboarding Guide](docs/how/entity-onboarding.md) -* [Docker Images](docker/README.md) -* [Frontend](datahub-frontend/README.md) -* Older [Ember Web App](datahub-web) -* New [React Web App](datahub-web-react/README.md) (incubating) -* [Generalized Metadata Service](gms/README.md) -* Metadata Ingestion with [Python](metadata-ingestion/README.md) (recommended) or [Java](metadata-ingestion-examples) -* [Metadata Processing Jobs](metadata-jobs) - ## Releases See [Releases](https://github.com/linkedin/datahub/releases) page for more details. We follow the [SemVer Specification](https://semver.org) when versioning the releases and adopt the [Keep a Changelog convention](https://keepachangelog.com/) for the changelog format. @@ -115,20 +105,25 @@ Join our [slack workspace](http://slack.datahubproject.io) for discussions and i Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it. * [Expedia Group](http://expedia.com) * [Experius](https://www.experius.nl) +* [Geotab](https://www.geotab.com) * [Grofers](https://grofers.com) +* [Klarna](https://www.klarna.com) * [LinkedIn](http://linkedin.com) * [Saxo Bank](https://www.home.saxo) * [Shanghai HuaRui Bank](https://www.shrbank.com) +* [ThoughtWorks](https://www.thoughtworks.com) * [TypeForm](http://typeform.com) -* [Valassis]( https://www.valassis.com) +* [Viasat](https://viasat.com) +* [Wolt](https://wolt.com) + Here is a list of companies that are currently building POC or seriously evaluating DataHub. * [Amadeus](https://www.amadeus.com) * [Bizzy Group](https://www.bizzy.co.id) * [Booking.com](https://www.booking.com) +* [City of New York, DoITT](https://www1.nyc.gov/site/doitt/index.page) * [Experian](https://www.experian.com) * [FlixBus](https://www.flixbus.com) -* [Geotab](https://www.geotab.com) * [Kindred Group](https://www.kindredgroup.com) * [Instructure](https://www.instructure.com) * [Inventec](https://www.inventec.com) @@ -138,17 +133,15 @@ Here is a list of companies that are currently building POC or seriously evaluat * [REEF Technology](https://reeftechnology.com) * [SpotHero](https://spothero.com) * [Sysco AS](https://sysco.no) -* [ThoughtWorks](https://www.thoughtworks.com) * [University of Phoenix](https://www.phoenix.edu) * [Vectice](https://www.vectice.com) -* [Viasat](https://viasat.com) -* [Wolt](https://wolt.com) * [Weee!](https://www.sayweee.com) ## Select Articles & Talks * [DataHub: A Generalized Metadata Search & Discovery Tool](https://engineering.linkedin.com/blog/2019/data-hub) * [DataHub: Popular Metadata Architectures Explained](https://engineering.linkedin.com/blog/2020/datahub-popular-metadata-architectures-explained) * [Open sourcing DataHub: LinkedIn’s metadata search and discovery platform](https://engineering.linkedin.com/blog/2020/open-sourcing-datahub--linkedins-metadata-search-and-discovery-p) +* [Driving DataOps Culture with LinkedIn DataHub](https://www.youtube.com/watch?v=ccsIKK9nVxk) @ [DataOps Unleashed 2021](https://dataopsunleashed.com/#shirshanka-session) * [DataHub: Powering LinkedIn's Metadata](docs/demo/DataHub_-_Powering_LinkedIn_Metadata.pdf) @ [Budapest Data Forum 2020](https://budapestdata.hu/2020/en/) * [Taming the Data Beast Using DataHub](https://www.youtube.com/watch?v=bo4OhiPro7Y) @ [Data Engineering Melbourne Meetup November 2020](https://www.meetup.com/Data-Engineering-Melbourne/events/kgnvlrybcpbjc/) * [Metadata Management And Integration At LinkedIn With DataHub](https://www.dataengineeringpodcast.com/datahub-metadata-management-episode-147/) @ [Data Engineering Podcast](https://www.dataengineeringpodcast.com) @@ -159,7 +152,6 @@ Here is a list of companies that are currently building POC or seriously evaluat * [Data Discoverability at SpotHero](https://www.slideshare.net/MaggieHays/data-discoverability-at-spothero) * [Data Catalogue — Knowing your data](https://medium.com/albert-franzi/data-catalogue-knowing-your-data-15f7d0724900) * [LinkedIn DataHub Application Architecture Quick Understanding](https://medium.com/@liangjunjiang/linkedin-datahub-application-architecture-quick-understanding-a5b7868ee205) -* [LinkIn Datahub Metadata Ingestion Scripts Unofficical Guide](https://medium.com/@liangjunjiang/linkin-datahub-etl-unofficical-guide-7c3949483f8b) * [A Dive Into Metadata Hubs](https://www.holistics.io/blog/a-dive-into-metadata-hubs/) * [25 Hot New Data Tools and What They DON’T Do](https://blog.amplifypartners.com/25-hot-new-data-tools-and-what-they-dont-do/) * [Emerging Architectures for Modern Data Infrastructure](https://a16z.com/2020/10/15/the-emerging-architectures-for-modern-data-infrastructure/) diff --git a/docs/faq.md b/docs/faq.md index 1f53c0644bcd9..b376c513ed50f 100644 --- a/docs/faq.md +++ b/docs/faq.md @@ -16,39 +16,21 @@ DataHub can be right for you if you want an open source unbundled solution (fron Currently LinkedIn engineers. However, we’re receiving more and more PRs from individuals working at various companies. ## How big is the community? -External parties who deploy / are actively evaluating DataHub: -- [City of New York, DoITT](https://www1.nyc.gov/site/doitt/index.page) -- [Experian](https://www.experian.com/) -- [Geotab](https://www.geotab.com/) -- [Instructure](https://www.instructure.com/) -- [Intuit](https://www.intuit.com/) -- [Itaú Unibanco](https://www.itau.com/) -- [LavaMap](https://lavamap.com/) -- [Microsoft](https://www.microsoft.com/) -- [Morgan Stanley](https://www.morganstanley.com/) -- [Paypal](https://www.paypal.com/) -- [Prophecy.io](https://prophecy.io/) -- [SAXO Bank](https://www.home.saxo/) -- [Sysco AS](https://sysco.no/) -- [Tenable](https://www.tenable.com/) -- [Thoughtworks](https://www.thoughtworks.com/) -- [TypeForm](https://www.typeform.com/) -- [Valassis](https://www.valassis.com/) -- [Vrbo (Expedia Group)](https://www.vrbo.com/) +Check out our adoption [here](https://datahubproject.io/docs/#adoption) ## Is there a contributor selection criteria? We welcome contributions from everyone in the community. Please read our [contributing guidelines](CONTRIBUTING.md). In general, we will review PRs with the same rigor as our internal code review process to maintain overall quality. -## How does LinkedIn plan to engage with the community? -We plan to organize public town hall meetings at a monthly cadence, which may change depending on the interest from the community. Also we recently deprecated Gitter and start using [Slack](https://datahubspace.slack.com/join/shared_invite/zt-cl60ng6o-6odCh_I~ejZKE~a9GG30PA) as one of the main ways to support the community. +## How does the project engage with the community? +We organize public town hall meetings at a monthly cadence. We use [Slack](https://slack.datahubproject.io) as one of the main ways to support the community. ## Should this be the platform we decide upon, we’d like to fully engage and work with LinkedIn and the community. What’s the best way and what level of engagement/involvement should we expect? -The best way to engage is through the [Slack channel](https://datahubspace.slack.com/join/shared_invite/zt-cl60ng6o-6odCh_I~ejZKE~a9GG30PA). You’ll get to interact with the developers and the community. We are fairly response on Slack and plan to setup proper oncall support during normal business hours (Pacific Time). Sometimes we also create working groups with dedicated POC from the LinkedIn team to tackle specific use cases the community has. +The best way to engage is through the [Slack channel](https://slack.datahubproject.io). You’ll get to interact with the developers and the community. It is a vibrant community and most questions are answered within a few hours by the community. For reproducible technical issues, bugs and code contributions, Github [issues](https://github.com/linkedin/datahub/issues) and [PRs](https://github.com/linkedin/datahub/pulls) are the preferred channel. ## What’s the best way to ramp up the product knowledge to properly test and evaluate DataHub? -[Github](https://github.com/linkedin/datahub) is the best resource. We have documented the steps to install and test DataHub thoroughly there. There is also copious of document on [overall architecture](./architecture), [definitions](./what), and [onboarding guides](./how). +[The docs](https://datahubproject.io/docs) are the best resource. We have documented the steps to install and test DataHub thoroughly there. The [DataHub Introduction](https://engineering.linkedin.com/blog/2019/data-hub) and [Open Sourcing Datahub](https://engineering.linkedin.com/blog/2020/open-sourcing-datahub--linkedins-metadata-search-and-discovery-p) blog posts are also useful resources for getting a high level understanding of the system. diff --git a/docs/townhall-history.md b/docs/townhall-history.md index c103d14b9dbdd..df4f57b3c5436 100644 --- a/docs/townhall-history.md +++ b/docs/townhall-history.md @@ -1,10 +1,29 @@ # Town Hall History A list of previous Town Halls, their planned schedule, and the recording of the meeting. +## 3/19/2021 + [YouTube video](https://www.youtube.com/watch?v=xE8Uc27VTG4) + + [Medium Digest](https://medium.com/datahub-project/linkedin-datahub-project-updates-697f0faddd10?source=friends_link&sk=9888633c5c7219b875125e87a703ec4d) + +### Agenda + +* Welcome - 5 mins +* Project Updates ([slides](https://drive.google.com/file/d/1c3BTP3oDAzJr07l6pY6CkDZi5nT0cLRs/view?usp=sharing)) by [Shirshanka](https://www.linkedin.com/in/shirshankadas/) - 10 mins + * 0.7.0 Release + * Project Roadmap +* Demo Time: Themes and Tags in the React App! by [Gabe Lyons](https://www.linkedin.com/in/gabe-lyons-9a574543/) - 10 mins +* Use-Case: DataHub at [Wolt](https://www.linkedin.com/company/wolt-oy/) ([slides](https://drive.google.com/file/d/1za7NKbnXpFV2bBDblP35CbQEIDwc9tog/view?usp=sharing)) by [Fredrik](https://www.linkedin.com/in/fredriksannholm/?originalSubdomain=fi) and Matti - 15 mins +* Poll Time: Observability Mocks! ([slides](https://drive.google.com/file/d/1Ih2EGf-76jhbNAjr2EsBLb7n8bra2WIz/view?usp=sharing)) - 5 mins +* General Q&A from sign up sheet, slack, and participants - 10 mins +* Closing remarks - 5 mins + ## 2/19/2021 -[Full Recording](https://www.youtube.com/watch?v=Z9ImbcsAVl0) -[Digest](https://medium.com/datahub-project/linkedin-datahub-project-updates-february-2021-edition-338d2c6021f0) + [YouTube video](https://www.youtube.com/watch?v=Z9ImbcsAVl0) + + [Medium Digest](https://medium.com/datahub-project/linkedin-datahub-project-updates-february-2021-edition-338d2c6021f0) +### Agenda * Welcome - 5 mins * Latest React App Demo! ([video](https://www.youtube.com/watch?v=RQBEJhcen5E)) by John Joyce and Gabe Lyons - 5 mins diff --git a/docs/townhalls.md b/docs/townhalls.md index 2df99ac10d6b0..148f6b65ba161 100644 --- a/docs/townhalls.md +++ b/docs/townhalls.md @@ -1,86 +1,22 @@ # DataHub Town Halls We hold regular virtual town hall meetings to meet with DataHub community. -Currently it's held on the third Friday of every month. +Currently it's held on the fourth Friday of every month. It's the perfect venue to meet the team behind DataHub and other users, as well as to ask higher-level questions, such as roadmap and product direction. From time to time we also use the opportunity to showcase upcoming features. -## Coming up - March 19th, 2021 @ 7 AM US Pacific (GMT-7) +## Coming up - April 23rd, 2021 @ 9 AM US Pacific ## Meeting Invite -You can join with this link, or see the full invite below. https://linkedin.zoom.us/j/4698262890 +You can join with this link https://zoom.datahubproject.io, or signup to get a calendar invite. - Topic Proposals: [submit here](https://docs.google.com/forms/d/1v2ynbAXjJlqY97xE_X1DAntNrXDznOFiNfryUkMPtkI/) - Signup to get an invite: [here](https://docs.google.com/forms/d/1r9bObXKS3tgKpISqqO3rw4yQog5zwuaFxg8IrJGUbvQ/) -
- Full Invite - -``` -DataHub is inviting you to a scheduled Zoom meeting. - -Topic: DataHub Town Hall -Time: Mar 19, 2021 07:00 AM Pacific Time (US and Canada) - -Join Zoom Meeting -https://linkedin.zoom.us/j/4698262890 - -Meeting ID: 469 826 2890 -One tap mobile -+16699006833,,4698262890# US (San Jose) -+12532158782,,4698262890# US (Tacoma) - -Dial by your location - +1 669 900 6833 US (San Jose) - +1 253 215 8782 US (Tacoma) - +1 346 248 7799 US (Houston) - +1 301 715 8592 US (Washington D.C) - +1 312 626 6799 US (Chicago) - +1 646 558 8656 US (New York) - 877 853 5247 US Toll-free - 888 788 0099 US Toll-free - 833 548 0276 US Toll-free - 833 548 0282 US Toll-free -Meeting ID: 469 826 2890 -Find your local number: https://linkedin.zoom.us/u/acUYmEapPd - -Join by SIP -4698262890@zoomcrc.com - -Join by H.323 -162.255.37.11 (US West) -162.255.36.11 (US East) -221.122.88.195 (China) -115.114.131.7 (India Mumbai) -115.114.115.7 (India Hyderabad) -213.19.144.110 (Amsterdam Netherlands) -213.244.140.110 (Germany) -103.122.166.55 (Australia) -209.9.211.110 (Hong Kong SAR) -64.211.144.160 (Brazil) -69.174.57.160 (Canada) -207.226.132.110 (Japan) -Meeting ID: 469 826 2890 - -Join by Skype for Business -https://linkedin.zoom.us/skype/4698262890 - -``` - -
- ## Agenda -* Welcome - 5 mins -* Project Updates by [Shirshanka](https://www.linkedin.com/in/shirshankadas/) - 10 mins - * 0.7.0 Release - * Project Roadmap -* Demo Time: Themes and Tags in the React App! by [Gabe Lyons](https://www.linkedin.com/in/gabe-lyons-9a574543/) - 10 mins -* Use-Case: DataHub at [Wolt](https://www.linkedin.com/company/wolt-oy/) by [Fredrik](https://www.linkedin.com/in/fredriksannholm/?originalSubdomain=fi) and Matti - 15 mins -* Poll Time: Observability Mocks! - 5 mins -* General Q&A from sign up sheet, slack, and participants - 10 mins -* Closing remarks - 5 mins +* Stay tuned! ## Past Meetings