{"id":133521,"date":"2024-10-09T16:54:22","date_gmt":"2024-10-09T16:54:22","guid":{"rendered":"https:\/\/showbizztoday.com\/index.php\/2024\/10\/09\/unlocking-insights-with-high-quality-dashboards-at-scale\/"},"modified":"2024-10-09T16:54:22","modified_gmt":"2024-10-09T16:54:22","slug":"unlocking-insights-with-high-quality-dashboards-at-scale","status":"publish","type":"post","link":"https:\/\/showbizztoday.com\/index.php\/2024\/10\/09\/unlocking-insights-with-high-quality-dashboards-at-scale\/","title":{"rendered":"Unlocking Insights with High-Quality Dashboards at Scale"},"content":{"rendered":"<p> [ad_1]<br \/>\n<\/p>\n<div>\n        <!-- post title --><\/p>\n<div class=\"posted-by\">\n            <img decoding=\"async\" src=\"https:\/\/engineering.atspotify.com\/wp-content\/themes\/theme-spotify\/images\/icon.png\" alt=\"\"\/><\/p>\n<p>&#13;<br \/>\n                <span class=\"date\">August 28, 2024<\/span>&#13;<br \/>\n                <span class=\"author\">&#13;<br \/>\n                    Published by Skyler Johnson, Senior Data Scientist                <\/span>&#13;\n            <\/p>\n<\/p><\/div>\n<p>        <!-- post details --><\/p>\n<div class=\"img-holder\">\n            <!-- post thumbnail --><\/p>\n<p>                                                <a href=\"https:\/\/engineering.atspotify.com\/2024\/08\/unlocking-insights-with-high-quality-dashboards-at-scale\/\" title=\"Unlocking Insights with High-Quality Dashboards at Scale\" target=\"_blank\" rel=\"noopener\">&#13;<br \/>\n                        <img src=\"https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/EN221-1200-x-590-black-1.png\" class=\"attachment-post-thumbnail size-post-thumbnail wp-post-image\" alt=\"\" decoding=\"async\" fetchpriority=\"high\" srcset=\"https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/EN221-1200-x-590-black-1.png 1200w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/EN221-1200-x-590-black-1-250x123.png 250w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/EN221-1200-x-590-black-1-700x344.png 700w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/EN221-1200-x-590-black-1-768x378.png 768w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/EN221-1200-x-590-black-1-120x59.png 120w\" sizes=\"(max-width: 1200px) 100vw, 1200px\"\/>                    <\/a><br \/>\n                        <!-- \/post thumbnail -->\n        <\/div>\n<p>        <!-- \/post title --><\/p>\n<p>We have loads of dashboards at Spotify. Our Insight groups and analysts from throughout the corporate are always whipping up new dashboards for stakeholders and themselves, serving to reply these large data-driven questions daily. These dashboards sort out every thing from regularly used key metrics to exploratory insights and operational stories. It\u2019s clear to us: dashboards assist us transfer quicker and keep data-informed.<\/p>\n<p>In 2023, Spotifiers \u2014 largely knowledge scientists and the like \u2014 created greater than 4,900 dashboards in Tableau or Looker Studio. These dashboards have been utilized by greater than 6,000 Spotifiers in 2023. There isn&#8217;t any centralized crew at Spotify solely answerable for creating dashboards, however somewhat a vigorous and free market of dashboards \u2014 with the Analytics Platform crew offering the scaffolding for this market \u2014 consisting of dashboard producers and dashboard customers.<\/p>\n<p>At the center of our knowledge visualization efforts, we lean on two principal instruments to amp up our dashboard sport: Tableau and Google\u2019s Looker Studio. With these in our toolbox, we\u2019ve constructed extra programs and frameworks to maximise our potential to distribute, share, and uncover insights like by no means earlier than.<\/p>\n<h2 class=\"wp-block-heading\">Let\u2019s speak Tableau<\/h2>\n<p>Tableau\u2019s superior customization choices allow us to create detailed, visually beautiful dashboards that aren&#8217;t simply informative however can even present distinctive person experiences. We can craft a extremely particular expertise for each use case \u2014 whether or not which means distinctive drill-down capabilities or a customized chart sort. These dashboards are sometimes regarded as full-fledged inner merchandise, not simply knowledge artifacts, every with a definite person base with particular wants.<\/p>\n<h2 class=\"wp-block-heading\">Next up: Looker Studio<\/h2>\n<p>Looker Studio, our fast and nimble sidekick, gives a seamless integration with Google merchandise that we usually use, like BigQuery. With Looker Studio, our customers can go from SQL to chart to dashboard in a heartbeat. It\u2019s notably fashionable amongst our engineering and product groups for its simple, intuitive person expertise.<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1200\" height=\"1051\" src=\"https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image2.png\" alt=\"\" class=\"wp-image-7187\" style=\"width:637px;height:auto\" srcset=\"https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image2.png 1200w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image2-250x219.png 250w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image2-700x613.png 700w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image2-768x673.png 768w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image2-120x105.png 120w\" sizes=\"auto, (max-width: 1200px) 100vw, 1200px\"\/><\/figure>\n<\/div>\n<p>Both Tableau and Looker Studio are important to our technique, every providing distinctive benefits. Looker Studio excels in fast, easy-to-use visualizations, whereas Tableau supplies complicated and detailed dashboards for extra nuanced wants. This dual-tool strategy permits each Spotify worker to decide on the answer that most closely fits their particular necessities, and we offer directions for getting began with each instruments by means of <a href=\"https:\/\/engineering.atspotify.com\/2020\/08\/how-we-use-golden-paths-to-solve-fragmentation-in-our-software-ecosystem\/\" target=\"_blank\" rel=\"noreferrer noopener\">Golden Path workouts<\/a>.<\/p>\n<p>To guarantee our most generally shared dashboards are appropriately and precisely interpreted \u2014 after which showcased throughout the group \u2014 we develop them according to particular requirements and practices.<\/p>\n<p>It begins with dashboard manufacturing. Building a dashboard, whether or not that&#8217;s in Tableau or in Looker Studio, can contain loads of transferring elements. It requires particular expertise in knowledge visualization and storytelling \u2014 expertise that require experience and time that many people could not have. On high of that, Spotifiers trying to construct a dashboard are possible in numerous elements of the org and never all the time in communication or imposing the identical requirements. To alleviate high quality challenges with distributed dashboard design \u2014 at scale \u2014 we developed a <strong>Dashboard Quality Framework<\/strong>.<\/p>\n<p>There are two elements to the Dashboard Quality Framework:<\/p>\n<ol class=\"wp-block-list\">\n<li><strong>Vital Signs<\/strong>: A set of computerized checks to make sure the dashboard is \u201calive and well.\u201d These are enabled by the knowledge we get from API and logs and embody data on proprietor standing, dashboard description, utilizing LDAP teams for sharing, underlying knowledge endpoint lifecycle, and whether or not updates and extract refreshes have been made lately.<\/li>\n<li><strong>Spicy Dashboard Design Checklist:<\/strong> A guidelines of information visualization and dashboard design greatest practices that would flip a vanilla report right into a \u201cspicy\u201d dashboard. The guidelines consists of objects associated to visible design, usability, insights, and belief. This is a handbook step that requires the human eye to find out. To allow this guidelines at scale, we\u2019ve turned this right into a self-evaluating guidelines that flags the dashboard when efficiently accomplished.<\/li>\n<\/ol>\n<p>Based on the outcomes of those measurements, a dashboard then receives certainly one of these high quality labels:<\/p>\n<ul class=\"wp-block-list\">\n<li>Low \u2014 fails Vital Signs (no matter Spicy Design Checklist consequence)<\/li>\n<li>High \u2014 passes Vital Signs<\/li>\n<li>Golden \u2014 passes Vital Signs <em>and<\/em> Spicy Design Checklist<\/li>\n<\/ul>\n<p>Ten % of eligible dashboards at Spotify have achieved Golden standing \u2014 and we attempt to maintain greater than 80% of all dashboards at High or above, informing dashboard house owners when their dashboards don\u2019t meet the Quality Framework standards.<\/p>\n<p>Below you will see the precise particulars of this framework \u2014 stealing is inspired!<\/p>\n<p>To assist our Tableau customers, we\u2019ve created a service that helps create and handle Tableau extracts.<strong> <\/strong>We\u2019ve developed a SQL scheduling instrument at Spotify that helps us schedule and run batch knowledge workflows in Google BigQuery. We\u2019ve enhanced this service to provide and publish Tableau .hyper recordsdata that can be utilized in dashboards on Tableau Cloud. These workflows run BigQuery SQL when upstream dependencies can be found and are sometimes quicker, can load extra knowledge, and are extra handy to edit because the SQL is in .yaml recordsdata as an alternative of embedded inside Tableau.<\/p>\n<p>And to actually drive dwelling the concept dashboards are a product, we equip all dashboard house owners with statistics and insights about their very own dashboards \u2014 exhibiting variety of energetic customers, weekly retention, customers by org or job household, and a capability to simply electronic mail customers (assume model updates or deprecation bulletins). This additionally permits folks to contemplate if they need to market the dashboard to a brand new viewers, or if they need to deprecate them when utilization may be very low. It\u2019s all about empowering dashboards house owners to make nice data-informed choices about their knowledge and dashboard merchandise.<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1999\" height=\"1297\" src=\"https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3.jpg\" alt=\"\" class=\"wp-image-7189\" style=\"width:640px;height:auto\" srcset=\"https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3.jpg 1999w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3-250x162.jpg 250w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3-700x454.jpg 700w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3-768x498.jpg 768w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3-1536x997.jpg 1536w, https:\/\/storage.googleapis.com\/production-eng\/1\/2024\/08\/image3-120x78.jpg 120w\" sizes=\"auto, (max-width: 1999px) 100vw, 1999px\"\/><\/figure>\n<\/div>\n<p>Insightful and exquisite dashboards aren\u2019t any good locked away \u2014 they must be accessible to  stakeholders!<\/p>\n<p>To present easy accessibility for dashboard customers, we developed the Dashboard Portal. Dashboard Portal is an inner website consisting of a searchable catalog of all printed dashboards at Spotify, each from Tableau and Looker Studio. It consists of methods to prepare and curate teams of dashboards and provides further context to dashboards for viewers.<\/p>\n<p>The main options of Dashboard Portal embody:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Search:<\/strong> Users can search by title, description, and area names to search out present dashboards. No extra \u201cDo we have a dashboard about <em>X<\/em>?\u201d!<\/li>\n<\/ul>\n<ul class=\"wp-block-list\">\n<li><strong>Curation:<\/strong> Dashboard authors can create curated collections of dashboards that turn out to be a go-to hub for his or her groups. Think \u201cThe Ads Dashboard Hub,\u201d containing all of the dashboards the crew consider are essential for his or her stakeholders to pay attention to.<\/li>\n<\/ul>\n<ul class=\"wp-block-list\">\n<li><strong>Trust and Quality:<\/strong> The Dashboard Quality Framework labels are displayed as a badge on high of the dashboard thumbnails and on all dashboard pages, giving viewers a fast understanding of a dashboard\u2019s high quality, and extra importantly, whether or not they can confidently belief it. We\u2019re capable of highlight and draw consideration to our Golden dashboards \u2014 our cream of the crop! In doing this, we\u2019ve seen that customers usually tend to view dashboards with a Golden label.<\/li>\n<\/ul>\n<ul class=\"wp-block-list\">\n<li><strong>Ubiquity:<\/strong> While Tableau and Looker Studio every have their very own discovery mechanisms, we\u2019ve discovered that having a Dashboard Portal that surfaces content material from a number of instruments permits the person to not have to consider the place the dashboard lives, however somewhat simply discover it.<\/li>\n<\/ul>\n<ul class=\"wp-block-list\">\n<li><strong>Enhanced Context:<\/strong> Dashboards are embedded straight into the Portal and boosted with further context: dashboard proprietor, final knowledge refresh date, utilization stats, and underlying SQL queries.<\/li>\n<\/ul>\n<p>Our sturdy strategy to dashboard creation and administration showcases our dedication to knowledge democratization and knowledgeable decision-making throughout the corporate. Our subtle instruments and frameworks be sure that each dashboard isn&#8217;t solely visually interesting but in addition a well-oiled machine delivering actionable insights.<\/p>\n<p><em>Special because of Jacob Olsufka, Arielle Silverman, Pavlina Mitsou, Daniel Wolmerud, Alex Pavlov, Axel \u00d6rnefalk, Robert Hjortsmarker, and Abhishek Upadhyay.<\/em><\/p>\n<p><\/p>\n<p>        Tags: <a href=\"https:\/\/engineering.atspotify.com\/tag\/data\/\" rel=\"tag noopener\" target=\"_blank\">Data<\/a>, <a href=\"https:\/\/engineering.atspotify.com\/tag\/engineering-culture\/\" rel=\"tag noopener\" target=\"_blank\">engineering tradition<\/a><br \/> \n            <\/div>\n<p>[ad_2]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] &#13; August 28, 2024&#13; &#13; Published by Skyler Johnson, Senior Data Scientist &#13; &#13; We have loads of dashboards at Spotify. Our Insight groups and analysts from throughout the corporate are always whipping up new dashboards for stakeholders and themselves, serving to reply these large data-driven questions daily. These dashboards sort out every thing [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":133523,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[38],"tags":[6314,6313,6312,6315,6311],"class_list":{"0":"post-133521","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-spotify","8":"tag-dashboards","9":"tag-highquality","10":"tag-insights","11":"tag-scale","12":"tag-unlocking"},"_links":{"self":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/posts\/133521","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/comments?post=133521"}],"version-history":[{"count":0,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/posts\/133521\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/media\/133523"}],"wp:attachment":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/media?parent=133521"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/categories?post=133521"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/tags?post=133521"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}