avatarStuart Englander

Free AI web copilot to create summaries, insights and extended knowledge, download it at here

3413

Abstract

zations-for-columnstore-compression">here</a>.</p><p id="fc40">An example of over-configured workload management is when resources are reserved for a workload group even when there are no active requests in it. When setting up a workload group, you can define the minimum % of resources that are always reserved for the group. This is very useful in cases when you have to ensure that SLAs are met, but it should always be done with caution. If such strict isolation of resources is not required, it’s better to use a shared resource pool in combination with different workload importances.</p><h2 id="3041">3. Using clustered columnstore index for staging</h2><p id="23d4">By default, dedicated SQL pool will set up tables using clustered columnstore indexes. These are highly compressed, column-based data structures optimized for analytical workloads on large tables, but they can be expensive to build.</p><p id="5dbe">When loading data into a clustered columnstore index, the rows are first split into row groups (batches) which then are separated into column segments before each of these segments get compressed.</p><figure id="c79e"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*NUSN2jBohgHVlSGhjbgToA.png"><figcaption><a href="https://learn.microsoft.com/en-us/sql/relational-databases/indexes/columnstore-indexes-data-loading-guidance?view=sql-server-ver16">Source</a></figcaption></figure><p id="0b0b">Because building a clustered columnstore index is a resource intensive process, using them for temporary staging tables creates an unnecessary overhead without providing any benefits. When comparing the throughput of bulk loading processes for clustered columnstore indexes and heap tables, a 2–3x difference can be observed (<a href="https://techcommunity.microsoft.com/t5/sql-server-blog/data-loading-performance-considerations-with-clustered/ba-p/305223">link</a>).</p><p id="1bcf">While avoiding the aforementioned 3 mistakes when working with a Synapse dedicated SQL pool can help you save cost by utilizing your resources more efficiently, finding the right combination of tools for your business needs can be challenging. We at Starschema can help you identify the technologies that will best serve your use cases and fine-tune them for optimal performance. <a href="https://starschema.com/contact">Reach out</a> — we’d love to talk.</p><p id="ed30">To learn how Synapse fares against Databricks, Snowflake, Redshift and BigQuery fare and scale in terms of query performance, cost per performance and differentiating feature value, see the results of our extensive testing in this white paper:</p><div id="2298" class="link-block"> <a href="https://starschema.com/kb/cloud-data-warehouse-benchmark-2023"> <div> <div> <h2>Cloud Data Warehouse Benchmark 2023</h2> <div><h3>As cloud data warehouse providers race to improve the scalability, performance and cost-effectiveness of their…</h3></div> <div><p>starschema.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*QBnOLQvJ3CUAhQ_C)"></div> </div> </div> </a> </div><p id="28bd"><b>About the author</b></p><p id="a1e9"><i>Marton is a highly skilled data professional with experience in commerci

Options

al aviation and electronics manufacturing. He holds a Master’s degree in data science from Tilburg University and previously worked as a data scientist with the top management of a major European airline, where his transformational work helped save millions of euros for the company. In his current work as a data engineer at Starschema, he helps Fortune 500 companies build data platforms to unlock greater value from their data. Connect with Marton on <a href="http://www.linkedin.com/in/martonmesz">LinkedIn</a>.</i></p><p id="272c"><b>REACH OUT TO STARSCHEMA <a href="https://starschema.com/contact">HERE</a>:</b></p><div id="2f2e" class="link-block"> <a href="https://starschema.com/contact"> <div> <div> <h2>Let’s talk | Starschema</h2> <div><h3>We help your organization become data-driven</h3></div> <div><p>starschema.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*JnBf22UiwDSON2-d)"></div> </div> </div> </a> </div><p id="742c"><b>READ MORE STORIES FROM STARSCHEMA:</b></p><div id="4934" class="link-block"> <a href="https://readmedium.com/find-the-balance-between-cloud-cost-and-efficiency-889958c39908"> <div> <div> <h2>Find the Balance between Cloud Cost and Efficiency</h2> <div><h3>Learn how to measure the ROI of a cloud migration and get clarity on the opportunities and challenges inherent in…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*3onHo1F--Lp3oe9M)"></div> </div> </div> </a> </div><div id="a8c0" class="link-block"> <a href="https://readmedium.com/data-fabric-vs-data-mesh-find-the-right-fit-for-your-organization-40b37f4efba"> <div> <div> <h2>Data Fabric vs Data Mesh: Find the Right Fit for Your Organization</h2> <div><h3>Learn the differences between data mesh and data fabric architectures and find the right one for your data governance…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*uR7nzrNVrfSbaH6x)"></div> </div> </div> </a> </div><div id="5263" class="link-block"> <a href="https://readmedium.com/from-guesswork-to-genius-how-to-get-maximum-value-from-marketing-data-and-automation-b7600346dee7"> <div> <div> <h2>From Guesswork to Genius: How to Get Maximum Value from Marketing Data and Automation</h2> <div><h3>See how one company used marketing data to learn more about their audience and run more effective campaigns — and how…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*nJFWer2IZmGd2KJAGBR-3g.jpeg)"></div> </div> </div> </a> </div></article></body>

Day Tripping: March 12

Nothing more agreeable than Coke and cookies

Welcome to my daily feature where each day on the calendar marks a part of our shared history.

By Coca-Cola Company — Scanned by uploader from Wired magazine (Nov 2010), Vol. 18, №11, p. 104., Public Domain, https://commons.wikimedia.org/w/index.php?curid=12726582

Pop The Cork

In the late nineteenth century, Coca-Cola was originally sold by the glass from a fountain. The belief then was that carbonated water had beneficial health qualities, a case of what goes around, comes around. Today in 1894, a candy company in Vicksburg, Mississippi is credited with the first bottling of the product.

Joseph A. Biedenharn used his Hutchinson bottle with a patented stopper to sell the sweet elixir. The famous contoured version would not make its first appearance until 1915.

Take A Big Bite

Having returned from the UK in 1912 where she learned of an organization devoted to the development of girls, Juliette Gordon Low established the Girl Guides of America in Savannah, Georgia. Calling on eighteen local girls, Low formed and promoted the group, dedicating her life to the development of female youth which later incorporated as Girl Scouts and grew to worldwide success.

“Truly, ours is a circle of friendships, united by our ideals.” — Juliette Gordon Low. And what goes better with a coke than cookies?

Shake Hands

Semiramis Hotel in Cairo was the scene of the secret 1921 conference held to determine the future political landscape in the Middle East. In attendance with then Colonial Secretary, Winston Churchill, were two of the most active Britons in the region, Gertrude Bell and T.E. Lawrence. Bell was an extraordinary influence not only as a woman but for her expertise and knowledge from extensive travels throughout the region. Lawrence of course was canonized in David Lean’s film depiction of Lawrence of Arabia.

The outcome of the two-week meeting set boundaries for rulers Abdullah bin Hussein of Jordan, and his brother King Faisal of Iraq. The British kept their mandate over Palestine in the promise of creating a Jewish Homeland.

Musical Milestones

2003 — The Rolling Stones are given explicit instructions on what songs they will not be allowed to perform on their tour of Communist China. Banned from the playlist are, Brown Sugar, Honky Tonk Woman, and Let’s Spend the Night Together.

If it was sexual innuendo they were worried about, I can think of a few that may have been worse.

Narratives

Two literary giants that walked to their own beat, Jack Kerouac 1922, and Edward Albee 1928, were born.

Remembrance

Anne Frank died of typhus in Belson concentration camp during the Holocaust at the age of fifteen in 1945. Her legacy speaks volumes for the many who perished with her.

Notable Births

1933 — If you know Agent 99 from one fo television's best sitcoms Get Smart, you know Barbara Feldon. “Oh, Max.”

1946 —Daughter of Judy Garland and accomplished actress, singer and dancer, Liza Minnelli. The original Arthur is still one of my favourite comedies.

1948 — Folk singer and songwriter, the great James Taylor.

Thanks for taking the time to read this article dedicated to the days of our history. I hope to see you tomorrow for another instalment.

K. Barrett Katie Wallace Maria Rattray Joseph M. Learned Maryam Merchant Dr Mehmet Yildiz Tree Langdon Myriam Ben Salem Phil Truman Chelsea Mandler MAT Terry Mansfield Hollie Petit, PhD. Terry Trueman Dr Preeti Singh John Gruber Bill Abbate James G Brennan ScienceDuuude Marcus Liam Ireland Claire Kelly

History
Events
People
Writing
Marketing
Recommended from ReadMedium