Problems displaying this newsletter? View online.
SQL Server Central
Featured Contents
Question of the Day
The Voice of the DBA
 

Daily Coping Tip

Ask a trusted friend to tell you what they like about you

I also have a thread at SQLServerCentral dealing with coping mechanisms and resources. Feel free to participate.

For many of you out there working in a new way, I'm including a thought of the day on how to cope in this challenging time from The Action for Happiness Coping Calendar. My items will be on my blog, feel free to share yours.

The Value of Metadata

A long time ago, nearly two decades ago, I had a manager come ask me about metadata, specifically, what it was. This was a technical manager, who understood software well but wasn't a data expert. I tried to explain data about data, but at that time, the world primarily dealt with client-server type technologies, with data being something that was primarily about a think. Metadata like types, scales, etc., weren't seen as that useful, and descriptive items, like we might store in the MS_Description extended property, were rare.

Today, we use metadata quite often, and I think in many ways we've "consumer-ized" metadata with tagging and other structures that let the users of our software add descriptive attributes to the data they store in our systems. In some sense, we get metadata at a deeper level, almost the row or cell level, and if we were tracking column or entity level markers.

There is a lot of value in this metadata, both to the technical staff and to business users. This article talks about the value of having detailed metadata for data scientists and similar roles, where understanding the meaning of the data can be very valuable. The more focused data scientists and analysts can be, and the easier with which they can find data, the more productive they can be.

At Redgate, we work with customers all over the world, but it's outside the US where we've seen the value of metadata grow. Primarily in response to the GDPR, we find many business people want to know about their data, it's meaning, it's sensitivity, and really, the risk of data loss. This has expended into our Data Catalog and Data Masker products, which exist to help organizations keep track of their data. It's a big job, one that isn't fun, and often has debatable value when starting from the beginning. It can be a large time sink when one has to track down the meanings of all the data in databases.

Many find, however, that knowing this information can be quite useful when it's available. Archive plans, decisions on masking data, even choosing technologies for protection become more focused when you know what data you have. We continue to research and work on finding ways to improve the help software gives users in applying this metadata, as do many others. Privacy and compliance have driven a lot of work in this area, but potentially data science, data lineage, security, and more could find ways to use this information in our organizations.

The one thing I think is important is that we maintain this information as a part of our regular work. Customers might do some metadata work themselves (which can be extremely valuable information), but asking most people to classify and tag lots of information is a mind-numbing job. It's better if we can tag sections of data as we add features to software. That way, when someone goes looking, most data is already partially tagged.

Steve Jones - SSC Editor

Join the debate, and respond to today's editorial on the forums

Redgate SQL Prompt
 
  Featured Contents

Editor Tips and Tricks for Azure Data Studio

Steve Jones - SSC Editor from SQLServerCentral

Azure Data Studio (ADS) is a lightweight IDE built on Visual Studio Code. I've written a few articles on how ADS works, shown here: Getting Started with Azure Data Studio Getting Comfortable Writing Code in Azure Data Studio Using Notebooks in Azure Data Studio Using Azure Data Studio with TFVC Using Azure Data Studio with […]

Cross Tab Report in SSRS

Additional Articles from MSSQLTips.com

This tip provides a step by step process to create a cross tabulation report in SQL Server Reporting Services.

Hidden treasures of SQL Prompt

Additional Articles from Redgate

You are invited to discover features of SQL Prompt that you may not even know exist. We will will walk you through the treasure map of SQL Prompt and show you where all the great features are buried.

Questions about Comparing Databases with SQL Compare that you were Too Shy to Ask

Site Owners from Redgate

Phil Factor offers straightforward answers to tricky SQL Compare questions.

Free eBook: Inside the SQL Server Query Optimizer

Press Release from SQLServerCentral.com

This free eBook from Redgate Software will take you from the fundamentals of Statistics, Cost Estimation, Index Selection, and the Execution Engine, and guide you through the inner workings of the Query Optimization process, and throws in a pragmatic look at Parameterization and Hints along the way.

From the SQL Server Central Blogs - Cleaning up bad dates–#SQLNewBlogger

Steve Jones - SSC Editor from The Voice of the DBA

Another post for me that is simple and hopefully serves as an example for people trying to get blogging as #SQLNewBloggers. I got some data recently from an online...

 

  Question of the Day

Today's question (by Steve Jones - SSC Editor):

 

A calculated column in R

I have a small dataframe in R that looks like this:
> mysales orderdate customerids orderqty orderprice 1 2019-09-23 1 10 10 2 2019-06-16 2 20 10 3 2019-03-09 3 30 9
I want to add a line total column, called linetotal, that is the product of the quantity and the price. Which code does this?

Think you know the answer? Click here, and find out if you are right.

 

 

  Yesterday's Question of the Day (by Steve Jones - SSC Editor)

Backing up to Azure

I want to send the backup of my SQL Server 2019 database to Azure Blob storage. When I enter the URL, what is the format? All CAPS are the items I set for my account.

Answer: http[s]://ACCOUNTNAME.blob.core.windows.net/CONTAINER/FILENAME.bak

Explanation: The format is: http[s]://ACCOUNTNAME.blob.core.windows.net// A filename must be provided, as well as a container. Ref: SQL Server Backup to URL - https://docs.microsoft.com/en-us/sql/relational-databases/backup-restore/sql-server-backup-to-url?view=sql-server-ver15

Discuss this question and answer on the forums

 

 

 

Database Pros Who Need Your Help

Here's a few of the new posts today on the forums. To see more, visit the forums.


SQL Server 2017 - Administration
Inserts not propagated in transactional replication - Hello, I have a transactional replication configured which subscription fails to sync to often due to 20598 errors. I've enabled verbose logging on the Distribution agent, nothing more detailed captured than the message that the UPDATE fails due to the row missing at the Subscriber. I've run profiler on the Subscriber side and verified that very often […]
SQL Server 2017 - Development
Import csv file into existing table where 1st row has sep=, - Hi, I have a csv file that has the value "sep=," in the first row and the header in the second row. I can import it as using the flat file wizard however that doesn't allow importing into an existing table. The data import task allows importing into an existing tables but i can't figure […]
Cross Apply, sub query or something else.... I\'m stuck - need help on a query please. given the following table; CREATE TABLE #T (CATEGORY bigint, NESTEDSETLEFT bigint, NESTEDSETRIGHT BIGINT) INSERT INTO #T ( CATEGORY, NESTEDSETLEFT, NESTEDSETRIGHT ) SELECT 5637145852,1526,1541 UNION SELECT 5637145310,392,407 UNION SELECT 5637145515,814,837 I need to be able to pass NESTEDSETLEFT and NESTEDSETRIGHT into this query without using a cursor.... SELECT CATEGORY, ITEMID […]
SQL Server 2016 - Administration
Old version SQL server license questions - Please forgive me for asking questions about licensing on older version SQL servers We have 6 SQL servers on prior 2012 versions (1 version 2005 and 5 versions 2008 R2, standard editions)  still being used for our business, I have two questions: Microsoft extended support for 2005 and 2008 R2 version SQL server  has already […]
SQL Agent error history - Is there a way to capture 2 things, when did the job failed and why did it fail ( capturing error message). I don't have the history available for couple of jobs but do know they have failed before and they were fixed. I want to know why they failed before like by looking at […]
Linked Server Modification - I have a linked server and need to change only the @svrproduct and the @datasrc.  I cannot figure out how to do this.  I do not want to drop the object and recreate. @server = N'EAUTO', @srvproduct=N'1.2.3.4', @provider=N'SQLNCLI', @datasrc=N'1.2.3.4' Thanks, Terry
SQL Server 2016 - Development and T-SQL
How to use PIPES in T-SQL to bring two number based on user entry - Hello I have a query that use wildcard to bring any value according to the user entry now the use want to enter two number at the same time so I was trying this with a "PIPE", please help tb_phone.number  IN ( '%' + @number + '%' | '%' + @number + '%') Also I […]
Administration - SQL Server 2014
Service pack process? - Hello!  Our current version of SQL 2014 is only updated to the first Service Pack 2 download 12.0.5000.0 We're wanting to get fully updated with the Service Pack 2 Cumulative updates and Service pack 3. I'm sorry if it's a stupid question, first time updating this one. Would this be the correct update sequence? SQL […]
SQL 2012 - General
Adding Column to Existing View - Incorrect Syntax near ')' - I created a view several years ago that has been working well.  Basically it selects a value from a row directly below it.  Now, I would like to add another column to the view but when I try to save it, I get the error message 'Incorrect Syntax near ')'.  If I try to run […]
DB maintenance plan to clear tempdb? - Hi Experts , The tempdb in our production database is getting full and this is causing the SQL server job and other query's to halt. Should I shrink the tempdb to generate space? .I would require your help in creating a maintenance plan which would trigger automatically to generate  space in tempdb.   Thanks in […]
SQL Server 2019 - Administration
Create Credentials of the network shared access in SQL server to be used by SQL - Could you please let me know 'Create Credentials of the network shared access in SQL server to be used by SQL Agent'
SQL Server 2019 - Development
Size of table - Hi This probably a silly question but..... If I query the size of a table and it shows 20 gigs in size, when I do a select * from that table from another server will I bring back 20 gigs over the network? thanks in advance
Validate field in STaging before loading - I have a STaging table where I have defined all fields as Varchar(255), now I'm trying to load the Prod table, and one of my fields(order_open_qty) is defined as Decimal(18,10), but it fails as data from STaging fails converting Varchar to Dec. Is there any pre-validation I can run to change those bad records to […]
Analysis Services
Azure Log Analytics or SQL Profiler for AAS? - I think you can use both SQL Server Profiler or Azure Log Analytics for Azure Analysis Services logging. But which one is the better option?
Integration Services
Running SSIS package on Always On and getting error - Hello, so My ssis Package i created, does 2 things: 1.it first checks if the Table exists, and if not, create it 2.checks if Store procedure exists, if not creates it using a Dynamic tsql statement so far, i made several ssis packages with it including several Execution SQL Task, and works fine, just this […]
 

 

RSS FeedTwitter

This email has been sent to newsletter@newslettercollector.com. To be removed from this list, please click here. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com.
©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved.
webmaster@sqlservercentral.com

 

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -