 | A community of more than 1,600,000 database professionals and growing |
| Featured ContentsFeatured Script |
| | Should the Data Lake be Immutable? There's a concept in computer science of immutability. At a high level, this means once something is set, it isn't changed. Various computer science languages do this with variables, where values don't change, though variables can be destroyed and recreated. In the PASS keynote, Dr. Ramakrishnan pointed out that we have silos of data, often in disparate systems where we keep our information. We want to query this together, so we transfer this to a data warehouse or data lake (the future view) and that items in the data lake are immutable. They aren't allowed to chang in the way that we update values in our relational databases. We should just read the most recent version of any data, and if there is an update, just add a new set of data. That's an interesting concept, but not sure I agree. I think that while we might often want to use a simpler process, there are cases where we do need capabilities to edit. Imagine I had a large set of data, say GBs in a file, would I want to download this and change a few values before uploading it again? Do we want a large ETL load process to repeat? Could we repeat the process and reload a file again? I don't think so, but it's hard to decide. After all, the lake isn't the source of data; that is some other system. Maybe that's the simplest solution, and one that reduces complexity, downtime, or anything else that might be involved with locking and changing a file. After all, we wouldn't want queries that could potentially read the data in between us deleting a value and adding back a new one. If you're a data warehouse or analysis person, what do you think? Does it make sense to keep the data lake as immutable and reload data that might not be clean? Let us know today. Steve Jones from SQLServerCentral.comJoin the debate, and respond to today's editorial on the forums |
| The Voice of the DBA Podcast Listen to the MP3 Audio ( 2.8MB) podcast or subscribe to the feed at iTunes and Libsyn.  The Voice of the DBA podcast features music by Everyday Jones. No relation, but I stumbled on to them and really like the music. |
|
|
|
| | ADVERTISEMENT |  | | Redgate Acknowledged as Representative Vendor in 2018 Gartner Market Guide Data Masking has come of age and Gartner’s?2018 Market Guide for?Data Masking includes analysis, recommendations and representative vendors to help you start your data masking journey on the right foot.
Get your complimentary copy now |
|  | | Write, format, analyze, and refactor SQL fast with SQL Prompt Writing SQL is 50% faster with SQL Prompt. Your SQL code can be formatted just the way you like it, you can create and share snippets with your team, and with code analysis you get suggestions to improve your SQL as you type. Download your free trial |
|
|
|
| | |  | Andy Warren from SQLServerCentral.com Monitoring your SQL Server is important. This article examines one of the metrics you might want to keep an eye on. More » |
 | Additional Articles from Database Journal Sometimes performance is more important than exact accuracy. Learn how to get an approximate count in SQL Server with better performance. More » |
 | Most organizations are finding that the size and number of databases that need to be monitored is increasing, unlike the number of people available to do the work. Now that it is possible for the organization to scale out to cloud-hosted databases, the constraints of the available infrastructure have ceased to govern the growth of the database estate. More » |
 | ChrisJenkins from SQLServerCentral Blogs In this article I’m going to show you how I build my time dimensions. There are lots of different ways... More » |
| | Eduardo Pivaral from SQLServerCentral Blogs If you have SQL Server Integration Services installed on your server, and you left the default configurations a table named... More » |
|
|
| | | Today's Question (by Steve Jones): I want to create a memory-optimized table with an identity value. I want to use this code: CREATE TABLE SensorData ( SensorDataKey INT IDENTITY(X,Y) CONSTRAINT SensorDataPK PRIMARY KEY , SensorKey int , ReadingTime datetime2 , SensorValue int ) What values can I use for x and y? |
Think you know the answer? Click here, and find out if you are right.
We keep track of your score to give you bragging rights against your peers.
This question is worth 1 point in this category: IDENTITY Property. We'd love to give you credit for your own question and answer.
To submit a QOTD, simply log in to the Contribution Center. |
|
|
| |
| ADVERTISEMENT |  Extract, Transform, and Load with SQL Server Integration Services: With Microsoft SQL Server, Oracle, and IBM DB2 Readers will learn by example how to use Microsoft SQL Server 2016 Integration Services (SSIS) as they design and implement extract, transform, and load (ETL) solutions to support a business application that integrates with a data warehouse and an online Web store across a heterogeneous system. This volume describes proven methods to support common ETL needs, such as databases communicating directly with each other, using files to exchange data, or performing database operations using Web services. Pick up your copy of this great book today at Amazon today. |
|
|
|
|
|
| Yesterday's Question of the Day |
| Yesterday's Question (by Steve Jones): I have the Buffer Pool Extension enabled and set on my instance. Currently I have a 58GB setting for max server memory and a 500GB file set for BPE. I want to decrease this to 250. Which of these statements do I run? - ALTER SERVER CONFIGURATION SET BUFFER POOL EXTENSION OFF
- ALTER SERVER CONFIGURATION SET BUFFER POOL EXTENSION ON (FILENAME = 'F:\memory.BPE', SIZE = 250GB)
- ALTER SERVER CONFIGURATION SET BUFFER POOL EXTENSION (FILENAME = 'F:\memory.BPE', SIZE = 250GB)
- ALTER SERVER CONFIGURATION SET BUFFER POOL EXTENSION ON
- Restart the instance
Answer: 1, then 2, then 5 Explanation: To lower the BPE limit, you must first turn off the option and then change the value. You must restart the instance as well. Ref: ALTER SERVER CONFIGURATION - click here
» Discuss this question and answer on the forums |
|
|
| | | Jonathan Roberts from SQLServerCentral.com I use this when inserting data into a staging table on a data warehouse. If inserting data into an empty table it is faster to insert data when the indexes are disabled and then rebuild the indexes once the insert has completed than to insert all the data with the indexes enabled. If you disable a clustered index then you won't be able to insert any data onto the table. So this script only disables and then rebuilds nonclustered indexes. More »
|
|
|
| Database Pros Who Need Your Help |
| Here's a few of the new posts today on the forums. To see more, visit the forums.
Encrypting All Procedures in a Database - Dear All, I have a requirement where i need to encrypt all my stored procedures in a existing database. Do we... SSRS Load Balancing, Listeners and Licenses - I hope someone can verify this for me. We're about to upgrade to 2017 and we're addressing an old question that... SQL Server Database Administrator Interview Questions - As a beginner DBA I am really interested what kind of question do employers ask while interviewing for a position... AlwaysOn synchronous - restarting secondary causes long pauses on primary due to HADR_SYNC_COMMIT - Hi all, I'm having a bit of a weird issue here that I just managed to get more info on. Setup: 2-Node...
Find all stored procedures called by jobs - I am trying to find all stored procedures called by jobs. I have modified SELECT DISTINCT SPROC=SPECIFIC_NAME FROM .. CROSS JOIN...
Disk corrupted in always on - One of the disk corrupted where the database files are placed and those databases are configured in always on. What... Connections made to Server - Is there a way to identify how many hits were made by particular user against a database server? If yes,is... Database Mail - Not sending mail - SSMS 2016 - Setup Failed Access Denied (0x80070005) - Attempt to install SSMS 2016 returns Setup Failed Access Denied (0x80070005) OS is Windows 2012 R2 Datacenter on a VMware machine
Totals up to a specific date - Hello, it would be great if someone could help me with the following problem. I need to write a query, i guess... Group by companyid with Latest date - Hi Team, Can you please help me on this below query. create table #test ( companyid int, companyname varchar(100), actiondate datetime ) insert into...
Transactional Replication - I have DB mirroring configured to DR location from Server A --> B. Also replication configured from Server A -->...
Stored proc not returning data in SSRS - Hi Experts, I am running a query below in ssms and it returns data,but when i put the same query on...
Login Failed for user Domain\User - I have a .net web app on development machine. It is WIndows 10 with .Net Framework 4.7, SQL Server 2012...
Expand multi-join with another table - Hi all, I'm have a SQL agent job (running in live business situation) and it's doing the following: -read data from source... Convert string MMDDYYYY to a date - First I will say I've found a couple different SQL solutions for this, I'm asking if there is a better...
mapping back - i have table as below: country code australia 55555 australia 55555 australia checklater ukraine 33333 ukraine checklater ukraine checklater ukraine 33333 america 22222 i would like to map back the same country and replace the code...
Report Builder 3.0: Unable to connect to the server that is specified in the URL - I'm getting the following error when attempting to connect to Report Builder 3.0 on a SQL 2014 Report Builder install....
date formats - ((Get-Date).AddMonths(1)) gives me Saturday, August 25, 2018 3:06:26 AM (Get-Date -format 'Y') gives me July, 2018 How do i get August, 2018 when I...
sp_addartcle fails - Hi, I am trying to automate replication creation. I am running the below code to add two articles to a... |
|
| This email has been sent to newsletter@newslettercollector.com. To be removed from this list, please click here.
If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com.
| This newsletter was sent to you because you signed up at SQLServerCentral.com.
Feel free to forward this to any colleagues that you think might be interested.
If you have received this email from a colleague, you can register to receive it here.
| This transmission is ©2018 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved.
Contact: webmaster@sqlservercentral.com |
|
|