TSQL Merge for Slowly Changing Dimension or Persistent Staging Area
CaseWhat is a fast way to load a Slowly Changing Dimension or Persistent Staging Area in SSIS. When using a Data Flow Task for this, the process could become very slow when there are a lot of...
View ArticleTSQL Snippet: Split string in records
CaseI have a string in TSQL and I want to split it into separate values / records. How do I do that?SolutionThere are a lot of split examples available on the web, but I really like the XQuery solution...
View ArticleGetting error column name in SSIS 2016
CaseIn SQL 2016 CTP 2.3 Microsoft introduced a new simple way with to get the name of the column causing the error with some .NET code in a Script Component. In the final release this code doesn't...
View ArticleSSIS Data Streaming Destination
CaseWhat can you do with the Data Streaming Destination in SSIS and how does it work? It only has an 'Advanced' editor with very little explanation.Editor Data Streaming DestinationSolutionYou probably...
View ArticleSSIS 2016 Feature Pack for Azure
A while ago I did a post on the SSIS (2012/2014) Feature Pack for Azure. Now a new version has been released for SSIS 2016 and they made some minor changes.DownloadIf you start SSDT 2015 you will see a...
View ArticleUsing SAS as a source in BIML
CaseI recently created packages with a SAS source, but now I want to use the same SAS source in my BIML Script. But I'm getting an error that the Local Provider doesn't support SQL. How can I solve...
View ArticleUsing SAS as a source in SSIS
CaseI want to extract data from a SAS database file (*.sas7bdat). How do I do that in SSIS?SolutionThis is possible but not out of the box. You need to install an extra provider to accomplish this.1)...
View ArticleSSIS Appetizer: Cache Transformation File is Raw File
SSIS AppetizerI'm not sure I have a purpose for this, but did you know that you can use the cache file of the Cache Transformation (introduced in SSIS 2008) as a source file in the Raw File...
View ArticleUsing PowerShell for SSIS
Recently I presented an SSIS & PowerShell session at the SQL Serverdays in Schelle, Belgium and SQL Saturday in Utrecht, The Netherlands. You can download the PowerPoints:SQL Serverdays Belgium...
View ArticleUsing PowerShell to create SQL Agent Job for SSIS
CaseI used PowerShell to deploy my SSIS project to the Catalog. Can I also automatically create a SQL Server Agent job with an SSIS jobstep?SQL Agent Job for SSIS packageSolutionYes, almost every...
View ArticleSSIS Naming conventions
In 2006 Jamie Thomson came up with naming conventions for SSIS tasks and data flow components. These naming conventions make your packages and logs more readable. Five SQL Server versions and a decade...
View ArticleSetup SSIS Scale Out
CaseSQL VNext has a new Scale Out function. How does it work and how do you install and configure that?SolutionThe new Scale Out option in SSIS VNEXT gives you the ability to execute multiple packages...
View ArticleDeployment bug SSIS VNEXT missing reference
CaseWhen deploying a project from SSDT VNEXT (SQL Server Data Tools 17.0 RC1) I get an error.Could not load file or assembly'Microsoft.SqlServer.Management.IntegrationServicesEnum,...
View ArticleExecute packages in Scale Out
CaseHow do I execute a package with the new Scale Out function? I don't see any options when executing a package.Find the Scale Out optionsSolutionThe new Scale Out execution is not (yet) integrated in...
View ArticleSSIS Appetizer: import numerics with other regional settings
CaseI have a CSV file with numeric values that use a dot "." as decimal separator instead of the comma "," we use locally. When I try to import it in SSIS with a Flat File Source it gives me an error....
View ArticleSSIS Appetizer: XML source is already sorted
CaseI have a large XML file with Orders and Onderlines which I want to (merge) join into a new destination. To join the two outputs I need to order them, but the sort transformation takes too much...
View ArticleChange Protection Level for all packages at once
CaseI created dozens of packages in my project but I forgot to change the default Protection Level in the project properties from "EncryptSensitiveWithUserKey" to "DontSaveSensitive". Now I have to...
View ArticleDynamically unpivot data
CaseFor a client I need to read hundreds of bus route matrices and they all vary in size. This makes it hard to read them dynamically with a Foreach Loop Container because the number of columns differs...
View ArticleSQL Nexus - PowerShell ❤️ SSIS
Nordic SQL Nexus 2017Last week I had the honor to speak at SQL Nexus in Copenhagen, a marvelous three day Microsoft Data Platform event with over 70 session to choose from. You can download my...
View ArticleImport and export SSIS Catalog Environments with JSON
CaseI want to import and export Environments to/from my SSIS Catalog. Doing it manually in SSMS takes ages. How can you do that more quickly?I want to export this environmentSolutionI will ago I...
View Article