SQL Saturday #221
The powerpoint (in Dutch!) of my SQL Saturday presentation about SSIS Performance Tuning is available for download. Added some screenshots for most demo's and a couple of URL's for additional...
View ArticlePerformance Best Practice: Network Packet Size
NetworkIf your SSIS package gets its data from a SQL Server database located on an other machine, then the data of your query will go from the SQL Server machine over the network to your SSIS machine....
View ArticlePerformance Best Practice: more rows per buffer
SSIS uses buffers to transport a set of rows through the data flow task. In general the less buffers you need to transport all rows from the source to the destination the faster it is.You can compare a...
View ArticlePerformance Best Practice: Flat File (Fast) Parse
Here are some tips to speed up the reading of flat files within the SSIS data flow. They are especially handy for importing large flat files (or when you merge join your small flat file to a large...
View ArticleCreate your own Foreach Loop Enumerator
CaseI want to create my own custom SSIS enumerator with a GUI. How do you do that?SolutionFor this example I will create a very basic enumerator which you can extend for your own needs. The enumerator...
View ArticleCreate your own custom task
CaseI want to create my own custom SSIS task with a GUI. How do you do that? SolutionFor this example I will create a very basic task which you can extend for your own needs. It checks whether a file...
View ArticleStarting with BIML for SSIS
Yesterday I finally started using BIML in one of my projects. Very handy to create dozens of those simple but annoying packages in a fraction of the time you would normally need when creating them...
View ArticleMixing BIML with .Net code
CaseRecently I had to stage about 150 tables from a source database. I like creating SSIS packages, but not 150 times the same boring stage package. Is there an alternative?Simplified version of my...
View ArticleBIML: An error occurred while parsing EntityName
CaseI'm creating an SSIS package with BIML and I want to add an expression in my Derived Column with an Logical AND &&.ISNULL([Column1]) && ISNULL([Column2])But when I check the BIML...
View ArticleCustom SSIS Component: Multiple Expressions Task
To change the value of a variable during runtime you need an expression or a Script Task. The expression isn't very flexible and the Script Task requires .Net knowledge. That's why Microsoft introduced...
View ArticleSending mail within SSIS - Part 3: Execute SQL Task
CaseI want to send mail within SSIS, preferably HTML formatted. What are the options?SolutionsThere are a couple of solutions to mail within SSIS:Send Mail TaskScript Task with SmtpClient ClassExecute...
View ArticleSending mail within SSIS - Part 2: Script Task
CaseI want to send mail within SSIS, preferably HTML formatted. What are the options?SolutionsThere are a couple of solutions to mail within SSIS:Send Mail TaskScript Task with SmtpClient ClassExecute...
View ArticleSending mail within SSIS - Part 1: Send Mail Task
CaseI want to send mail within SSIS, preferably HTML formatted. What are the options?SolutionsThere are a couple of solutions to mail within SSIS:Send Mail TaskScript Task with SmtpClient ClassExecute...
View ArticleUse Visual Studio 2012 for SSIS 2012
CaseI want to use Visual Studio 2012 to edit my SSIS packages, but during installation of Microsoft SQL Server Data Tools - Business Intelligence for Visual Studio 2012, I get an error:Rule "Same...
View ArticleCreate your own custom connection manager
CaseI want to create my own custom SSIS Connection Manager with a GUI. How do you do that? SolutionA custom connection manager is only for storing properties from a connection. You also need to create...
View ArticleCustom Task in BIML Script
CaseI want to add a custom task to my BIML Script. How do you do that in BIML?Solution1) IntroFor BIML you first need to install BIDS Helper. At the time of writing the current version of BIDS Helper...
View ArticleExecute multiple child packages in parallel with loop
CaseI used a foreach loop to execute all my staging packages, but my server isn't using all resources. Is there a way to execute multiple child packages at once, but with a loop?Executing packages...
View ArticleThe process cannot acces the file 'ssisproject.ispac' because it is being...
CaseI want to run an SSIS 2012 package but I'm getting an error:ispac file in use by other processSystem.IO.IOException: The process cannot access the file 'c:\folder\ssisproject.ispac' because it is...
View ArticleChecksum Transformation in BIML
CaseLast year we (colleague Marc Potters and me) created a custom Checksum Transformation for SSIS. We use it a lot to compare records from two sources. Instead of comparing a whole bunch of columns in...
View ArticleOpen BIML script without losing format and intellisense
CaseA couple of months ago I posted some tips about getting started with BIML. If you mix C# and BIML then you could loose formatting and intellisense. You can overcome this by right clicking the BIML...
View Article