Building Custom Tasks for SQL Server Integration Services: The Power of .NET for ETL for SQL Server 2019 and Beyond, Second Edition`

  • 4h 6m
  • Andy Leonard
  • Apress
  • 2021

Build custom SQL Server Integration Services (SSIS) tasks using Visual Studio Community Edition and C#. Bring all the power of Microsoft .NET to bear on your data integration and ETL processes, and for no added cost over what you’ve already spent on licensing SQL Server. New in this edition is a demonstration deploying a custom SSIS task to the Azure Data Factory (ADF) Azure-SSIS Integration Runtime (IR).

All examples in this new edition are implemented in C#. Custom task developers are shown how to implement custom tasks using the widely accepted and default language for .NET development.

Why are custom components necessary? Because even though the SSIS catalog of built-in tasks and components is a marvel of engineering, gaps remain in the available functionality. One such gap is a constraint of the built-in SSIS Execute Package Task, which does not allow SSIS developers to select SSIS packages from other projects in the SSIS Catalog. Examples in this book show how to create a custom Execute Catalog Package task that allows SSIS developers to execute tasks from other projects in the SSIS Catalog. Building on the examples and patterns in this book, SSIS developers may create any task to which they aspire, custom tailored to their specific data integration and ETL needs.

You will:

  • Configure and execute Visual Studio in the way that best supports SSIS task development
  • Create a class library as the basis for an SSIS task, and reference the needed SSIS assemblies
  • Properly sign assemblies that you create in order to invoke them from your task
  • Implement source code control via Azure DevOps, or your own favorite tool set
  • Troubleshoot and execute custom tasks as part of your own projects
  • Create deployment projects (MSIs) for distributing code-complete tasks
  • Deploy custom tasks to Azure Data Factory Azure-SSIS IRs in the cloud
  • Create advanced editors for custom task parameters

About the Author

Andy Leonard is Chief Data Engineer at Enterprise Data & Analytics, an SSIS trainer, consultant, developer of the Data Integration Lifecycle Management (DILM) Suite, a Business Intelligence Markup Language (Biml) developer, and BimlHero. He is a SQL Server database and data warehouse developer, community mentor, engineer, and occasional farmer. He is co-author of Apress books SQL Server Integration Services Design Patterns and The Biml Book, and author of the Apress book Data Integration Life Cycle Management with SSIS and the Stairway to Integration Services series at SQLServerCentral.com.

In this Book

  • The Story of this Book
  • Preparing the Environment
  • Creating the Assembly Project
  • Check in the Project Code
  • Signing the Assembly
  • Preparing to Build
  • Coding the Task
  • Coding a Simple Task Editor
  • Signing and Binding
  • Expanding Editor Functionality
  • Minimal Coding for the Complex Editor
  • Editor Integration
  • Implement Views and Properties
  • Implement New Connection
  • Implement Use32bit, Synchronized, and LoggingLevel SettingsView Properties
  • Refactoring SourceConnection
  • Refactoring the SSIS Package Hierarchy
  • Instrumentation and Validation
  • Crushing Bugs
  • Adding Synchronous Execution Properties
  • Testing the Task
  • Building the Setup Project
  • Using the Execute Catalog Package Task in an SSIS Framework
  • Deploying to Azure-SSIS
  • Test the Task in Azure Data Factory
  • Notes from my Experience
SHOW MORE
FREE ACCESS

YOU MIGHT ALSO LIKE

Book Practical Database Auditing for Microsoft SQL Server and Azure SQL: Troubleshooting, Regulatory Compliance, and Governance
Book Pro Serverless Data Handling with Microsoft Azure: Architecting ETL and Data-Driven Applications in the Cloud
Book SQL Server Data Automation Through Frameworks: Building Metadata-Driven Frameworks with T-SQL, SSIS, and Azure Data Factory