Friday, 26 July 2019

Integration Runtime


Azure Integration Runtime :

The Integration Runtime (IR) is the compute infrastructure used by Azure Data Factory to provide the following data integration capabilities across different network environments.

  • Data Flow: Execute a Data Flow.
  • Data movement: Copy data across data stores in public network and data stores in private network (on-premises or virtual private network). 
  • Activity dispatch: Dispatch and monitor transformation activities running on a variety of compute services such as Azure Databricks, Azure HDInsight, Azure Machine Learning, Azure SQL Database, SQL Server, and more.
  • SSIS package execution: Execute SQL Server Integration Services (SSIS) packages in a managed Azure compute environment.

Types of Integration Runtime :

  • Azure
  • Self-hosted
  • Azure-SSIS

An Azure integration runtime is capable of:
  • Running Data Flows in Azure
  • Running copy activity between cloud data stores.
  • Dispatching the following transform activities in public network: Databricks Notebook/ Jar/ Python activity, HDInsight Hive activity, HDInsight Pig activity, HDInsight MapReduce activity, HDInsight Spark activity, HDInsight Streaming activity, Machine Learning Batch Execution activity, Machine Learning Update Resource activities, Stored Procedure activity, Data Lake Analytics U-SQL activity, .NET custom activity, Web activity, Lookup activity, and Get Metadata activity.