OpenSkillIndex← back to search
claude-code

Agent-Skills azure-data-factory

Expert knowledge for Azure Data Factory development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when designing ADF pipelines, Mapping Data Flows, SHIR/SSIS IR, secure VNet/Private Link setups, or CI/CD deployments, and other Azure Data Factory related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure Databricks (use azure-databricks), Azure Stream Analytics (use azure-stream-analytics), Azure Data Explorer (use azure-data-explorer).

install
source · Clone the upstream repo
git clone https://github.com/MicrosoftDocs/Agent-Skills
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/MicrosoftDocs/Agent-Skills "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/azure-data-factory" ~/.claude/skills/microsoftdocs-agent-skills-azure-data-factory && rm -rf "$T"
manifest: skills/azure-data-factory/SKILL.md
source content

Azure Data Factory Skill

This skill provides expert guidance for Azure Data Factory. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., 

L35-L120
), use 
read_file
with the specified lines. For categories with file links (e.g., 
[security.md](security.md)
), use 
read_file
on the linked reference file

IMPORTANT for Agent: If 

metadata.generated_at
is more than 3 months old, suggest the user pull the latest version from the repository. If 
mcp_microsoftdocs
tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use 
    mcp_microsoftdocs:microsoft_docs_fetch
    with query string 
    from=learn-agent-skill
    . Returns Markdown.
  • Fallback: Use 
    fetch_webpage
    with query string 
    from=learn-agent-skill&accept=text/markdown
    . Returns Markdown.

Category Index

CategoryLinesDescription
TroubleshootingL37-L90Diagnosing and fixing ADF issues: connector/format errors, copy & data flow performance, pipelines/triggers, SHIR/SSIS IR problems, security/access, and interpreting failure logs.
Best PracticesL91-L113Performance, DataOps, and reliability best practices for ADF: tuning data flows/copy, optimizing sources/sinks/IR, handling schema drift/errors, and migrating data (HDFS, Netezza, S3) to Azure.
Decision MakingL114-L134Guidance on ADF architecture, runtimes, connector upgrades, cost optimization, and migration/modernization of pipelines, SSIS, Synapse, and data warehouses to Azure/Fabric
Architecture & Design PatternsL135-L145Patterns and architectures for ADF: efficient mapping data flows, metadata‑driven copy, SSIS IR with SQL MI/failover/VNet, Cosmos DB migration, and SAP CDC design.
Limits & QuotasL146-L150Info on ADF connector lifecycle stages and timelines, plus how reservation discounts work for Mapping Data Flows and how they affect cost and capacity planning
SecurityL151-L181Securing Data Factory with identity, encryption, Key Vault, and Azure Policy, plus network controls like VNets, Private Link, firewalls, private endpoints, and secure runtimes (Azure-SSIS, self-hosted).
ConfigurationL182-L295Configuring ADF artifacts and runtime: pipelines, activities, data flows, triggers, copy behavior, formats, IRs (Azure/self-hosted/SSIS), monitoring, logging, parameters, and DevOps setup.
Integrations & Coding PatternsL296-L482Connector how-tos, patterns, and activities for copying/transforming data between ADF and many services (databases, SaaS apps, files, Fabric, Databricks, SSIS, ML, Synapse) using data flows and SDKs.
DeploymentL483-L496CI/CD and deployment for ADF: ARM/linked templates, Azure DevOps pipelines, hotfix flows, pre/post scripts, IR automation, SSIS job migration, and networked IR migration.

Troubleshooting

TopicURL
Troubleshoot Azure Data Factory change data capturehttps://learn.microsoft.com/en-us/azure/data-factory/change-data-capture-troubleshoot
Troubleshoot CI/CD, Azure DevOps, and GitHub integration for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/ci-cd-github-troubleshoot-guide
Resolve common Azure Data Factory connector upgrade issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-deprecation-frequently-asked-questions
Resolve Azure Data Factory Amazon S3 connector errorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-amazon-simple-storage-service
Fix Azure Blob Storage connector issues in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-blob-storage
Troubleshoot Azure Cosmos DB connectors in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-cosmos-db
Resolve Azure Data Explorer connector problems in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-data-explorer
Troubleshoot Azure Data Lake Storage connectors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-data-lake
Resolve Azure Files connector errors in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-files
Troubleshoot Azure Table Storage connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-table-storage
Fix DB2 connector problems in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-db2
Troubleshoot delimited text format connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-delimited-text
Resolve Dynamics 365 and Dataverse connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-dynamics-dataverse
Troubleshoot file system connector failures in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-file-system
Troubleshoot FTP, SFTP, and HTTP connectors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-ftp-sftp-http
Fix Google Ads connector errors in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-google-ads
Troubleshoot Azure Data Factory connector failureshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-guide
Troubleshoot Hive connector issues in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-hive
Troubleshoot Microsoft Fabric Lakehouse connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-microsoft-fabric-lakehouse
Fix Microsoft Fabric Warehouse connector issues in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-microsoft-fabric-warehouse
Resolve MongoDB connector problems in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-mongodb
Resolve Oracle connector issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-oracle
Troubleshoot ORC format connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-orc
Fix Parquet format connector issues in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-parquet
Fix Azure Database for PostgreSQL connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-postgresql
Troubleshoot REST connector errors in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-rest
Resolve Salesforce and Service Cloud connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-salesforce
Troubleshoot SAP Table and BW Open Hub connectorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-sap
Fix ServiceNow connector problems in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-servicenow
Troubleshoot SharePoint Online list connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-sharepoint-online-list
Resolve Shopify connector issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-shopify
Troubleshoot Snowflake connector errors in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-snowflake
Troubleshoot SQL-based connectors in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-synapse-sql
Fix Teradata connector failures in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-teradata
Fix XML format connector problems in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-xml
Troubleshoot Copy activity performance issueshttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-troubleshooting
Troubleshoot external control activities in ADF pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-troubleshoot-guide
Diagnose and fix Azure Data Factory Studio issueshttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-ux-troubleshoot-guide
Troubleshoot mapping data flow connector and format issueshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-connector-format
Resolve mapping data flow issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-guide
Work around known Azure Data Factory issueshttps://learn.microsoft.com/en-us/azure/data-factory/known-issues-troubleshoot-guide
Troubleshoot Azure Data Factory pipeline orchestration and triggershttps://learn.microsoft.com/en-us/azure/data-factory/pipeline-trigger-troubleshoot-guide
Debug SAP CDC connector issues via SHIR logshttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-debug-shir-logs
Resolve security and access control issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/security-and-access-control-troubleshoot-guide
Use the self-hosted integration runtime diagnostic toolhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-diagnostic-tool
Diagnose and fix self-hosted IR issues in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-troubleshoot-guide
Troubleshoot SSIS IR connectivity with diagnose featurehttps://learn.microsoft.com/en-us/azure/data-factory/ssis-integration-runtime-diagnose-connectivity-faq
Diagnose and fix SSIS IR management issueshttps://learn.microsoft.com/en-us/azure/data-factory/ssis-integration-runtime-management-troubleshoot
Troubleshoot SSIS package execution on SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/ssis-integration-runtime-ssis-activity-faq
Interpret pipeline failure status and error messages in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-pipeline-failure-error-handling

Best Practices

TopicURL
Apply DataOps practices to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/apply-dataops
Use column patterns in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-column-pattern
Reuse logic with flowlets in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-flowlet
Tune mapping data flow performance in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance
Optimize sink performance in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-sinks
Optimize source performance in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-sources
Improve transformation performance in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-transformations
Handle schema drift in Data Factory mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-schema-drift
Tune integration runtime performance for data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime-performance
Tune Azure-SSIS integration runtime for high performancehttps://learn.microsoft.com/en-us/azure/data-factory/configure-azure-ssis-integration-runtime-performance
Optimize Azure Data Factory copy activity performancehttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance
Migrate on-premises HDFS data to Azure Storagehttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-hdfs-azure-storage
Migrate Netezza data to Azure with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-netezza-azure-sqldw
Migrate data from Amazon S3 to Azure Storage with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-s3-azure-storage
Dedupe rows and detect nulls using ADF data flow snippetshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-data-flow-dedupe-nulls-snippets
Handle error rows and truncation in ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-data-flow-error-rows
Implement BCDR strategies for Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/pipelines-disaster-recovery
Apply advanced SAP CDC features and best practiceshttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-advanced-topics
Apply data flow best practices for writing to data lakehttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-data-flow-write-to-lake

Decision Making

TopicURL
Use automatic connector upgrades in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/automatic-connector-upgrade
Interpret pricing examples for ADF integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/better-understand-different-integration-runtime-charges
Choose the right integration runtime architecturehttps://learn.microsoft.com/en-us/azure/data-factory/choose-the-right-integration-runtime-configuration
Choose compute environments for Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/compute-linked-services
Choose Azure Data Factory connector release stageshttps://learn.microsoft.com/en-us/azure/data-factory/connector-release-stages-and-timelines
Use connector upgrade advisor for ADF and Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/connector-upgrade-advisor
Decide how and when to upgrade ADF connectorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-upgrade-guidance
Buy and use ADF data flow reserved capacity for cost savingshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-reserved-capacity-overview
Plan data lake and EDW migration to Azure with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-overview
Answer common Azure Data Factory usage questionshttps://learn.microsoft.com/en-us/azure/data-factory/frequently-asked-questions
Assess Azure Data Factory pipelines for Fabric migrationhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-assess-your-azure-data-factory-to-fabric-data-factory-migration
Choose and provision Enterprise Edition Azure-SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-azure-ssis-ir-enterprise-edition
Assess and upgrade Azure Data Factory pipelines to Fabrichttps://learn.microsoft.com/en-us/azure/data-factory/how-to-upgrade-your-azure-data-factory-pipelines-to-fabric-data-factory
Modernize Azure Synapse pipelines to Fabric Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-upgrade-your-azure-synapse-analytics-pipelines-to-fabric-data-factory
Plan and manage Azure Data Factory costshttps://learn.microsoft.com/en-us/azure/data-factory/plan-manage-costs
Assess and plan SSIS migration to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/scenario-ssis-migration-overview
Apply SSIS migration assessment rules for ADF/Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/scenario-ssis-migration-rules

Architecture & Design Patterns

TopicURL
Design efficient pipelines using mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-pipelines
Configure Azure-SSIS IR with SQL failover groupshttps://learn.microsoft.com/en-us/azure/data-factory/configure-bcdr-azure-ssis-integration-runtime
Build metadata-driven large-scale copy pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/copy-data-tool-metadata-driven
Migrate Azure SQL schemas to Azure Cosmos DB with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-sqldb-to-cosmosdb
Use Azure SQL Managed Instance with Azure-SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-use-sql-managed-instance-with-ir
Decide when and how to join Azure-SSIS integration runtime to a virtual networkhttps://learn.microsoft.com/en-us/azure/data-factory/join-azure-ssis-integration-runtime-virtual-network
Understand architecture of SAP CDC in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-introduction-architecture

Limits & Quotas

TopicURL
Understand reservation discounts for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-understand-reservation-charges

Security

TopicURL
Allow Azure Integration Runtime IP ranges through firewallshttps://learn.microsoft.com/en-us/azure/data-factory/azure-integration-runtime-ip-addresses
Configure VNet injection for Azure-SSIS IR securelyhttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-virtual-network-configuration
Configure roles and permissions for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-roles-permissions
Configure outbound FQDN allow lists with Azure Policy for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/configure-outbound-allow-list-azure-policy
Use Azure credentials and managed identities in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/credentials
Plan secure data access strategies for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-access-strategies
Configure Azure Private Link for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-private-link
Configure managed identities for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-service-identity
Security infrastructure and data movement in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/data-movement-security-considerations
Enable Microsoft Entra authentication for Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/enable-aad-authentication-azure-ssis-ir
Enable customer-managed keys (BYOK) for ADF encryptionhttps://learn.microsoft.com/en-us/azure/data-factory/enable-customer-managed-key
Encrypt credentials for self-hosted integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/encrypt-credentials-self-hosted-integration-runtime
Access secured Purview from Data Factory via private endpointshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-access-secured-purview-account
Use Azure Key Vault secrets in ADF pipeline activitieshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-use-azure-key-vault-secrets-pipeline-activities
Join Azure-SSIS IR to VNet using PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/join-azure-ssis-integration-runtime-virtual-network-powershell
Join Azure-SSIS IR to VNet via portalhttps://learn.microsoft.com/en-us/azure/data-factory/join-azure-ssis-integration-runtime-virtual-network-ui
Use managed virtual networks and private endpoints in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/managed-virtual-network-private-endpoint
Use built-in Azure Policy definitions for Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/policy-reference
Secure Azure Data Factory with network and identity controlshttps://learn.microsoft.com/en-us/azure/data-factory/secure-your-azure-data-factory
Detect and mask PII data with ADF solution templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-pii-detection-and-masking
Configure Windows authentication for SSIS packages in Azurehttps://learn.microsoft.com/en-us/azure/data-factory/ssis-azure-connect-with-windows-auth
Store ADF credentials securely in Azure Key Vaulthttps://learn.microsoft.com/en-us/azure/data-factory/store-credentials-in-key-vault
Use private endpoints to securely copy data with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-copy-data-portal-private
Configure Azure-SSIS integration runtime in virtual networkhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-deploy-ssis-virtual-network
Secure self-hosted integration runtime with TLS from intranethttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-enable-remote-access-intranet-tls-ssl-certificate
Secure on-prem SQL access via Data Factory managed VNethttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-on-premise-sql-server
Configure private endpoint access to SQL Managed Instance from Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-sql-managed-instance

Configuration

TopicURL
Define and use global parameters in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/author-global-parameters
Configure connections and global settings in ADF management hubhttps://learn.microsoft.com/en-us/azure/data-factory/author-management-hub
Configure express virtual network injection for Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-express-virtual-network-injection
Manage SSIS packages with Azure-SSIS package storehttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-package-store
Configure standard virtual network injection for Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-standard-virtual-network-injection
Reference built-in and preinstalled components on Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/built-in-preinstalled-components-ssis-integration-runtime
Define and configure datasets in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-datasets-linked-services
Configure integration runtimes in Data Factory and Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime
Define and configure linked services in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-linked-services
Override default ARM template parameters for ADF CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-resource-manager-custom-parameters
Configure Append Variable activity in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-append-variable-activity
Configure Data Flow activity executionhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-execute-data-flow-activity
Configure Execute Pipeline activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-execute-pipeline-activity
Use Azure Data Factory expression language and functionshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-expression-language-functions
Use Fail activity to raise custom errors in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-fail-activity
Configure Filter activity for arrays in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-filter-activity
Configure ForEach activity loops in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-for-each-activity
Use Get Metadata activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity
Configure If Condition activity in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-if-condition-activity
Configure Lookup activity for external data in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-lookup-activity
Use Power Query activity for data wranglinghttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-power-query-activity
Use Set Variable activity and pipeline return valueshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-set-variable-activity
Configure Switch activity for conditional routing in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-switch-activity
Use system variables in Azure Data Factory expressionshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-system-variables
Configure Until activity loops in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-until-activity
Configure Validation activity for dataset readiness in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-validation-activity
Use Wait activity to pause Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-wait-activity
Enable data consistency verification in ADF copyhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-data-consistency
Configure fault tolerance for Copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-fault-tolerance
Configure session logging for Copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-log
Configure monitoring for ADF copy activitieshttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-monitoring
Configure Copy activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-overview
Use Copy activity performance optimization featureshttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-features
Preserve metadata and ACLs in ADF copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-preserve-metadata
Configure schema and data type mapping in Copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-schema-and-type-mapping
Use the Copy Data tool in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/copy-data-tool
Create and configure Azure integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-integration-runtime
Provision Azure-SSIS integration runtime in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime
Create Azure-SSIS integration runtime via Azure portalhttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-portal
Create Azure-SSIS integration runtime via PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-powershell
Deploy Azure-SSIS IR using ARM templateshttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-resource-manager-template
Create and configure self-hosted integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime
Create shared self-hosted IR with PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/create-shared-self-hosted-integration-runtime-powershell
Configure cross-tenant Azure DevOps connections for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/cross-tenant-connections-to-azure-devops
Configure Aggregate transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-aggregate
Use Alter Row transformation for database updateshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-alter-row
Configure Assert transformation for data quality checkshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-assert
Use Cast transformation to change column data typeshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-cast
Configure Conditional Split transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-conditional-split
Configure Derived Column transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-derived-column
Configure Exists transformation for row matchinghttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-exists
Configure Filter transformation for row selectionhttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-filter
Configure Flatten transformation for hierarchical datahttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-flatten
Use Flowlet transformation for reusable logic in data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-flowlet
Configure Join transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-join
Configure Lookup transformation for reference data in data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-lookup
Configure multiple branches in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-new-branch
Author and configure mapping data flow scripthttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-script
Configure Select transformation in ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-select
Configure source transformation in ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-source
Configure Delete activity for file cleanuphttps://learn.microsoft.com/en-us/azure/data-factory/delete-activity
Configure Avro format options in ADF and Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/format-avro
Configure binary dataset format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-binary
Configure Common Data Model format in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-common-data-model
Configure delimited text datasets in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-delimited-text
Configure Delta Lake format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-delta
Configure Excel file format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-excel
Configure Iceberg table format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-iceberg
Configure JSON file format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-json
Configure ORC format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-orc
Configure Parquet format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-parquet
Configure XML format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-xml
Configure Bring Your Own Driver connectors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/guidance-for-byod-approach
Customize Azure-SSIS integration runtime setup with additional componentshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-azure-ssis-ir-custom-setup
Configure SHIR for Azure Log Analytics collectionhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-shir-for-log-analytics-collection
Configure custom Event Grid triggers for Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-custom-event-trigger
Create storage event-based triggers in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-event-trigger
Configure schedule triggers in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-schedule-trigger
Configure tumbling window triggers in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-tumbling-window-trigger
Develop and install licensed SSIS IR components in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-develop-azure-ssis-ir-licensed-components
Use parameters and expression language in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-expression-language-functions
Manage Azure Data Factory studio settings and preferenceshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-manage-settings
Control Azure Data Factory studio preview experiencehttps://learn.microsoft.com/en-us/azure/data-factory/how-to-manage-studio-preview-exp
Run self-hosted IR in Windows containershttps://learn.microsoft.com/en-us/azure/data-factory/how-to-run-self-hosted-integration-runtime-in-windows-container
Schedule start and stop of Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/how-to-schedule-azure-ssis-integration-runtime
Use trigger metadata parameters in ADF pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-use-trigger-parameterization
Reconfigure Azure-SSIS integration runtime settingshttps://learn.microsoft.com/en-us/azure/data-factory/manage-azure-ssis-integration-runtime
Configure diagnostic settings and Log Analytics for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-configure-diagnostics
Monitor Azure Data Factory with Azure Monitorhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-data-factory
Use monitoring reference data for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-data-factory-reference
Configure monitoring for Azure Data Factory integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-integration-runtime
Monitor integration runtimes in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-integration-runtime
Set up ADF diagnostic logs via Azure Monitor REST APIhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-logs-rest
Configure monitoring for managed VNet integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-managed-virtual-network-integration-runtime
Monitor SHIR Azure VMs with diagnosticshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-shir-in-azure
Monitor SSIS operations in ADF using Azure Monitorhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-ssis
Visually monitor pipelines and activities in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-visually
Apply naming rules for Azure Data Factory artifactshttps://learn.microsoft.com/en-us/azure/data-factory/naming-rules
Parameterize linked services in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/parameterize-linked-services
Parameterize mapping data flows from ADF pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/parameters-data-flow
Operate and configure SAP CDC processes in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-management
Set up SAP CDC linked service and datasethttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-prepare-linked-service-source-dataset
Configure prerequisites for the SAP CDC connectorhttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-prerequisites-configuration
Configure self-hosted IR for SAP CDC connectorhttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-shir-preparation
Configure SHIR autoupdate and expiry notificationshttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-auto-update
Configure self-hosted integration runtime as proxy for Azure-SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-proxy-ssis
Configure source control for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/source-control
Supported file formats and compression in ADF copyhttps://learn.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs
Configure tumbling window trigger dependencies in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/tumbling-window-trigger-dependency
Return values from child pipelines in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-pipeline-return-value

Integrations & Coding Patterns

TopicURL
Configure SAP CDC connector to load data into Fabric OneLakehttps://learn.microsoft.com/en-us/azure/data-factory/change-data-capture-from-sap-to-onelake-with-azure-data-factory
Use expression builder for ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-expression-builder
Connect Azure Data Factory to Microsoft Purviewhttps://learn.microsoft.com/en-us/azure/data-factory/connect-data-factory-to-azure-purview
Configure ADF connector for Amazon Marketplace Web Servicehttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-marketplace-web-service
Integrate Amazon RDS for Oracle with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-rds-for-oracle
Copy data from Amazon RDS for SQL Server with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-rds-for-sql-server
Copy data from Amazon Redshift using ADF/Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-redshift
Copy data from S3-compatible storage using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-s3-compatible-storage
Copy and transform data in Amazon S3 with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-simple-storage-service
Transform AppFigures data with ADF Data Flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-appfigures
Transform Asana data with ADF Data Flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-asana
Copy and transform data in Azure Blob Storage with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-blob-storage
Transform Azure Cosmos DB analytical store data with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-cosmos-analytical-store
Copy and transform data in Azure Cosmos DB for NoSQLhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-cosmos-db
Copy data to and from Azure Cosmos DB for MongoDBhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-cosmos-db-mongodb-api
Copy and transform data in Azure Data Explorer with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-explorer
Copy and transform data in Azure Data Lake Storage Gen2https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-lake-storage
Copy data to and from Azure Data Lake Storage Gen1https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-lake-store
Copy data from Azure Database for MariaDB using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-database-for-mariadb
Copy and transform data in Azure Database for MySQL with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-database-for-mysql
Copy and transform data in Azure Database for PostgreSQLhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-database-for-postgresql
Copy data to and from Azure Databricks Delta Lake with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-databricks-delta-lake
Copy data to and from Azure Files using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-file-storage
Copy data into Azure Search index using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-search
Copy and transform data in Azure Synapse Analytics with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-sql-data-warehouse
Copy and transform data in Azure SQL Database with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-sql-database
Copy and transform data in Azure SQL Managed Instancehttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-sql-managed-instance
Copy data to and from Azure Table storage using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-table-storage
Copy data from Cassandra using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-cassandra
Integrate Azure Data Factory with Concur sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-concur
Integrate Azure Data Factory with Couchbase sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-couchbase
Transform data in data.world using Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-dataworld
Configure DB2 connector for Azure Data Factory copyhttps://learn.microsoft.com/en-us/azure/data-factory/connector-db2
Integrate Azure Data Factory with Apache Drillhttps://learn.microsoft.com/en-us/azure/data-factory/connector-drill
Copy data from Dynamics AX using Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-ax
Copy and transform Dynamics 365/Dataverse data with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-crm-office-365
Copy data to and from file systems with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-file-system
Copy data from FTP servers using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-ftp
Connect Azure Data Factory CDM to GitHubhttps://learn.microsoft.com/en-us/azure/data-factory/connector-github
Configure Google Ads connector for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-adwords
Copy data from Google BigQuery V2 with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-bigquery
Copy data from Google BigQuery V1 with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-bigquery-legacy
Copy data from Google Cloud Storage using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-cloud-storage
Transform data in Google Sheets using Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-sheets
Configure Greenplum connector for Azure Data Factory copyhttps://learn.microsoft.com/en-us/azure/data-factory/connector-greenplum
Integrate Azure Data Factory with HBase sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-hbase
Copy data from HDFS with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-hdfs
Copy data from Hive using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-hive
Copy data from HTTP endpoints with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-http
Copy data from HubSpot using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-hubspot
Integrate Azure Data Factory with Impala sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-impala
Copy data to and from IBM Informix using Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-informix
Configure Azure Data Factory Jira connector for copyhttps://learn.microsoft.com/en-us/azure/data-factory/connector-jira
Copy data from Magento using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-magento
Copy data from MariaDB using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mariadb
Copy data from Marketo using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-marketo
Copy data to and from Microsoft Access using Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-access
Copy and transform data in Microsoft Fabric Lakehousehttps://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-fabric-lakehouse
Copy and transform data in Microsoft Fabric Warehousehttps://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-fabric-warehouse
Copy data to and from MongoDB using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mongodb
Configure Azure Data Factory MongoDB Atlas connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mongodb-atlas
Use legacy MongoDB connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mongodb-legacy
Use Azure Data Factory MySQL connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mysql
Configure Azure Data Factory Netezza connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-netezza
Configure Azure Data Factory OData connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-odata
Use ODBC connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-odbc
Copy and transform Microsoft 365 data with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-office-365
Configure Azure Data Factory Oracle connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle
Connect Azure Data Factory to Oracle Cloud Storagehttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-cloud-storage
Connect Azure Data Factory to Oracle Eloquahttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-eloqua
Connect Azure Data Factory to Oracle Responsyshttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-responsys
Connect Azure Data Factory to Oracle Service Cloudhttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-service-cloud
Connect Azure Data Factory to PayPal datahttps://learn.microsoft.com/en-us/azure/data-factory/connector-paypal
Use Azure Data Factory Phoenix connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-phoenix
Use PostgreSQL V2 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-postgresql
Use PostgreSQL V1 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-postgresql-legacy
Use Azure Data Factory Presto connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-presto
Transform Quickbase data with ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-quickbase
Connect Azure Data Factory to QuickBooks Onlinehttps://learn.microsoft.com/en-us/azure/data-factory/connector-quickbooks
Use REST connector for copy and transform in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-rest
Use Salesforce V2 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce
Use Salesforce V1 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-legacy
Connect Azure Data Factory to Salesforce Marketing Cloudhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-marketing-cloud
Use Salesforce Service Cloud V2 connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-service-cloud
Use Salesforce Service Cloud V1 connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-service-cloud-legacy
Copy from SAP BW using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-business-warehouse
Copy from SAP BW via Open Hub using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-business-warehouse-open-hub
Transform SAP ODP data with SAP CDC connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-change-data-capture
Copy data to and from SAP Cloud for Customerhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-cloud-for-customer
Copy data from SAP ECC with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-ecc
Configure SAP HANA connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-hana
Copy data from SAP tables using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-table
Configure ServiceNow V2 connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-servicenow
Use ServiceNow V1 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-servicenow-legacy
Copy and transform data via SFTP connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sftp
Copy data from SharePoint Online lists with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list
Connect Azure Data Factory to Shopify datahttps://learn.microsoft.com/en-us/azure/data-factory/connector-shopify
Transform Smartsheet data with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-smartsheet
Configure Snowflake V2 connector and data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake
Use Snowflake V1 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake-legacy
Configure Spark connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-spark
Configure Azure Data Factory SQL Server connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sql-server
Set up Azure Data Factory Square connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-square
Configure Sybase connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sybase
Use TeamDesk connector for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-teamdesk
Configure Azure Data Factory Teradata Vantage connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-teradata
Use Twilio connector for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-twilio
Configure Vertica connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-vertica
Configure Web Table connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-web-table
Configure Azure Data Factory Xero connector for copyhttps://learn.microsoft.com/en-us/azure/data-factory/connector-xero
Use Zendesk connector for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-zendesk
Configure Zoho connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-zoho
Configure Azure Function activity in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-azure-function-activity
Call REST endpoints with Web activityhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-web-activity
Configure Webhook activity for callback control in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-webhook-activity
Deploy and run SSIS packages on Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-deploy-packages
Apply aggregate functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-aggregate-functions
Use array functions in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-array-functions
Use cached lookup functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-cached-lookup-functions
Use conversion functions in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-conversion-functions
Use date and time functions in ADF mapping flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-date-time-functions
Use expression functions in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-expression-functions
Reference for all ADF mapping data flow functionshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-expressions-usage
Call external endpoints from mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-external-call
Use map functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-map-functions
Use metafunctions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-metafunctions
Configure parse transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-parse
Use pivot transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-pivot
Configure rank transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-rank
Configure sink transformation targets in ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-sink
Use sort transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-sort
Stringify complex data types in ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-stringify
Generate surrogate keys in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-surrogate-key
Union multiple streams in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-union
Use unpivot transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-unpivot
Configure window transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-window
Use window functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-window-functions
Use mapping data flow transformation functionshttps://learn.microsoft.com/en-us/azure/data-factory/data-transformation-functions
Automate SSISDB log cleanup with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-clean-up-ssisdb-logs-with-elastic-jobs
Integrate Azure Data Factory with Microsoft Purviewhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-discover-explore-purview-data
Process fixed-width text files with ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-fixed-width
Configure ADF Copy activity to ingest data into Fabrichttps://learn.microsoft.com/en-us/azure/data-factory/how-to-ingest-data-into-fabric-from-azure-data-factory
Execute SSIS packages with Azure-enabled dtexec utilityhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-azure-enabled-dtexec
Run SSIS packages via Azure SQL MI Agenthttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-managed-instance-agent
Execute SSIS packages in Azure from SSDThttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-ssdt
Run SSIS packages via Execute SSIS Package activity in portalhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-ssis-activity
Execute SSIS packages with ADF activity and PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-ssis-activity-powershell
Run SSIS packages using Stored Procedure activity in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-stored-procedure-activity
Send email notifications from ADF and Synapse pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-send-email
Copy data from ADLS Gen1 to Gen2 with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/load-azure-data-lake-storage-gen2-from-gen1
Programmatically monitor Azure Data Factory pipelines via SDKshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-programmatically
Create Azure Data Factory via .NET SDKhttps://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-dot-net
Create Azure Data Factory with Python SDKhttps://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-python
Create Azure Data Factory via REST APIhttps://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-rest-api
Use Azure PowerShell scripts to manage Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/samples-powershell
Bulk copy from ADLS Gen2 files to Azure databases with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-bulk-copy-from-files-to-database
Bulk copy from databases using control tables in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-bulk-copy-with-control-table
Use ADF template to copy files from multiple containershttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-copy-files-multiple-containers
Copy new and changed files by LastModifiedDate in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-copy-new-files-last-modified-date
Transform data with Azure Databricks notebooks in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-databricks-notebook
Delta copy from databases using control table templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-delta-copy-with-control-table
Extract structured data from PDFs using ADF templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-extract-data-from-pdf
Migrate large S3 datasets to ADLS Gen2 templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-migration-s3-azure
Move files between file-based stores using ADF templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-move-files
Replicate multiple SAP objects via SAP CDC using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-replicate-multiple-objects-sap-cdc
Access on-premises and Azure files from SSIS in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/ssis-azure-files-file-shares
Run Databricks JAR jobs from Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-databricks-jar
Trigger Databricks Jobs from Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-databricks-job
Run Databricks notebooks from Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-databricks-notebook
Run Databricks Python scripts from Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-databricks-python
Execute Azure Machine Learning pipelines from Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-machine-learning-service
Run Synapse notebooks from Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-synapse-notebook
Trigger Synapse Spark job definitions in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-synapse-spark-job-definition
Use custom .NET activities in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-custom-activity
Run U-SQL scripts with Data Lake Analytics activityhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-data-lake-analytics
Run Hive queries with ADF HDInsight activityhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-hadoop-hive
Run Hadoop MapReduce jobs with ADF HDInsight activityhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-hadoop-map-reduce
Configure Hadoop Pig activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-hadoop-pig
Use Hadoop Streaming activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-hadoop-streaming
Use Script activity for SQL transformations in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-script
Run Spark activity in Azure Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-spark
Invoke stored procedures with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-stored-procedure
Use data wrangling functions in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/wrangling-functions

Deployment

TopicURL
Implement CI/CD for Azure Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery
Automate ADF CI/CD with Azure Pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-automate-azure-pipelines
Use hotfix production environments for ADF CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-hotfix-environment
Automate publishing for Azure Data Factory CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-improvements
Deploy Azure Data Factory with linked ARM templateshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-linked-templates
Manually promote ADF ARM templates across environmentshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-manual-promotion
Run pre- and post-deployment scripts for ADF CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-sample-script
Deploy linked ARM templates via Azure DevOps for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/deploy-linked-arm-templates-with-vsts
Migrate SSIS SQL Agent jobs to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-migrate-ssis-job-ssms
Automate self-hosted integration runtime installation with PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-automation-scripts
Migrate Azure integration runtime to managed virtual networkhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-migrate