Azure data factory developer with Snowflake exp Job at CLOUDSCOUTS SOFTWARE SOLUTIONS LLC, Frisco, TX

clhsNEZtTGI4QjJDZDUvTkw2WW0zMGhB
  • CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
  • Frisco, TX

Job Description

Job Description

Job Description

6+ years of ADF data flows/Snowflake. if you just worked on ADF pipelines, this is not for you.

An Azure Data Factory (ADF) Integration Developer is responsible for building, maintaining, and optimizing data pipelines and integration solutions using Microsoft Azure Data Factory . This role is key in data engineering and ETL (Extract, Transform, Load) processes in a cloud-based environment.

Key Responsibilities:

  1. Design and Develop Data Pipelines

    • Build end-to-end data workflows using ADF (v2) for batch and real-time data processing.

    • Create and manage Linked Services, Datasets, Pipelines , Activities , and Triggers .

  2. Data Integration

    • Integrate data from multiple sources like SQL Server, Azure Blob Storage, Azure Synapse, REST APIs, SAP, Salesforce, etc.

    • Handle structured and unstructured data using Data Flows , Mapping Data Flows , or custom transformations.

  3. ETL/ELT Development

    • Implement data transformations using Azure Data Flows , Stored Procedures , or Azure Functions .

    • Optimize performance and cost using best practices.

  4. Monitoring and Troubleshooting

    • Set up pipeline monitoring, alerts, and logs using ADF Monitoring and Azure Monitor.

    • Debug failures and optimize pipeline performance.

  5. CI/CD and DevOps

    • Use Azure DevOps or Git integration for version control, build, and release pipelines.

    • Implement ARM templates for infrastructure as code (IaC).

  6. Security and Governance

    • Manage access through Azure RBAC , Key Vault , and Managed Identity .

    • Ensure compliance and data security standards.

  7. Collaboration

    • Work closely with Data Architects, Business Analysts, and BI developers.

    • Translate business requirements into technical solutions.

Required Skills and Technologies:

  • Azure Data Factory

  • Azure Synapse Analytics , Azure SQL

This is a remote position.

Job Tags

Remote work,

Similar Jobs

Bjak

Founding AI Engineer (Remote) Job at Bjak

 ...from Model to UI - and Everything in Between At BJAK, were using AI to reinvent how financial services work across Southeast Asia -...  ..., simpler, and more inclusive. As a Founding Full Stack AI Engineer, youll bridge machine learning and software engineering to deliver... 

UWorld, LLC

Copy Editor/Curriculum Editor Job at UWorld, LLC

 ...global leader in online test prep materials that helps students excel on high stakes exams, is seeking a first-rate general content editor with a wide range of interests and abilities. In addition to editing the questions and detailed explanations written by our teams... 

AppliedVR

1099 Independent Medical Device Sales Representative Job at AppliedVR

 ...RelieVRx is the first VR-based, prescription therapeutic to receive Breakthrough Therapy Designation and De Novo authorization by the FDA for chronic lower back pain (CLBP). CLBP affects 45 million people in the U.S. alone. We are poised to help millions more through our... 

Sanford Health

RN Clinical Educator Job at Sanford Health

 ...Careers With Purpose Sanford Health is one of the largest and fastest-growing...  ...* Opportunity to influence the education strategic plan for the market and region...  ...partners, educational facilities, and/or other community agencies and consortium institutions when... 

CEI

AI Prompt Engineer Job at CEI

 ...Job Description Job Description Prompt and Context Engineer Job Details: Location: Remote (U.S.) EST or CST time zone preferred...  ...Holders preferred Experience Required: Minimum 2 years in AI/ML, NLP, or LLM development Job Summary: We are looking for...