Data Engineer (Data Warehouse, ADF, Stored Procedures) | REMOTE Job at Kaav Inc., Minneapolis, MN

  • Kaav Inc.
  • Minneapolis, MN

Job Description

Data Engineer100% TelecommuteWork Hours: 9am-5pm CSTProject:As a member of the Data Management team, the Data Engineer supports the Alabama EDS by developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance.The Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications.Responsibilities:Develop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfacedEfficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end usersAssist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flowsInvestigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutionsDeveloping ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsetsDeveloping idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and PipelinesAbility to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problemsCapturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using TasksOptimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responsesMust have the ability to build a highly efficient orchestrator that can schedule jobs, execute workflows, perform Data quality checks, and coordinate dependencies among tasksResponsible for testing of ETL system code, data design, and pipelines and data flows. Root cause analysis on all processes and resolving production issues are also a part of the process and routine tests on databases and data flow and pipeline testingResponsible for documenting the implementations, and test cases as well as responsible for building deployment documents needed for CI/CDIdeal Background: Data Engineer with Healthcare (Medicaid) and Microsoft Azure based experience with Snowflake and Azure Data Factory TOP REQUIREMENTS:5+ years of Data engineering experience with a focus on Data Warehousing2+ years of experience creating pipelines in Azure Data Factory (ADF)3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQLRequired:5+ years of Data engineering experience with a focus on Data Warehousing2+ years of experience creating pipelines in Azure Data Factory (ADF)5+ years developing ETL using Informatica PowerCenter, SSIS, Azure Data Factory, or similar tools.5+ years of experience with Relational Databases, such as Oracle, Snowflake, SQL Server, etc.3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL2+ years of experience with GitHub, SVN, or similar source control systems2+ years of experience processing structured and un-structured data.Experience with HL7 and FHIR standards, and processing files in these formats.3+ years analyzing project requirements and developing detailed specifications for ETL requirements.Excellent problem-solving and analytical skills, with the ability to troubleshoot and optimize data pipelines.Ability to adapt to evolving technologies and changing business requirements.Bachelors or Advanced Degree in a related field such as Information Technology/Computer Science, Mathematics/Statistics, Analytics, BusinessPreferred:2+ years of batch or PowerShell scripting2+ years of experience with Python scripting.3+ years of data modeling experience in a data warehouse environmentExperience or familiarity with Informatica Intelligent Cloud Services (specifically Data Integration)Experience designing and building APIs in Snowflake and ADF (e.g. REST, RPC)Experience with State Medicaid / Medicare / Healthcare applicationsAzure certifications related to data engineering or data analytics.Required Skills : Data AnalysisBasic Qualification :Additional Skills : AnalystThis is a high PRIORITY requisition.

Job Tags

Similar Jobs

Sheetz, Inc

Store Team Member - #747 Job at Sheetz, Inc

 ...Overview: \n Got high-energy and love to hustle? Come join the fast-paced, FUN work atmosphere as a Store Team Member and MAKE SHEETZ HAPPEN!\n \n We call this role a team member because thats what youre in for: a team culture where youll find your people... 

CHRISTUS Health

RN, Registered Nurse - 2N - OR - PRN-Weekend shift 3 p.m.-12 a.m. Job at CHRISTUS Health

 ...preferred Experience ~1 year of experience in the related nursing specialty preferred Licenses, Registrations, or Certifications BLS required RN License in state of employment or compact Work Schedule: PRN Work Type: Per Diem As Needed

Wellstar Health Systems, Inc.

Part Time Physical Therapist Inpatient Rehab Unit Job at Wellstar Health Systems, Inc.

 ...Day (United States of America) Job Summary: The physical therapist assesses, plans, organizes and participates in rehabilitative...  ...Planning and Provision of Care * Implements the physical therapy treatment plan * Selects appropriate treatment activities... 

Expedia

Software Development Engineer III Job at Expedia

At Expedia Group, we help travelers explore the world, one journey at a time. As a global travel company powered by passionate people, trusted partnerships, and leading technology, we connect travelers, partners, and advertisers through our consumer brands, B2B network,... 

Sherwin-Williams

Customer Service Delivery Driver Job at Sherwin-Williams

 ...timely manner using Company vans or pick-up trucks. Job duties involve contact with customers...  ...reports and other documents relating to deliveries Operate equipment and machines, such...  ...Must have a valid, unrestricted Driver's License Must be able, with or without...