Job Information
TAD PGS, Inc. Technical Lead Cloud Data Engineering in United States
We have an outstanding Contract position for aTechnical Lead ? Cloud Data Engineeringto join a leading Company.This position is fully remote.
Pay Rate: $77.08
US Citizenship is required.
Candidate must have the ability to obtain and maintain a Public Trust.
We are seeking a customer-experience-focused Technical Lead ? Cloud Data Engineering to lead a team of developers in the design and implementation of data engineering solutions for Azure Cloud-based Data Lake , SQL, and NoSQL data stores. As a technical lead, you will work directly with end users to translate business requirements into cloud data engineering to support an enterprise-scale Microsoft Azure-based data analytics and reporting platform. Our ideal candidate is mission-focused and delivery-oriented, and applies critical thinking, including the use of AI concepts, to create innovative functions and solve technical issues.
Responsibilities :
Work directly with business users to understand data requirements, and develop, deliver, and maintain appropriate data solutions.
Lead a team of data engineering developers to implement Azure Data Lake-based ETL/ELT/data pipelines, data extracts, and API based data delivery.
Ensure continued legacy EDW development and operations utilizing Microsoft SQL Server, SSIS, SSRS, SSAS, PowerShell, and related technologies.
Drive migration of legacy EDW platform data workloads to the new Azure Cloud Data Lake platform.
Define ETL performance testing scope, benchmark workloads against legacy EDW baselines, validate SLA-compliant data loads, and optimize throughput to ensure scalable cloud performance.
Work with IT infrastructure, DevOps, Data Engineers, Modelers, and Architects to optimize pipelines in the test environment, test design, test execution, resolve issues, perform optimization, and tuning.
Support the design and implementation of data models and data pipelines for relational, dimensional, data Lakehouse (Medallion architecture), data warehouse, data mart, SQL, and NoSQL data stores.
Utilize Microsoft Azure services, including Azure Data Lake Storage Gen2, Azure SQL Managed Instance, Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures, and Azure OpenAI to develop cloud native data solutions.
Prepare data required for advanced analytics, visualization, reporting, data extracts, and AI/ML.
Develop and implement processes, procedures, and checklists to guide the development and operations of the legacy EDW platform and the modernized Azure platform.
Implement data migration, data integrity, data quality, metadata management, performance management, audit data capture, and data security functions.
Monitor and troubleshoot data-related issues to maintain high availability and performance.
Implement governance, build, deployment, and monitoring to automate platform operation.
Actively support Agile DevOps process, including Program Increment planning.
Actively engage in continuous learning to increase relevant skills.
Maintain strict versioning and configuration control to ensure the integrity of data.
Basic Hiring Criteria :
US Citizenship and the ability to successfully obtain government-issued Public Trust clearance.
Bachelor's degree (BS) in Computer Science or related field and 9+ years of experience.
Minimum 5 years of proven experience leading a team supporting enterprise data warehousing using Microsoft data warehousing and reporting solutions.
Minimum 5 years of experience working directly with clients to understand data needs, develop and deliver solutions (data engineering, reports, dashboards, data extracts), and provide continued support.
Minimum 5 years of strong experience in ETL performance testing for traditional EDW and Azure Cloud Data platforms with the use of tools such as JMeter, Native Azure Tools like Azure App Testing, Azure Monitor + Log Analytics, Spark UI + Ganglia for Lakehouse Performance.
Minimum 5 years of experience delivering solutions using Microsoft database, ETL/ELT, and business intelligence tools, including SQL Server (e.g., stored procedures), SSIS, SSRS, and SSAS (cubes).
Minimum 5 years of experience with more than one of the following scripting languages: SQL, T-SQL, Python, PySpark, PowerShell.
Minimum 3 years of experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, and Integration Runtime.
Experience with data management and engineering best practices, including system development lifecycle, configuration control, change management, quality assurance, performance management, and documentation support.
Experience in Agile projects, working with a multi-functional team.
Must be detail-oriented and able to support multiple projects and tasks.
Demonstrate continuous learning to increase relevant skills.
Demonstrated experience in supporting production, testing, integration, and development environments.
Open mindset, ability to quickly adapt to new technologies to solve customer problems.
Desired Qualifications :
Experience working with data in law, HR, financial management, inventory, property, and management domains.
Experience working on Federal government projects with at least an active Public Trust Clearance
Experience working with Azure DevOps.
Microsoft certification in Azure fundamentals, data engineering, AI, and data analytics solutions.
Benefits offered to vary by the contract. Depending on your temporary assignment, benefits may include direct deposit, free career counseling services, 401(k), select paid holidays, short-term disability insurance, skills training, employee referral bonus, affordable medical coverage plan, and DailyPay (in some locations). For a full description of benefits available to you, be sure to talk with your recruiter.
Military connected talent encouraged to apply.
VEVRAA Federal Contractor / Request Priority Protected Veteran Referrals / Equal Opportunity Employer / Veterans / Disabled
To read our Candidate Privacy Information Statement, which explains how we will use your information, please visithttp://www.tadpgs.com/candidate-privacy/orhttps://pdsdefense.com/candidate-privacy/
The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:
The California Fair Chance Act
Los Angeles City Fair Chance Ordinance
Los Angeles County Fair Chance Ordinance for Employers
San Francisco Fair Chance Ordinance