Job Information
Compass Minerals America Inc. Mgr Data Architecture & Engineering in Overland Park, Kansas
Description
Summary : The Data Architecture & Engineering Manager is responsible for the design, implementation, and operational excellence of the enterprise data platform. This role owns the overall data architecture and leads a team of data engineers as direct reports responsible for building and maintaining data solutions. The role combines strategic ownership of data architecture with hands on leadership of data engineering practices, ensuring a scalable, reliable, and well governed analytics environment. The manager establishes architectural standards, oversees medallion architecture implementation, and ensures high quality data transformations.
Essential Job Functions: Include but are not limited to the following:
(Management reserves the right to add or modify the duties and responsibilities at any time.)
Data Architecture & Platform Ownership
Own and evolve the enterprise data architecture within Microsoft Fabric, including: lakehouses, SQL endpoints, data warehouses, and the medallion architecture (Bronze, Silver, Gold)
Define and maintain enterprise data architecture principles that support scalability, governance, security, and evolving business needs across current and future technologies.
Establish and maintain the enterprise AI/ML data architecture strategy, ensuring data platforms, models, and pipelines effectively support machine learning, advanced analytics, and emerging AI use cases with appropriate scalability, security, and governance.
Evaluate and recommend data technologies, tooling, and architectural patterns to ensure long term platform sustainability and alignment with organizational strategy.
Act as the primary authority on data architecture decisions, balancing technical best practices with business, cost, and operational considerations.
Partner with analytics team and business stakeholders to ensure data models support reporting, analytics, and advanced use cases.
Data Engineering Leadership
Lead, mentor, and develop data engineering direct reports, providing technical guidance and setting clear priorities.
Assign and oversee engineering work related to data pipelines, transformations, and platform maintenance.
Establish and enforce engineering best practices including code quality standards, version control, testing and validation, and documentation
Perform design reviews and provide hands on guidance for complex pipelines or architectural decisions.
Data Pipelines & Transformations
Oversee data ingestion and transformation processes across the medallion layers.
Ensure data transformations are reliable, efficient, and well documented as data moves from raw to curated layers.
Optimize performance and cost of workloads and storage.
Monitor and troubleshoot data pipeline failures and performance issues.
Governance, Reliability, and Operations
Partner with security and governance teams to ensure appropriate data access controls and compliance.
Establish monitoring, alerting, and operational practices to ensure high availability and data quality.
Drive continuous improvement of data reliability, observability, and operational maturity.
Own and maintain deployment pipelines for data engineering solutions, ensuring consistent promotion across environments following established change control and release management processes.
Collaboration & Communication
Act as the primary point of accountability for the data platform and engineering outcomes.
Translate business and analytics requirements into scalable technical solutions.
Communicate architecture, tradeoffs, and progress clearly to both technical and non technical audiences.
Minimum Required Qualifications:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.
Education and/or Experience:
7+ years of experience in data engineering, data architecture, or related roles.
2+ years of experience leading or mentoring engineers.
Strong hands-on experience with Microsoft Fabric or related data technologies.
Proven experience designing and maintaining data transformation pipelines across multiple layers.
Demonstrated expertise in building production grade PySpark notebooks, including complex transformations, optimization for scale, reusable patterns, and troubleshooting distributed workloads.
Hands on experience using modern data developer tools such as Visual Studio Code, including notebook development, debugging, package management, and integration with version control.
Strong problem solving and stakeholder communication skills.
Familiarity with data governance, security, and compliance best practices.
Experience managing cloud based data platforms at scale preferred.
Experience supporting BI tools and downstream analytics workloads preferred.
Physical Requirements: The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Compass Minerals is an equal opportunity and affirmative action employer. We are firmly committed to making all employment-related decisions without regard to race, ancestry, ethnicity, color, religious creed or belief, national origin, sex (including sexual orientation, gender identity, and pregnancy and breastfeeding), age, military or veteran status, status as a qualified individual with a disability, genetic information, and any other characteristic protected by law. To request reasonable accommodations, email careers@compassminerals.com or call 913-344-9200. Learn more about equal employment opportunity laws at dol.gov (https://www.dol.gov/agencies/ofccp/posters) . Jan 2023
Equal Opportunity Employer
This employer is required to notify all applicants of their rights pursuant to federal employment laws.
For further information, please review the Know Your Rights (https://www.eeoc.gov/poster) notice from the Department of Labor.