Job Information
GAP Solutions Inc Databricks Platform Engineer in Atlanta, Georgia
Position Objective: In this position, you’ll drive the next generation of our analytics products by architecting and delivering end-to-end cloud analytics solutions. In a fully cloud-native environment, you’ll partner with product managers, data scientists, software engineers, ML engineers and business analysts to enable and support a platform that powers personalized experiences and operational efficiency. You’ll leverage automated model CI/CD, containerized deployments (Docker/Kubernetes), and real-time monitoring to ensure our ML systems are reliable, secure, and scalable.
You will be responsible for the design, implementation, and maintenance of the Databricks workspaces and its associated Azure infrastructure. You will manage and optimize data and machine learning workloads, ensuring a reliable, secure, and scalable platform for business analysts, data engineering and data science teams.
Candidate must be in Atlanta, GA area.
Duties and Responsibilities:
Lead the administration and governance framework of the platform regarding the security posture of the enterprise and its key stakeholders.
Design and implement automated solutions to streamline accounts and workspace administration.
Collaborate with cross-functional teams to understand business needs and translate them into ML solutions.
Mentor junior engineers and provide technical leadership in Databricks best practices and techniques.
Conduct cost and performance analysis of the various computes and data assets within the platform.
Stay current with the latest advancements in Databricks SQL, Machine Learning and AI, and integrate new technologies and methods as applicable.
Engage in knowledge sharing and contribute to building a strong, collaborative team environment.
Qualifications
Required Qualifications:
Bachelor's degree required
5+ years of experience with Databricks Account and Workspace Administration, including governance, configuration, and security management
Experience with optimizing Databricks environments for cost efficiency, performance, and reliability
Experience with developing and maintaining Databricks data pipelines using Autoloader, Delta Live Tables, and Databricks Workflows
Experience with implementing MLOps solutions using MLflow 2.0/3.0, Serving Endpoints, and Model Registry in production environments
Experience with Databricks SQL tools such as Queries and AI/BI Dashboards
Experience with large datasets and distributed computing across cloud platforms (AWS, GCP, Azure), including Azure services like Entra ID, Data Factory, Key Vault, and Purview
Knowledge of Unity Catalog Governance Architecture and enterprise data security best practices
Possession of strong communication and documentation skills with the ability to clearly convey complex technical concepts to both technical and non-technical audiences
Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
Preferred Qualifications:
Master's Degree preferred
Knowledge of Azure Cloud Networking concepts like VNET Injection
Databricks Platform Administrator Certification
Microsoft Certified: Azure Administrator Associate
*This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required by this position.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed above are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
GAP Solutions provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job, email us at recruiting@gapsi.com . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned.
Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by law.