Job Information
IBM Databricks Engineer L3 in GUADALAJARA, Mexico
Introduction
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
Your role and responsibilities
As an associate Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing.
Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets.
In this role, your responsibilities may include:
Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques
Designing and implementing various enterprise seach applications such as Elasticsearch and Splunk for client requirements
Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviors.
Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modeling results
Develop and maintain data processing pipelines using Databricks.
Work with big data technologies to optimize data analysis and pipeline performance.
Collaborate with data science and engineering teams to integrate Databricks solutions into existing systems.
Support data engineers, data scientists, and analysts with advanced querying tools and data visualization services.
Implement and troubleshoot data governance and security best practices.
Required technical and professional expertise
Strong experience in data engineering with data warehousing and big data technologies.
Proficiency in SQL, Python, and PySpark.
Experience with cloud-based data services, particularly Databricks.
Strong problem-solving skills and attention to detail.
Preferred technical and professional experience
Preferred experience: knowledgeable on design, creation and execution of functional and/or non-functional test cases; experience with tool (or similar tools) such as: Confluence, JIRA, Selenium, Test Data Management Tools, Performance Testing Tools
Exposure to at least one cloud platform such as AWS, Azure, IBM, or Google Cloud
Familiarity with data quality analysis, and testing skills in API, ETL and SQL
Exposure to basic data science concepts
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.