Job Information
IBM Data Engineer Databricks in Cluj, Romania
Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.
Your role and responsibilities
The successful candidate will be responsible for designing, developing, and maintaining RESTful APIs, integrating APIs with various services, and implementing backend services. They will also develop ETL/ELT pipelines, create data models, and build and maintain Delta Lake tables. Additionally, they will define and enforce data architecture standards, data governance, quality, and archival strategies.
Required technical and professional expertise
Experience with designing, developing, and maintaining RESTful APIs using .NET Core or Python
Knowledge of integrating APIs with Azure Data Factory, Databricks, and downstream applications
Ability to implement authentication, authorization, error handling, and logging within backend services
Experience with developing ETL/ELT pipelines in Azure Data Factory and Databricks
Understanding of creating conceptual, logical, and physical data models
Preferred technical and professional experience
Experience with building and maintaining Delta Lake tables in ADLS
Knowledge of integrating usage history, weather data, pricing curves, and product terms into standardized data models
Ability to define and enforce data architecture standards, data governance, quality, and archival strategies
Familiarity with Azure Data Factory, Databricks, and ADLS
Strong understanding of data modeling and data engineering principles
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.