Job Information
IBM Big Data Engineer with Spark in Brasov, Romania
Introduction
We are currently hiring a Senior Data Engineer with Spark to join our IT Digital Marketing Solutions team to develop dynamic software solutions.
Your role and responsibilities
Your responsibilities will include:
Writing effective and scalable data processing code using Spark with Scala/Java/Python
Designing and implementing robust solutions
Debugging applications to ensure low-latency and high-availability (Docker / Kubernetes)
Interfacing with developed API and building Rest API
Implementing and refactoring ETL processes (Airflow)
Implementing security and data protection (HVault)
Accommodating various data storage solutions (COS API, Cassandra)
Required technical and professional expertise
Proficiency in data processing with Apache Spark (Scala/Java)
Work experience with Docker/Kubernetes
Experience in implementing and refactoring ETL processes (Arflow / Python)
Experience in implementing security and data protection (HVault)
Previous work experience with: SQL, COS API, Cassandra
Preferred technical and professional experience
Nice to have: Kafka, GitLab, Jenkins
French: fluent
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.