Job Information
Comcast Development Engineer 3 in Chennai, India
Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast.
Job Summary
We are seeking an experienced Data Engineer that designs and builds scalable data pipelines, ingestion frameworks, and data platforms to enable reliable, high-quality data for analytics and reporting. Ensures data quality across the lifecycle, develops standardized data access methods (views, extracts, APIs), and supports data lakes/warehouses across on-prem and cloud environments. Collaborates with cross-functional teams to optimize data processing, maintain data lineage, and uphold data governance, privacy, and security standards.
Job Description
Responsibilities:
Develops data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs
Focuses on ensuring data quality during ingest, processing as well as final load to the target tables.
Creates standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed.
Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces.
Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces.
Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks.
Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements.
Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes.
Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization.
Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
Develops strategies for data acquisition, archive recovery, and database implementation.
Manages data migrations/conversions and troubleshooting data processing issues.
Understands the data sensitivity, customer data privacy rules and regulations and applies them consistently in all Information Lifecycle Management activities.
Identifies and reacts to system notification and log to ensure quality standards for databases and applications. Solves abstract problems beyond single development language or situation by reusing data file and flags already set.
Solves critical issues and shares knowledge such as trends, aggregate, quantity volume regarding specific data sources.
Consistent exercise of independent judgment and discretion in matters of significance.
Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
Other duties and responsibilities as assigned.
Tech Skills
Big Data Architecture, AWS, Python, SQL, Apache Spark, Data Modeling, Data Pipeline design, Kafka / Kinesis (Streaming), Apache AirFlow, Github, CI/CD (Concourse preferred), AWS S3, MinIO, Tableau, Databricks (preferred), Performance tuning, Jira (ticketing), Shell commands, Data Governance & Best practices.
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.
Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary (https://jobs.comcast.com/benefits) on our careers site for more details.
Education
Bachelor's Degree
While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.
Relevant Work Experience
5-7 Years
Job Family Group: Engineering