Development Engineer 4 - Chennai, India - Comcast Corporation

Description

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast.

Job Summary

Responsible for planning and designing new software and web applications. Analyzes, tests and assists with the integration of new applications. Oversees the documentation of all development activity. Trains non-technical personnel. Assists with tracking performance metrics. Integrates knowledge of business and functional priorities. Acts as a key contributor in a complex and crucial environment. May lead teams or projects and shares expertise.

Job Description

Core Responsibilities

• Create and maintain an optimal data pipeline architecture focussed upon network data, including real-time and batch data sources.
• Assemble large, complex data sets that meet functional and non-functional business requirements.
• Build batch/streaming ELT/ETL solutions from a wide variety of data sources in varying formats (SQL, JSON, AVRO, HTTP, API, etc.) using the right blend of tools.
• Keep our data compliant, relevant and secured across multiple data centres and regions.
• Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery and evolving current solutions whilst ensuring continuity of service.
• Create data tools for data scientist team members that assist them in building and optimizing into an innovative industry leader.
• Guide and collaborate with data consumers on analytics, tooling and platform related queries.

What you'll bring

Graduate degree BSc in Computer Science, Electrical Engineering or similar. Strong communications skills. SQL knowledge and experience working with relational databases. Strong analytic skills related to working with structured and unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management. A successful history of manipulating, processing and extracting value from large, disconnected datasets. Hands-on experience in building scalable data platforms. Awareness of security practices and privacy concerns when working with data across both in-house and cloud platforms. Ideally an awareness of network technologies and concepts or an insatiable desire to learn. Key technologies

• Apache Airflow / NiFi / Kafka / ZooKeeper

• Confluent ecosystem (Connect / Schema Registry / ksqlDB)

• GCP (BigQuery, Dataflow, Pub/Sub, IAM)

• Linux / Terraform / Ansible

• Python / Docker (Nice to have)

Disclaimer:

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

7-10 Years