Senior Data Engineer - Bengaluru, India - Collabera Digital

Description

Position Details:

Job Title: Senior Data Engineer

Experience : 6+ years of experience

Location: Bangalore, Pune, Noida, Hyderabad, Chennai, Mumbai, Kolkata

Primary Skills - AWS Glue, AWS DMS, Redshift, EMR, S3, ETL, SQL, PySpark, Snowflake

Detailed JD:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field
• Proven experience as a Data Engineer, preferably in a senior or lead role.
• Strong proficiency in AWS cloud services, including AWS Glue, AWS Lambda, Amazon EMR, Amazon Redshift, Amazon S3, and AWS IAM.
• AWS certification (e.g., AWS Certified Solutions Architect, AWS Certified Big Data – Specialty).
• Experience with containerization technologies (e.g., Docker, Kubernetes).
• Knowledge of streaming data processing frameworks (e.g., Apache Kafka, Apache Flink).
• Familiarity with machine learning concepts and techniques.
• Proficiency in programming languages such as Python, Scala, or Java, with experience in building and maintaining production-quality code.
• Solid understanding of data engineering concepts, data modelling, and ETL processes.
• Experience with big data technologies (e.g., Apache Spark, Hadoop) and distributed computing frameworks.
• Familiarity with DevOps practices and tools (e.g., CI/CD pipelines, version control systems.
• Excellent problem-solving skills and ability to troubleshoot complex data-related issues.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.