Data Engineer - Hyderabad, India - Virtusa

    Virtusa
    Virtusa Hyderabad, India

    2 weeks ago

    Virtusa background
    Description
    Data Engineer
    • CREQ187057 Description 6 8 years of relevant work experience showing growth as a Data Engineer.
    Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.

    Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security ImplementationWorked on Scheduling tools like AirflowGood hands-on design and programming skills building reusable tools and productsExperience developing in AWS or similar cloud platforms.


    Preferred:
    , ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
    Good knowledge of Python. Good to have Java/Scala.

    Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).Experience in efficient data processing using open table format Delta, Iceberg.

    Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
    Expertise in practices like Agile, Peer reviews, Continuous IntegrationPrimary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills DynamoDB, Java, Spark, AWS Glue, AWS Lake Formation, Kafka, Amazon Redshift Years of Experience 8 Qualification

    6-8years of relevant work experience showing growth as a Data Engineer.
    Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.

    Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security ImplementationWorked on Scheduling tools like AirflowGood hands-on design and programming skills building reusable tools and productsExperience developing in AWS or similar cloud platforms.


    Preferred:
    , ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
    Good knowledge of Python. Good to have Java/Scala.

    Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).Experience in efficient data processing using open table format Delta, Iceberg.

    Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
    Expertise in practices like Agile, Peer reviews, Continuous IntegrationTravel No