Jobs
>
Delhi

    AWS Data Engineer - Delhi, India - Change Leaders

    Change Leaders
    Change Leaders Delhi, India

    3 hours ago

    Default job background
    Description

    Job Description :
    AWS Glue + Python Pyspark


    Job Overview :
    Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.

    This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.


    Location :
    India (Most Preferrable - Bangalore)

    Experience Level : 5-12 years


    Role Overview :
    We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.

    As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.

    Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.


    Primary Skills :
    AWS PySpark Python programming.

    He has to do coding in day to day activities and also expected to review the code developed by the team.


    • Must be aware of AWS services like Glue, redshift, S3, Airflow etc.
    • Candidate is expected to manage stakeholder management along with mentoring the offshore team.
    • Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

    Responsibilities :

    Data Pipeline Development :

    • Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.
    • Optimize data pipelines for performance, scalability, and reliability.
    • Implement data aggregation, consolidation, and enrichment.

    Workflow Automation :

    • Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.
    • Schedule, monitor, and manage data processing tasks efficiently.

    Database Management :

    • Leverage your strong SQL skills to create and optimize database queries.

    Cloud Infrastructure :

    • Collaborate with architecture teams to design and implement AWS cloud infrastructure.
    • Ensure security, scalability, and costeffectiveness of cloud resources.

    Support Project Processes :

    • Work closely with crossfunctional teams to understand project requirements and deliverables.
    • Provide technical support during project execution and troubleshoot issues as needed.

    Optional Python Skills :

    • Familiarity with Python for scripting and automation tasks is a plus.

    Willingness to Work Late Hours :
    The role involves working until 12:30 AM IST (Indian Standard Time) due to global project requirements. Flexibility in working hours is essential.


    Qualifications :

    • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
    • AWS certifications (e.g., AWS Certified Data Analytics
    • Specialty) are advantageous.
    • Strong problemsolving skills and ability to work independently.
    • Excellent communication and collaboration skills.

    Benefits :

    • Competitive salary and benefits package.
    • Opportunity to work on cuttingedge cloud technologies.
    • Career growth and professional development.
    If you are passionate about cloud data engineering, thrive in a collaborative environment, and are ready to take on exciting challenges, we encourage you to apply
    )
  • Terminus

    Data Engineer

    1 week ago

    Terminus Delhi, India

    Role · We are looking for a Data Engineer to join our team who will be involved data management and transformation at scale and optimize to prepare the data pipe for the AI /Analytical technology stack. The ideal candidate is an experienced data pipeline builder and data wrangle ...

  • Blackstraw

    Data Engineer

    4 days ago

    Blackstraw Delhi, India

    Data Engineer · Company Name: · Office Location: Delhi (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exa ...

  • INSIGHT GLOBAL SOLUTIONS

    Data Engineer

    3 hours ago

    INSIGHT GLOBAL SOLUTIONS Delhi, India

    Data Engineer · Must Haves : · - Bachelors Degree in science, technology, or another related field. · - 3+ years of data engineering experience. · - 3+ years of experience with Cloud platforms like GCP, Azure, Airflow. · - 4+ years of data warehouse, relational database, and SQL ...

  • Resources valley

    Data Engineer

    2 days ago

    Resources valley Delhi, India

    Job Description : · Ownership of Data Engineering solution development, including ingestion, transformation, loading, modelling, curation, profiling, migration, and validation of data, also maintaining security, access control, compliance, and SLAs · - Design and create data mode ...

  • Uplers

    Data Engineer

    23 hours ago

    Uplers New Delhi, India

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through ...

  • SIENT TECHOLOGIES PVT LTD

    Data Engineer

    1 week ago

    SIENT TECHOLOGIES PVT LTD New Delhi, India

    Company Overview: · SIENT Technologies is a pioneering technology firm at the forefront of innovation, dedicated to revolutionizing industries through the power of advanced solutions. Committed to excellence, we specialize in creating transformative technology that enhances effic ...

  • HARP Technologies and Services

    Data Engineer

    2 days ago

    HARP Technologies and Services Delhi, India

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...

  • Reliable Group

    Data Engineer

    1 day ago

    Reliable Group Delhi, India

    POSITION DESCRIPTION : · WHAT YOU'LL DO : · - Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow. · - Ensure correctness and completeness of the data being transformed via engineering pipelines ...

  • Muoro

    Data Engineer

    2 days ago

    Muoro Delhi, India

    Responsibilities : · - Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies. · - Implement data ingestion processes from various sources, ensuring data quality and integrity. · - Optimize and tune data pipelines for perfo ...

  • KARYA CONSULTANTS PRIVATE LIMITED

    Data Engineer

    1 day ago

    KARYA CONSULTANTS PRIVATE LIMITED Delhi, India

    As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...

  • Triumph Ladders Pvt. Ltd.

    Data Engineer

    2 days ago

    Triumph Ladders Pvt. Ltd. Delhi Division, India

    Title - Data Engineer · Exp years · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group ...

  • Vbeyond

    Data Engineer

    1 day ago

    Vbeyond Delhi NCR/Mumbai/Noida, India permanent

    JOB SUMMARY : · We are seeking a skilled and experienced Data Engineer with strong developments skills and solid track record in terms of implementing scalability, availability and excellence when building data pipelines and platforms for our royalties and revenue share initiati ...

  • WovV Technologies

    Data Engineer

    1 day ago

    WovV Technologies Delhi, India

    Job Description : Data Engineer · Location : Remote · Experience : 5+ years. · Durations : 6 months with a very likely extension · Mandatory Technology : DBT, SQL, Snowflake,data integration practices, and Tableau · Primary Skills : Expertise in transaction refunds and a comprehe ...

  • RS Consultants

    Data Engineer

    6 days ago

    RS Consultants Delhi, India

    About the job : · Responsibilities : · - Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets. · - Collaborate with Business Intelligence team and other stakeholders for data requirements · - Collaborate with the Dat ...

  • Triumph Ladders Pvt. Ltd.

    Data Engineer

    2 days ago

    Triumph Ladders Pvt. Ltd. Delhi, India permanent

    Title - Data Engineer · Exp yrs · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group · - ...

  • Ally-eXecutive

    Data Engineer

    2 days ago

    Ally-eXecutive Pune/Gurgaon/Gurugram/Noida, India permanent

    Job Description : · Technical Expertise : · - Should have experience of working on Microsoft Azure tools like Spark, Databrick, Synapse (knowledge of these will be an added advantage). · - Should be very strong on BI and EDWH concepts. · - Must have good experience on working on ...

  • USEReady Technology Pvt. Ltd.

    Data Engineer

    2 days ago

    USEReady Technology Pvt. Ltd. Any Location/Bangalore, India permanent

    Role Responsibility : · - Translate functional specifications and change requests into technical specifications. · - Translate business requirement document, functional specification, and technical specification to related coding. · - Develop efficient code with unit testing and ...

  • Woolworths Group International

    Data Engineering Manager

    1 week ago

    Woolworths Group International New Delhi, India

    What we're like · At BIG W every day's a big day. For you, this could be the start of something big. · There are over 15,000 of us, in the biggest cities and the tiniest towns. And each of us has an important role to play to help make a real difference for families by providing r ...

  • MASAN Group

    Head Of Data Engineer

    3 hours ago

    MASAN Group New Delhi, India

    Responsibilities: · 1. Data Strategy and Governance · Develop and implement the data strategy and roadmap aligned with the organisation's overall business goals and objectives · Define data governance policies and procedures to ensure data quality, security, and regulatory compli ...

  • Randstad

    Senior Data Engineer

    2 days ago

    Randstad Delhi, India

    Job Description: · We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. · The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations ...