Jobs
>
Chennai

    AWS Data Engineer - Chennai, India - Change leaders

    Change leaders
    Change leaders Chennai, India

    3 days ago

    Default job background
    Description

    Job Description :
    AWS Glue + Python Pyspark


    Job Overview :

    • Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.
    • This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

    Location :
    India (Most Preferrable - Bangalore)

    Experience Level : 5-12 years


    Role Overview :

    • We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.
    • As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.
    • Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our datadriven projects.

    Primary Skills :

    • AWS PySpark Python programming.
    • He has to do coding in day to day activities and also expected to review the code developed by the team.
    • Must be aware of AWS services like Glue, redshift, S3, Airflow etc.
    • Candidate is expected to manage stakeholder management along with mentoring the offshore team.
    • Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

    Responsibilities :

    Data Pipeline Development :

    • Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.
    • Optimize data pipelines for performance, scalability, and reliability.
    • Implement data aggregation, consolidation, and enrichment.

    Workflow Automation :

    • Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.
    • Schedule, monitor, and manage data processing tasks efficiently.

    Database Management :

    • Leverage your strong SQL skills to create and optimize database queries.

    Cloud Infrastructure :

    • Collaborate with architecture teams to design and implement AWS cloud infrastructure.
    • Ensure security, scalability, and costeffectiveness of cloud resources.

    Support Project Processes :

    • Work closely with crossfunctional teams to understand project requirements and deliverables.
    • Provide technical support during project execution and troubleshoot issues as needed.

    Optional Python Skills :

    • Familiarity with Python for scripting and automation tasks is a plus.

    Willingness to Work Late Hours :

    • The role involves working until 12:30 AM IST (Indian Standard Time) due to global project requirements.
    • Flexibility in working hours is essential.

    Qualifications :

    • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
    • AWS certifications (e.g., AWS Certified Data Analytics
    • Specialty) are advantageous.
    • Strong problemsolving skills and ability to work independently.
    • Excellent communication and collaboration skills.

    Benefits :

    • Competitive salary and benefits package.
    • Opportunity to work on cuttingedge cloud technologies.
    • Career growth and professional development.
    )
  • HTC Global Services

    Data Engineer

    4 days ago

    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • Integrate

    Data Engineer

    10 hours ago

    Integrate Chennai, India

    Role: Data Engineer L2 · Experience: 4-6 yrs · Skills required: Snowflake, spark, SQL, python · Work Location: Global Infocity, Chennai · Model: Hybrid · About us: · Integrate is the leader in Demand Management, an emerging category to help B2B marketers develop and deliver an om ...

  • Ashley Global Capability Center

    Data Engineer

    1 week ago

    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • HTC Global Services

    Data Engineer

    1 week ago

    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • BU Soft Tech

    Data Engineer

    4 days ago

    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...

  • InfoCepts

    Data Engineering

    3 days ago

    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • Cynosure Corporate Solutions

    Data Engineer

    10 hours ago

    Cynosure Corporate Solutions Chennai, India

    Lead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data war ...

  • Makonis

    Data Engineer

    2 days ago

    Makonis Chennai, India

    Work Location: Chennai & Coimbatore · Required Exp: 3 to 6yrs (Fulltime Position) · Client: Leading Investment Bank · Mandatory skills: · We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. · If that matches your profile, please share a copy o ...

  • Aspire Systems

    Data Engineer

    2 days ago

    Aspire Systems Chennai, India

    Data Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...

  • Movate

    Data Engineer

    1 week ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • OptiSol Business Solutions

    Data Engineer

    1 day ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...

  • Movate

    Data Engineer

    2 days ago

    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • Blackstraw

    Data Engineer

    1 week ago

    Blackstraw Chennai, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...

  • ResourceTree Global Services

    Data Engineer

    1 day ago

    ResourceTree Global Services Chennai, India

    ResourceTree Global Services is hiring Senior Data Engineer(Snowflake & DBT) for one of its Data Analytics Client. Below are the details. · Role: Senior Data Engineer(Snowflake & DBT) · Primary Skills: DBT,Snowflake · Secondary Skills: 4 to 6 Years · Location: Chennai · Role fun ...

  • ResourceTree Global Services

    Data Engineer

    1 day ago

    ResourceTree Global Services Chennai, India

    Job Description : · ResourceTree Global Services is hiring Senior Data Engineer Role for one of its Data Analytics Client. Below are the details · Role : Senior Data Engineer - Azure · Primary Skills : ADF (Azure Data Factory), SQL · Experience : 4 - 6 Years · Location : Chennai ...

  • Mindsprint

    Data Engineer

    1 day ago

    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    3 days ago

    TIGI HR Solution Pvt. Ltd. Chennai, India

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • CliqHR

    Data Engineer

    3 days ago

    CliqHR Chennai, India

    Job Description : · Mandatory Skills : GCP, Python, SQL, Snap logic, Airflow, Data flow · - 6-8 years of experience in to GCP Data engineer. · - GCP Components (Composer, BQ, Data flow, Pub/Sub, Cloud functions, GCS storage) Intermediate · - SQL Advanced level · - ETL Processing ...

  • System Soft Technologies

    Data Engineer

    1 week ago

    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • Notus

    Data Engineer

    1 day ago

    Notus Chennai, India

    AWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintainin ...