Jobs
>
Bengaluru

    Senior Cloud Data Engineer - Bengaluru, India - Changeleaders

    Changeleaders
    Changeleaders Bengaluru, India

    3 days ago

    Default job background
    Description

    Job Overview:

    • Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.
    • This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

    Location:
    India (Most Preferrable - Bangalore)

    Experience Level : 5-12 years

    Budget : 28 lpa


    Role Overview :

    • We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.
    • As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.
    • Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our datadriven projects.

    Primary Skills :
    AWS PySpark Python programming.

    • He has to do coding in day to day activities and also expected to review the code developed by the team.
    • Must be aware of AWS services like Glue, redshift, S3, Airflow etc.
    • Candidate is expected to manage stakeholder management along with mentoring the offshore team.
    • Candidate must have technical expertise to advise effective solutions to the client on AWS Pipeline Development:
    • Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.
    • Optimize data pipelines for performance, scalability, and reliability.
    • Implement data aggregation, consolidation, and enrichment.

    Workflow Automation :

    • Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.
    • Schedule, monitor, and manage data processing tasks efficiently.

    Database Management :

    • Leverage your strong SQL skills to create and optimize database queries.

    Cloud Infrastructure :

    • Collaborate with architecture teams to design and implement AWS cloud infrastructure.
    • Ensure security, scalability, and costeffectiveness of cloud resources.

    Support Project Processes :

    • Work closely with crossfunctional teams to understand project requirements and deliverables.
    • Provide technical support during project execution and troubleshoot issues as needed.

    Optional Python Skills :

    • Familiarity with Python for scripting and automation tasks is a plus.

    Qualifications :

    • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
    • AWS certifications (e.g., AWS Certified Data Analytics
    • Specialty) are advantageous.
    • Strong problemsolving skills and ability to work independently.
    • Excellent communication and collaboration skills.

    Benefits :

    • Competitive salary and benefits package.
    • Opportunity to work on cuttingedge cloud technologies.
    • Career growth and professional development.
    )
  • NatWest Group

    Data Enginer

    4 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    5 days ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    5 days ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    1 day ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Commonwealth Bank

    Data Engineer-1

    6 days ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    1 week ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Joveo

    Data Engineer

    1 week ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Ascendion

    Data Engineer

    1 week ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • LeadSquared

    Data Engineer

    3 days ago

    LeadSquared Bengaluru, India

    Data Engineer: · About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in e ...

  • JRD Systems

    Data Engineer

    3 days ago

    JRD Systems Bengaluru, India

    Role : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong fo ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Course5i

    Data Engineer

    1 week ago

    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    4 days ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    1 week ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • Recro

    Data Engineer

    4 days ago

    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestration To ...

  • Rakuten India

    Data Engineer

    1 day ago

    Rakuten India Bangalore Urban, India

    About Rakuten: · Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engin ...

  • TEKsystems

    Data Engineer

    4 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • Ascendion

    Data Engineer

    1 day ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer · Job Location: Bangalore (Remote) · Experience Level: 5-8 Years · Job Summary: We are seeking an experienced Data Engineer with a strong background in SQL Server and Azure Data Factory to join our team. The ideal candidate will be responsible for designi ...