Jobs
>
Bengaluru

    Data Engineer - bangalore, India - IBU Consulting

    IBU Consulting
    IBU Consulting bangalore, India

    5 hours ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description :

    Duties and Responsibilities :

    • Maintain knowledge of evolving industry trends, practices, techniques, and standards on Big Data with a focus on AWS cloud technologies and Python/Pyspark from an application development perspective.
    • Be aware of DevOps practices and follow appropriate steps/tools to effect code migration during development phase.
    • Collaborate with crosscommit teams for implementation of deliverables in all environments.
    • Development of code and design to meet evolving needs while adhering to policy and standards.
    • Write test cases for Unit testing and Functional testing when the application is developed
    • Conduct and participate in coding and design reviews.
    • Manage test plan & risks through development phases to implementation, ensure zero defects are introduced into the production environment.
    • Ensure required documentation for projects and/or enhancements are created and updated.
    • Monitor and support the production environment applications to ensure optimum stability and performance prior to handing over the code to operations team.
    • Be aware of datawarehousing concepts and different facts/dimensionbased modelling mechanisms for implementing in a Datalake environment.

    Skill requirements:

    • Bachelor's degree in computer science, Engineering, or related field; or equivalent work experience.
    • Excellent handson experience in AWS Data technologies Glue, S3, Athena, EMR, IAM etc.

    Mandatory Skill Set :

    • Hands on experience in Python and PySpark.
    • Python as a language is practically usable for anything, we are looking for application Development and Extract/Transform/Load and Data lake curation experience using Python.
    • Hands on experience in version control tools like Git.
    • Worked on Amazon's Analytics services like Amazon Athena, DynamoDB and AWS Glue
    • Worked on Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services.
    • Experience/knowledge of bash/shell scripting will be a plus.
    • Has built ETL processes to take data, copy it, structurally transform it etc involving a wide variety of formats like CSV, fixed width, XML and JSON.
    • Have worked with columnar storage formats
    • Parquet, Avro, and ORC etc.
    • Hands on experience in tools like Jenkins to build, test and deploy the applications.
    • Excellent debugging skills.
    • Ability to quickly perform critical analysis and use creative approaches for solving complex problems.
    • Strong academic background.
    • Excellent written and verbal communication skills, and strong relationship building skills.
    )
  • NatWest Group

    Data Enginer

    5 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    6 days ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    6 days ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    2 days ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Commonwealth Bank

    Data Engineer-1

    1 week ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    1 week ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Informatica

    Data Engineer

    1 week ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Indium Software

    Data Engineer

    1 week ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    5 days ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    1 week ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • TEKsystems

    Data Engineer

    5 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • Razorpay

    Data Engineer

    6 days ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Informatica

    Data Engineer

    1 week ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • JRD Systems

    Data Engineer

    27 minutes ago

    JRD Systems Bengaluru, India

    Role · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...

  • Allica Bank

    Data Engineer

    1 week ago

    Allica Bank Bangalore Urban, India

    About Allica Bank · Allica is the UK's fastest growing company - and the fastest-growing financial technology (fintech) firm ever. Our purpose is to help established SMEs, one of the last major underserved opportunities in fintech. Established SMEs are the backbone of local commu ...

  • Tavant

    Data Engineer

    1 week ago

    Tavant Bengaluru, India

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufa ...

  • Ascendion

    Data Engineer

    28 minutes ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer · Job Location: Bangalore (Remote) · Experience Level: · 5-8 Years · Job Summary: · We are seeking an experienced Data Engineer with a strong background in SQL Server and Azure Data Factory to join our team. The ideal candidate will be responsible for des ...