Jobs
>
Bengaluru

    Big Data Engineer - Bengaluru, India - Huquo

    Huquo
    Default job background
    Description

    Job Description:
    Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)

    • Python programming language is required.
    • PySpark
    • Proficient with SQL
    • Proficient with Airflow is a bonus.

    Good to Have:

    • Airflow
    • Strong problem-solving abilities, analytical skills, and aptitude, ability to take ownership when necessary.
    • Capable of coding, debugging, performance tuning, and deploying apps to Production
    • Able to work on sprint stories till completion with Unit test case coverage.
    • Experience in Agile Methodology
    • Strong communication and coordination skills
    • Proficient in UNIX environments, various continuous integration tools
    • Quick integration into the team and independent work towards team objectives

    Role & Responsibilities:

    • Take full responsibility for executing sprint stories.
    • Ensure timely delivery of tasks with good quality
    Follow project execution and delivery processes.

    • Follow agile methodology.
    • Collaborate closely with the team lead to ensure smooth project delivery
    • Understand/define architecture and discuss pros and cons with the team
    • Engage in brainstorming sessions and propose enhancements in architecture/design
    • Coordinate with other team leads for architecture/design reviews
    • Interact with clients and project counterparts (in US)
    • Keep stakeholders informed about project/task status, risks, and issues, if any
    )

  • Decathlon India

    Data Engine

    4 days ago


    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • NatWest Group

    Data Enginer

    3 days ago


    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    4 days ago


    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Commonwealth Bank

    Data Engineer-1

    5 days ago


    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    17 hours ago


    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...


  • HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...


  • Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...


  • Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • JRD Systems

    Data Engineer

    2 days ago


    JRD Systems Bengaluru, India

    Role : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong fo ...

  • Course5i

    Data Engineer

    6 days ago


    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    3 days ago


    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    6 days ago


    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • TEKsystems

    Data Engineer

    4 days ago


    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • UNO Digital Bank

    Data Engineer

    1 week ago


    UNO Digital Bank Bengaluru, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering po ...

  • Razorpay

    Data Engineer

    4 days ago


    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Info Origin Inc.

    Data Engineer

    1 day ago


    Info Origin Inc. Bengaluru, India

    NEW OPPORTUNITY || CONTRACT TO HIRE ROLE FINANCIAL ANALYTICS DATA ENGINEER · Required Immediate to 30 days joiners only. · Position Title: Financial Analytics Data Engineer · Location: Bangalore/ Hyderabad/ Pune · Position Type: Contract to hire role · Required Experience: · 3+ ...

  • Giant Eagle GCC

    Engineer, Data

    6 days ago


    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Informatica

    Data Engineer

    1 week ago


    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Recro

    Data Engineer

    3 days ago


    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestration To ...

  • Banyan Cloud

    Data Engineer

    1 week ago


    Banyan Cloud Bengaluru, India

    Who are we? · About US · Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA, which owns the SaaS product "Banyan Cloud", First of its kind Cyber Security Platform, which simplifies the code to cloud security for multi ...