Jobs
>
Bengaluru

    Big Data Engineer - Pune/Bangalore/Gurgaon/Gurugram, India - HuQuo Consulting Pvt. Ltd.

    HuQuo Consulting Pvt. Ltd.
    HuQuo Consulting Pvt. Ltd. Pune/Bangalore/Gurgaon/Gurugram, India

    4 days ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description :
    4-7 years of experience in DE development.

    • Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)
    • Python programming language is mandatory.
    • PySpark
    • Excellent with SQL
    • Excellent with Airflow is a plus.
    • Good to Have Airflow
    • Good aptitude, strong problemsolving abilities, and analytical skills, ability to take ownership as appropriate.
    • Should be able to do coding, debugging, performance tuning and deploying the apps to Prod
    • Ability to work on the sprint stories to completion along with Unit test case coverage.
    • Experience working in Agile Methodology
    • Excellent communication and coordination skills
    • Knowledgeable (and preferred hands on)
    • UNIX environments, different continuous integration tools
    • Must be able to integrate quickly into the team and work independently towards team goals

    Role & Responsibilities :

    • Take the complete responsibility of the sprint stories' execution.
    • Be accountable for the delivery of the tasks in the defined timelines with good quality
    • Follow the processes for project execution and delivery.
    • Follow agile methodology.
    • Work with the team lead closely and contribute to the smooth delivery of the project
    • Understand/define the architecture and discuss the proscons of the same with the team
    • Involve in the brainstorming sessions and suggest improvements in the architecture/design
    • Work with other team leads to get the architecture/design reviewed
    • Work with the clients and counterparts (in US) of the project
    • Keep all the stakeholders updated about the project/task status/risks/issues if there are any
    )
  • Commonwealth Bank

    Data Engineer-1

    20 hours ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    5 days ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    2 days ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    5 days ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Course5i

    Data Engineer

    1 day ago

    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • Quantum Labs

    Data Engineer

    1 day ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • Informatica

    Data Engineer

    3 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Razorpay

    Data Engineer

    25 minutes ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Banyan Cloud

    Data Engineer

    3 days ago

    Banyan Cloud Bengaluru, India

    Who are we? · About US · Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA, which owns the SaaS product "Banyan Cloud", First of its kind Cyber Security Platform, which simplifies the code to cloud security for multi ...

  • Info Origin Inc.

    Data Engineer

    1 day ago

    Info Origin Inc. Bengaluru, India

    NEW OPPORTUNITY || Immediate to 30 days Joiners || Data Engineer · Position Title: Data Engineer · Location: Bangalore/Hyderabad, India On-site · Position Type: Contract to hire · Required Experience: 4+Years · Job Description · Experience and Qualification: · Experience with SQL ...

  • Demyst

    Data Engineer

    2 days ago

    Demyst Bengaluru, India

    Our Solution · Demyst unlocks innovation with the power of data. Our platform helps enterprises solve strategic use cases, including lending, risk, digital origination, and automation, by harnessing the power and agility of the external data universe. We are known for harnessing ...

  • Sun Life

    Data Engineer

    3 days ago

    Sun Life Bengaluru, India

    Key Responsibilities · This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. · Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of e ...

  • Joveo

    Data Engineer

    2 days ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • TEKsystems

    Data Engineer

    1 day ago

    TEKsystems Bengaluru, India

    Experience – 4 to 10 years · Requirement- · Lead the technical team, help, and support junior developers in project work. · Expert level in Azure Data-bricks with SQL · Expert level in Pyspark programming. · Good understanding in Azure Data Factory (ADF) · Good understanding on D ...

  • Giant Eagle GCC

    Engineer, Data

    1 day ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Ascendion

    Data Engineer

    2 days ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Decathlon Sports India

    Data Engineer

    4 days ago

    Decathlon Sports India Bengaluru, India

    About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthusiastic beginners as well as passionate professionals at extr ...

  • Fractal

    Data Engineering

    3 days ago

    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • Ascendion

    Data Engineer

    6 days ago

    Ascendion Bengaluru, India permanent

    : · We are currently seeking an experienced and skilled AWS Data Engineer to join our team. · In this role, you will be responsible for the design, development, and optimization of data solutions on the AWS platform. · The ideal candidate will have a strong background in data eng ...

  • UNO Digital Bank

    Data Engineer

    2 days ago

    UNO Digital Bank Bengaluru, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering po ...