Jobs
>
Bengaluru

    Data Engineer - bangalore, India - gethyr

    gethyr
    gethyr bangalore, India

    12 hours ago

    Default job background
    Technology / Internet
    Description

    Responsibilities:


    • Designing and implementing finetuned productionready data/ML pipelines in Hadoop platform.
    • Driving optimization, testing, and tools to improve quality.
    • Reviewing and approving highlevel & detailed design to ensure that the solution delivers to the business needs and aligns with the data & analytics architecture principles and roadmap.
    • Understanding business requirements and solution design to develop and implement solutions that adhere to big data architectural guidelines and address business requirements.
    • Following proper SDLC (Code review, sprint process).
    • Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, etc.
    • Building robust and scalable data infrastructure (both batch processing and realtime) to support the needs of internal and external users
    • Understanding various data security standards and using secure data security tools to apply and adhere to the required data controls for user access in the Hadoop platform.
    • Supporting and contributing to developing guidelines and standards for data ingestion
    • Working with data scientist and business analytics team to assist in data ingestion and datarelated technical issues.
    • Designing and documenting the development & deployment flow.

    Requirements:

    • Experience in developing rest API services using one of the Scala frameworks
    • Ability to troubleshoot and optimize complex queries on the Spark platform
    • Expert in optimizing 'big data' data/ML pipelines, architectures, and data sets
    • Experience in Big Data access and storage techniques.
    • Experience in doing cost estimation based on design and development.
    • Excellent debugging skills for the technical stack mentioned above which even includes analyzing server logs and application logs.
    • Highly organized, selfmotivated, proactive, and able to propose the best design solutions.
    • Good time management and multitasking skills to work to deadlines by working independently and as a part of a team.
    • Ability to analyze and understand complex problems.
    • Ability to explain technical information in business terms.
    • Ability to communicate clearly and effectively, both verbally and in writing.
    • Strong in user requirements gathering, maintenance, and support
    )
  • NatWest Group

    Data Enginer

    6 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon India

    Data Engine

    6 days ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Decathlon

    Data Engine

    6 days ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    2 days ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Commonwealth Bank

    Data Engineer-1

    1 week ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    1 week ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Multplyr

    Data Engineers

    1 week ago

    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • SP Software Solutions

    Data Engineer

    4 days ago

    SP Software Solutions Bengaluru, India

    Azure Date Engineer · Multiple Locations in India · (Bengaluru, Chennai, Hyderabad, Kochi, Kolkata, Lucknow, Mumbai, Noida, Pune) · Strong experience in SQL, Azure, Azure Data Factory, Databricks, Python, Spark, PySpark · Moderate experience in CI/CD · Requirements: · Strong pr ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Joveo

    Data Engineer

    7 hours ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd

    Data Engineer

    1 week ago

    Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Bengaluru, India

    Greetings from @Teamware Solutions. . · Hope you doing well Join our family Here we are hiring Data Engineer · Job Position: Data Engineer · Job Type: Full-Time · Job Location: Pan India · Job Description: · The right candidate has (Responsibilities); · Provide Wealth Management ...

  • LeadSquared

    Data Engineer

    7 hours ago

    LeadSquared Bengaluru, India

    Data Engineer: About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in exi ...

  • Genpact

    Data Engineer

    7 hours ago

    Genpact Bengaluru, India

    Inviting applications for the role of · Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...

  • Ascendion

    Data Engineer

    7 hours ago

    Ascendion Bengaluru, India

    · Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...

  • Fractal

    Data Engineering

    1 week ago

    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • Excellence and Eminence LLP

    Data Engineer

    12 hours ago

    Excellence and Eminence LLP bangalore, India

    About the Role: · We are seeking a talented and motivated Data Engineer to join our team and play a crucial role in building and maintaining our data infrastructure. · This role is ideal for a candidate with a strong foundation in data engineering principles and experience workin ...

  • Mobile Programming LLC

    Data Engineer

    12 hours ago

    Mobile Programming LLC Bangalore, India

    Job Description : · Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. · As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring t ...

  • Coders Brain Pvt Ltd

    Data Engineer

    12 hours ago

    Coders Brain Pvt Ltd bangalore, India

    Job Overview : · JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all as ...