Jobs
>
Bengaluru

    Senior Data Engineer - bangalore, India - Beyond Human Resource

    Beyond Human Resource
    Beyond Human Resource bangalore, India

    6 days ago

    Default job background
    Description

    Enable our customers to transform into an intelligent enterprise with our "AI-First" approach. We transform your data to make smart decisions for you.

    Founded in 2016 and headquartered in New York, Kloud9 LLC is one of the leading technology services and solutions providers specializing in Data Science, Artificial Intelligence (AI) and Machine Learning (ML).

    It was founded with the vision of enabling customers to transform into intelligent enterprises with our "AI-First " approach to solve business problems. We help our customers in their Data and Insights Transformation journeys enabling them to make smarter business decisions.

    At Kloud9, we know that Artificial Intelligence (AI) & Machine Learning (ML) are today's key technologies that help organizations significantly improve their end customer experiences and transform their business operations. Our best-of-the-breed Data Services, AI Services and Machine Learning services enable organizations across Retail, Consumer Goods, Manufacturing and Healthcare industries to become digital natives and build a robust cognitive ecosystem.

    The Role

    You will be responsible for :

    • Design, develop, and maintain scalable and efficient data engineering solutions using Apache Spark and related technologies.
    • Collaborate with cross-functional teams to understand data requirements, design data models, and implement data processing pipelines.
    • Utilize Databricks for collaborative development, debugging, and optimization of Spark applications.
    • Work with various data warehousing technologies such as Snowflake, Presto, Hive, or Hadoop to build robust and high-performance data storage solutions.
    • Develop and optimize SQL queries for efficient data retrieval and transformation.
    • Implement both batch and streaming data processing solutions to meet business requirements.
    • Collaborate with other teams to integrate data engineering solutions into larger software systems.
    • Utilize version control (Git/GitHub) for managing codebase and ensuring code quality through collaborative development practices.
    • Stay updated on industry best practices, emerging technologies, and contribute to the adoption of new tools and techniques within the data engineering team.

    Ideal Profile

    • Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.
    • Experience in distributed technology tools, viz. SQL, Spark, PySpark (or Spark with Scala)
    • Performance Turing – Optimize SQL, PySpark for performance Airflow workflow scheduling tool
    • Hands-on experience in Databricks/ Dataproc is mandatory.
    • Further, experience in EMR/ EC2 will be an added advantage.
    • DWH tools incl. SQL d/b, Snowflake, Hive, Presto, etc.
    • Messaging frameworks – Kafka

    Mandatory Skills:

    • Apache Spark and either PySpark or Scala: Extensive hands-on experience with Spark for large-scale data processing and analysis. Proficiency in either PySpark or Scala for developing Spark applications.
    • Databricks: Strong expertise in using Databricks for big data analytics, data engineering, and collaborative work on Apache Spark.
    • Github: Proficient in version control using Git and GitHub for managing and tracking changes in the codebase.
    • Data Warehousing (DWH): Experience with one or more of the following DWH technologies – Snowflake, Presto, Hive, or Hadoop. Ability to design, implement, and optimize data warehouses.
    • Python: Advanced programming skills in Python for data manipulation, analysis, and scripting tasks.
    • SQL: Strong proficiency in SQL for querying, analyzing, and manipulating large datasets in relational databases.
    • Data Streaming or Data Batch: In-depth knowledge and hands-on experience in both data streaming and batch processing methodologies.

    Good to Have:

    • Kafka: Familiarity with Apache Kafka for building real-time data pipelines and streaming applications.
    • Jenkins: Experience with Jenkins for continuous integration and continuous delivery (CI/CD) in the data engineering workflow.

    What's on Offer?

    • Excellent career development opportunities
    • Work within a company with a solid track record of success
    • Flexible working options
  • NatWest Group

    Data Enginer

    2 weeks ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    2 weeks ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    2 weeks ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Mercedes-Benz

    HD Map Data Collector Dev Engineer

    6 days ago

    Mercedes-Benz bangalore, India

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:InfotainmentGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:sofortVeröffentlichungsdatum:..4Stellennummer:MERV J ...

  • Deutsche Bank

    Data Engineer-2

    1 week ago

    Deutsche Bank Bengaluru, Karnataka, India

    **Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    2 weeks ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • DigitalCube Consultancy

    Azure Data Engineer

    1 week ago

    DigitalCube Consultancy Bengaluru, Karnataka, India

    **Azure Data Engineer** · **Job Type · - Full time** · **Location · - Bangalore/ Mumbai, India** · **Responsibilities**: · - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. · - Utilize Databricks for ...

  • Commonwealth Bank

    Data Engineer-1

    2 weeks ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • Kyndryl

    Data Engineer-1

    1 week ago

    Kyndryl Bengaluru, Karnataka, India

    Who We Are · At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inc ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    3 weeks ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Bosch Group

    Big Data Engineer 2023

    1 day ago

    Bosch Group Bengaluru, India

    Company Description · **Bosch Global Software Technologies Private Limited** is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 22,700 associ ...

  • Black & White Business Solutions

    Data Engineer-5 to 11years

    4 days ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Data engineer · Years Of exp:5 to 11years · Location:Hyderabad/Pune/Coimbatore · NP:Immed ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    3 weeks ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Concentrix

    Data Engineer

    4 days ago

    Concentrix Bengaluru, India

    Job Description: · Experience: 4 Years - 8 Years · Job Location: PAN India · Notice Period: Immediate/ 15 Days · Shift Timings: 03:00 PM to 12:00 AM (IST) · Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & python · Job Description: · We ar ...

  • Genpact

    Data Engineer

    6 days ago

    Genpact bangalore, India

    Inviting applications for the role of Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...

  • Joveo

    Data Engineer

    1 week ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Recro

    Data Engineer

    6 days ago

    Recro bangalore, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestratio ...

  • Ascendion

    Data Engineer

    6 days ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubefl ...

  • Novo Nordisk

    Data Engineer

    6 days ago

    Novo Nordisk bangalore, India

    Job Description: · As Data engineer, you will have the opportunity: - · Applying strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You will have to work in a fast-paced environment. · You are responsi ...

  • Ascendion

    Data Engineer

    1 week ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer · Job Location: Bangalore (Remote) · Experience Level: · 5-8 Years · Job Summary: · We are seeking an experienced Data Engineer with a strong background in SQL Server and Azure Data Factory to join our team. The ideal candidate will be responsible for des ...