Jobs
>
Bengaluru

    Data Engineer - Bangalore, India - Talent500

    Talent500
    Talent500 background
    permanent Technology / Internet
    Description

    Responsibilities for Data Engineer:

    • Create and maintain optimal data pipeline architecture,.
    • Assemble large, complex data sets that meet functional / nonfunctional business requirements.
    • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
    • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
    • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
    • Work with stakeholders including the Executive, Product, Data and Design teams to assist with datarelated technical issues and support their data infrastructure needs.
    • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
    • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
    • Work with data and analytics experts to strive for greater functionality in our data systems.

    Qualifications for Data Engineer:

    • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
    • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
    • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
    • Strong analytic skills related to working with unstructured datasets.
    • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
    • A successful history of manipulating, processing and extracting value from large disconnected datasets.
    • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
    • Strong project management and organizational skills.
    • Experience supporting and working with crossfunctional teams in a dynamic environment.


    We are looking for a candidate with 3-5 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

    They should also have experience using the following software/tools:

    • Experience with big data tools: Hadoop, Spark, Kafka, etc.
    • Experience with relational SQL and NoSQL databases.
    • Experience with data pipeline and workflow management tools.
    • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
    • Experience with streamprocessing systems: Storm, Spark-Streaming, etc.
    Experience with object-oriented / object function scripting languages: Python, Java, C++, Scala, etc.

    )

  • NatWest Group

    Data Enginer

    5 days ago


    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    5 days ago


    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    5 days ago


    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    1 day ago


    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Commonwealth Bank

    Data Engineer-1

    6 days ago


    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...


  • HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...


  • Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Joveo

    Data Engineer

    1 week ago


    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Ascendion

    Data Engineer

    1 week ago


    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Ascendion

    Data Engineer

    1 day ago


    Ascendion Bengaluru, India

    Job Title: Data Engineer · Job Location: Bangalore (Remote) · Experience Level: 5-8 Years · Job Summary: We are seeking an experienced Data Engineer with a strong background in SQL Server and Azure Data Factory to join our team. The ideal candidate will be responsible for designi ...

  • LeadSquared

    Data Engineer

    3 days ago


    LeadSquared Bengaluru, India

    Data Engineer: · About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in e ...

  • Indium Software

    Data Engineer

    1 week ago


    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • Axtria - Ingenious Insights

    Data Engineer

    1 day ago


    Axtria - Ingenious Insights Bengaluru, India

    Job Title: Data Engineer / ETL Developer · Job Description: · We are seeking an experienced ETL Developer / Data Engineer to join our team. The ideal candidate will have a strong background in Azure Data Factory (ADF), SQL, Pyspark/Databricks · Responsibilities: · Design, develo ...


  • Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Tech Mahindra

    Data Engineer

    1 week ago


    Tech Mahindra Bengaluru, India

    Role: GCP Data Engineer · Location: Hyderabad/ Bengaluru Work from office (Mon-Fri) · Duration: Full Time · Required Technical Skills: · ● More than 7 years' experience implementing data solutions · ● Strong proficiency in Python with an emphasis in building data pipelines · ● Ex ...

  • JRD Systems

    Data Engineer

    3 days ago


    JRD Systems Bengaluru, India

    Role : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong fo ...

  • Course5i

    Data Engineer

    1 week ago


    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago


    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Allica Bank

    Data Engineer

    1 week ago


    Allica Bank Bangalore Urban, India

    About Allica Bank · Allica is the UK's fastest growing company - and the fastest-growing financial technology (fintech) firm ever. Our purpose is to help established SMEs, one of the last major underserved opportunities in fintech. Established SMEs are the backbone of local commu ...

  • Recro

    Data Engineer

    4 days ago


    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestration To ...