Jobs
>
Data Engineer
>
Bengaluru

    Data Engineer - Bengaluru, India - Razorpay

    Razorpay
    Razorpay Bengaluru, India

    1 week ago

    Default job background
    Description

    The Role:

    We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

    Roles and Responsibilities:

    • Create and maintain optimal data pipeline architecture
    • Create and maintain events/streaming based architecture/design
    • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
    • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
    • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
    • Work with data scientists to strive for greater functionality in our data systems.

    Mandatory Qualifications:

    • We are looking for a candidate with 2+ years of experience in a Data Engineer role.
    • Experience with big data tools: HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
    • Experience with relational SQL and NoSQL databases, including Elastic search and Cassandra/MongoDB.
    • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
    • Experience with AWS /GCP cloud services
    • Experience with stream-processing systems: Spark-Streaming/Flink etc.
    • Experience with object-oriented/object function scripting languages: Java, Scala, etc.
    • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
    • Strong analytic skills related to working with structured/unstructured datasets.
    • Build processes supporting data transformation, data structures, dimensional modeling, metadata, dependency, schema registration/evolution and workload management.
    • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
    • Experience supporting and working with cross-functional teams in a dynamic environment
    • Have a few weekend side projects up on GitHub
    • Have contributed to an open-source project
    • Have worked at a product company
    • Have a working knowledge of a backend programming language
  • NatWest Group

    Data Enginer

    6 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon India

    Data Engine

    1 week ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Decathlon

    Data Engine

    1 week ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    3 days ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Deutsche Bank

    Data Engineer-2

    8 hours ago

    Deutsche Bank Bengaluru, Karnataka, India

    **Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...

  • Commonwealth Bank

    Data Engineer-1

    1 week ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    1 week ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Genpact

    Data Engineer

    16 hours ago

    Genpact Bengaluru, India

    Inviting applications for the role of · Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Recro

    Data Engineer

    16 hours ago

    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · - Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · - Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · - Orchestratio ...

  • Multplyr

    Data Engineers

    1 week ago

    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • Joveo

    Data Engineer

    16 hours ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • SP Software Solutions

    Data Engineer

    5 days ago

    SP Software Solutions Bengaluru, India

    Azure Date Engineer · Multiple Locations in India · (Bengaluru, Chennai, Hyderabad, Kochi, Kolkata, Lucknow, Mumbai, Noida, Pune) · Strong experience in SQL, Azure, Azure Data Factory, Databricks, Python, Spark, PySpark · Moderate experience in CI/CD · Requirements: · Strong pr ...

  • Mobile Programming LLC

    Data Engineer

    21 hours ago

    Mobile Programming LLC Bangalore, India

    Job Description : · Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. · As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring t ...

  • Ascendion

    Data Engineer

    16 hours ago

    Ascendion Bengaluru, India

    · Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...

  • Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd

    Data Engineer

    1 week ago

    Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Bengaluru, India

    Greetings from @Teamware Solutions. . · Hope you doing well Join our family Here we are hiring Data Engineer · Job Position: Data Engineer · Job Type: Full-Time · Job Location: Pan India · Job Description: · The right candidate has (Responsibilities); · Provide Wealth Management ...

  • LeadSquared

    Data Engineer

    16 hours ago

    LeadSquared Bengaluru, India

    Data Engineer: About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in exi ...

  • Coders Brain Pvt Ltd

    Data Engineer

    21 hours ago

    Coders Brain Pvt Ltd bangalore, India

    Job Overview : · JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all as ...

  • JRD Systems

    Data Engineer

    16 hours ago

    JRD Systems Bengaluru, India

    Role · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...