Jobs
>
Bengaluru

    Lead Data Engineer - Bengaluru, India - Recro

    Recro
    Recro Bengaluru, India

    4 days ago

    Default job background
    Description

    Position: Data Engineer(Lead)

    Location: WFO-Bangalore

    Experience Level: 8+ years

    Job Description:

    Summary:

    We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate problem-solver with a proven track record of developing robust data pipelines and architecting data products across diverse architectures.

    Responsibilities:

    • Design and architect big data solutions leveraging distributed platforms (e.g., Spark, EMR) to meet complex business needs.
    • Partner with data scientists, analysts, and software engineers to understand data requirements and propose innovative data solutions.
    • Develop, implement, and manage high-performing data pipelines for ingesting, transforming, and delivering data into our data warehouse and data lake.
    • Champion data quality by implementing robust data cleansing, transformation, and enrichment processes.
    • Continuously monitor and optimize data pipelines for peak performance, scalability, and cost-effectiveness.
    • Integrate security best practices into data pipelines and ensure data protection measures are in place.
    • Troubleshoot and debug complex data pipeline issues, performance bottlenecks, and data quality problems.
    • Advocate for and contribute to improvements in the overall data engineering process.
    • Foster a collaborative environment by mentoring and developing other data engineers in adopting best practices.

    Attributes & Qualifications:

    Technical Skills:

    • 8+ years of experience in developing and architecting scalable big data applications or solutions.
    • Expertise in distributed processing frameworks like Spark (Python, Scala).
    • Experience with cloud platforms for data engineering (AWS S3, Managed Airflow, EMR/EC2, IAM etc. preferred).
    • Experience with data pipeline orchestration tools (Airflow, Jenkins) and CI/CD practices.
    • Proficiency in SQL databases (Presto, Snowflake) and data warehousing concepts.
    • Experience architecting data products in streaming, serverless, and microservices architectures.
    • Experience with Data Lakehouse architecture (e.g., Databricks Delta Lake, Medallion).
    • Strong understanding of data governance, data modeling, and data quality frameworks.
    • Familiarity with reporting and analytical tools (Tableau, Quicksight).

    Soft Skills:

    • Excellent problem-solving skills with a keen eye for detail.
    • Strong communication and collaboration skills across technical and non-technical audiences.
    • Ability to work independently and as part of a fast-paced, Agile/Scrum development team.
    • Passion for data, a continuous learning mindset, and a willingness to learn new technologies.
  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 day ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Joveo

    Data Engineer

    4 days ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Ascendion

    Data Engineer

    6 days ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Cloud Raptor

    Data Engineer

    1 day ago

    Cloud Raptor Bangalore Urban, India

    At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across · many industries. Focused on cloud technologies and technical expertise, we help organisations · navigate the ever-changing landscape of the digital era. · With dedicated Centres of ...

  • Indium Software

    Data Engineer

    5 days ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • Informatica

    Data Engineer

    5 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Banyan Cloud

    Data Engineer

    4 days ago

    Banyan Cloud Bengaluru, India

    Who are we? · About US · Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA, which owns the SaaS product "Banyan Cloud", First of its kind Cyber Security Platform, which simplifies the code to cloud security for multi ...

  • Tech Mahindra

    Data Engineer

    3 days ago

    Tech Mahindra Bengaluru, India

    Role: GCP Data Engineer · Location: Hyderabad/ Bengaluru Work from office (Mon-Fri) · Duration: Full Time · Required Technical Skills: · ● More than 7 years' experience implementing data solutions · ● Strong proficiency in Python with an emphasis in building data pipelines · ● Ex ...

  • Reflections Info Systems

    Data Engineer

    5 days ago

    Reflections Info Systems Bengaluru, India

    Job Description · We are seeking a skilled Data Engineer with a minimum of 6 years of experience, preferably in a lead or key role, in implementing one or two large-scale data solutions. · The ideal candidate will have strong programming abilities in Scala or Python, as well as ...

  • Allica Bank

    Data Engineer

    5 days ago

    Allica Bank Bangalore Urban, India

    About Allica Bank · We are rare amongst banks in that our senior leadership team includes backgrounds at world-leading FinTechs, which shows in their active engagement with our cross-functional Product Squads, and in our bank-wide adoption of modern tools & techniques such as Dev ...

  • Allica Bank

    Data Engineer

    17 hours ago

    Allica Bank Bangalore Urban, India

    About Allica Bank · Allica is the UK's fastest growing company - and the fastest-growing financial technology (fintech) firm ever. Our purpose is to help established SMEs, one of the last major underserved opportunities in fintech. Established SMEs are the backbone of local commu ...

  • Demyst

    Data Engineer

    21 hours ago

    Demyst Bengaluru, India

    Our Solution · Demyst unlocks innovation with the power of data. Our platform helps enterprises solve strategic use cases, including lending, risk, digital origination, and automation, by harnessing the power and agility of the external data universe. We are known for harnessing ...

  • Giant Eagle GCC

    Engineer, Data

    11 hours ago

    Giant Eagle GCC Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Multplyr

    Data Engineers

    2 days ago

    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • Sun Life

    Data Engineer

    5 days ago

    Sun Life Bengaluru, India

    Key Responsibilities · This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. · Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of e ...

  • TMRW House of Brands

    Data Engineer

    5 days ago

    TMRW House of Brands Bengaluru, India

    Data Engineer III · Responsibilities · Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning. · Develop and maintain core data framework and key infrastructures · Create and support the ETL pipeline to get ...

  • Fractal

    Data Engineering

    4 days ago

    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • Informatica

    Data Engineer

    5 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • TEKsystems

    Data Engineer

    3 days ago

    TEKsystems Bengaluru, India

    Experience – 4 to 10 years · Requirement- · Lead the technical team, help, and support junior developers in project work. · Expert level in Azure Data-bricks with SQL · Expert level in Pyspark programming. · Good understanding in Azure Data Factory (ADF) · Good understanding on D ...

  • ParallelDots

    Data Engineer

    1 day ago

    ParallelDots Bengaluru, India

    Company Description · ParallelDots is a leading image recognition solution provider for FMCG companies and retailers globally. Our technology helps optimize in-store execution and maximize sales. For more information on our technology, visit · Role Description · This is a full-t ...