Jobs
>
Bengaluru

    Lead Data Engineer - Bengaluru, India - Straive

    Straive
    Straive Bengaluru, India

    Found in: Appcast Linkedin IN C2 - 1 week ago

    Default job background
    Description

    Responsibilities -

    ⦁ Leading the design, development, and maintenance of the data infrastructure for an enterprise.

    ⦁ Collaborating with data scientists, analysts, and other stakeholders to understand data needs and requirements.

    ⦁ Developing and implementing data pipelines to ingest, transform, and store data

    ⦁ Building and maintaining data lakes and data warehouses.

    ⦁ Ensuring the data infrastructure is scalable, reliable, and secure.

    ⦁ Mentoring and coaching team members to help them grow their skills and capabilities

    ⦁ Identifying and addressing technical challenges and roadblocks in data engineering projects

    ⦁ Communicating technical concepts and project progress to non-technical stakeholders

    ⦁ Building and maintaining relationships with key partners and stakeholders within the organization

    Must have -

    ⦁ 8-10 years of experience and 6+ years in Data Engineering

    ⦁ Building and maintaining data pipelines using technologies such as Cloud Data Fusion, Cloud Dataflow, Azure Data Factory, Azure Stream Analytics, Dell Boomi. (Any 2)

    ⦁ Storing and processing data using technologies such as BigQuery, Cloud Dataproc, Azure Synapse Analytics, Snowflake, Redshift, Cosmos DB. (Any 3)

    ⦁ Managing data storage and access using technologies such as Cloud Storage, Azure Blob Storage, or Azure Data Lake Storage. (Any 1)

    ⦁ Managing and deploying data infrastructure on GCP or Azure using technologies such as Cloud Composer, Azure Kubernetes Service, or Azure Container Instances (Any 2)

    ⦁ Implementing security and access controls for data such as Cloud Identity and Access Management, Azure Active Directory, or Azure Private Link

    ⦁ Well-versed with the Data services, integration, ingestion, ELT/ETL, Data Governance.

    ⦁ Security and Meta-driven Development.

    ⦁ Expertise on RDBMS (relational database management system) – writing complex SQL logics, DB/Query optimisation, Data Modelling, able to manage high data volume for mission critical applications.

    ⦁ Strong grip on programming using Python and PySpark.

    ⦁ Data pipeline lifecycle management and DataOps.

    ⦁ Expertise on using Azure DevOps or Google Cloud Build. (Any 1).

    ⦁ Preference to the candidates having Azure or GCP data engineer certification. (Any 1)

    ⦁ Databricks experience of 1-2 years.

    Should be aware of the following -

    ⦁ Application Development understanding (Full Stack)

    ⦁ Experience on open-source tools like Kafka, Spark, Splunk, Superset etc.

    ⦁ Good understanding of Analytics Platform Landscape that includes AI/ML

    ⦁ Experience on any Data Visualization tool like PowerBI / Tableau / Qlik /QuickSight etc.


  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 days ago


    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Cloud Raptor

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago


    Cloud Raptor Bengaluru, India

    At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across · many industries. Focused on cloud technologies and technical expertise, we help organisations · navigate the ever-changing landscape of the digital era. · With dedicated Centres of ...

  • Joveo

    Data Engineer

    Found in: Talent IN 2A C2 - 6 days ago


    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Banyan Cloud

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 days ago


    Banyan Cloud Bengaluru, India

    Who are we? · About US · Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA, which owns the SaaS product "Banyan Cloud", First of its kind Cyber Security Platform, which simplifies the code to cloud security for multi ...

  • Fractal

    Data Engineering

    Found in: Talent IN 2A C2 - 6 days ago


    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • Ascendion

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 4 hours ago


    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Demyst

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago


    Demyst Bengaluru, India

    Our Solution · Demyst unlocks innovation with the power of data. Our platform helps enterprises solve strategic use cases, including lending, risk, digital origination, and automation, by harnessing the power and agility of the external data universe. We are known for harnessing ...

  • IRIS Software Group

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 days ago


    IRIS Software Group Bengaluru, India

    About IRIS : · IRIS Software Group is one of the UK's largest privately held software companies. Its purpose is to be the most trusted provider of mission-critical software and services, ensuring customers get it right first time, every time. · IRIS takes the pain out of processe ...

  • Applicantz

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 days ago


    Applicantz Bengaluru, India

    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER. · Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use ...

  • TEKsystems

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago


    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • CareerXperts Consulting

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago


    CareerXperts Consulting Bengaluru, India

    Data Engineer - Become a Data Whisperer · Are you passionate about building the foundation for data-driven decision making? · We're looking for a talented Data Engineer to join our team and play a key role in unlocking the power of our data. You'll design, develop, and maintain d ...

  • Razorpay

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago


    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Info Origin Inc.

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago


    Info Origin Inc. Bengaluru, India

    Position Title: Financial Analytics Data Engineer · Location: Hyderabad/Bangalore, KA, Onsite · Position Type: Full-Time · Position Duration: Permanent · Job Description: · The Corporate Solutions Technical Accounting team is looking for financial analytics engineer to design and ...

  • Info Origin Inc.

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago


    Info Origin Inc. Bengaluru, India

    NEW OPPORTUNITY || Immediate to 30 days Joiners || Data Engineer · Position Title: Data Engineer · Location: Bangalore/Hyderabad, India On-site · Position Type: Contract to hire · Required Experience: 4+Years · Job Description · Experience and Qualification: · Experience with SQL ...

  • DigiKey Global Capability Center

    Data Engineer

    Found in: Talent IN 2A C2 - 5 days ago


    DigiKey Global Capability Center Bengaluru, India

    Data Engineer · Position Overview · This position is responsible for the design, development, and deployment of extraction, transformation, and load (ETL) processes and methodologies to satisfy corporate data movements across various environments. · This is not exclusively an ess ...

  • Coders Brain Pvt Ltd

    Data Engineer

    Found in: Talent IN 2A C2 - 17 hours ago


    Coders Brain Pvt Ltd Mumbai/Chennai/Pune/Bangalore, India permanent

    JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all aspects of the soft ...

  • TEKsystems

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago


    TEKsystems Bengaluru, India

    Experience – 4 to 10 years · Requirement- · Lead the technical team, help, and support junior developers in project work. · Expert level in Azure Data-bricks with SQL · Expert level in Pyspark programming. · Good understanding in Azure Data Factory (ADF) · Good understanding on D ...

  • Grizmo Labs

    Data Engineer

    Found in: Talent IN 2A C2 - 8 hours ago


    Grizmo Labs Bengaluru, India

    Responsibilities : · - Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka. · - Assemble large, complex data sets that meet functional / non-functional ...

  • Talent500 Tech

    Data Engineer

    Found in: Talent500 IN C2 - 2 days ago


    Talent500 Tech Bengaluru, India

    Responsibilities for Data Engineer: · Create and maintain optimal data pipeline architecture, · Assemble large, complex data sets that meet functional / non-functional business requirements. · Identify, design, and implement internal process improvements: automating manual proces ...

  • LanceTech Solutions

    Data Engineer

    Found in: Talent IN 2A C2 - 17 hours ago


    LanceTech Solutions Mumbai/Bangalore/Chennai/Pune, India permanent

    Data Engineer - SQL, PLSQL, Snowflake, ETL · We're seeking an experienced Data Engineer with expertise in SQL, strong PLSQL skills, Snowflake, and ETL development. As a key member of our team, you'll design and implement data-driven solutions, collaborating with software develope ...