Jobs
>
Chennai

    Lead Data Engineer - Chennai, India - Integrate

    Integrate
    Integrate Chennai, India

    6 days ago

    Default job background
    Technology / Internet
    Description

    Role: Lead Data Engineer

    Work Location: Global Infocity, Chennai

    Model: Hybrid

    About us:

    Integrate is the leader in Demand Management, an emerging category to help B2B marketers develop and deliver an omnichannel demand strategy, convert leads to revenue and drive marketing ROI. Over the past decade, Integrate has evolved from solving complex challenges across each demand generation channel to powering buyer-driven omnichannel experiences. Today, we help marketers orchestrate connected buying experiences that drive qualified conversations at scale, simplify ABM management and accelerate revenue generation.

    Our culture has allowed Integrate to be recognized as one of the best places to work for many years. We are a remote-first type company where you will find Integrators across the globe.

    The Role:

    Integrate's data is treated as a critical corporate asset and is seen as a competitive advantage in our business. As a Lead Data Engineer you will be working in one of the world's largest cloud-based data lakes. You should be skilled in the architecture of data warehouse solutions for the Enterprise using multiple platforms (EMR, RDBMS, Columnar, Cloud, Snowflake). You should have extensive experience in the design, creation, management, and business use of extremely large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change.

    Responsibilities:

    • Design and develop workflows, programs, and ETL to support data ingestion, curation, and provisioning of fragmented data for Data Analytics, Product Analytics and AI.
    • Work closely with Data Scientists, Software Engineers, Product Managers, Product Analysts and other key stakeholders to gather and define requirements for Integrate's data needs.
    • Use Scala, SQL Snowflake, and BI tools to deliver data to customers.
    • Understand MongoDB/PostgreSQL and transactional data workflows.
    • Design data models and build data architecture that enables reporting, analytics, advanced AI/ML and Generative AI solutions.
    • Develop an understanding of the data and build business acumen.
    • Develop and maintain Datawarehouse and Datamart in the cloud using Snowflake.
    • Create reporting dashboards for internal and client stakeholders.
    • Understand the business use cases and customer value behind large sets of data and develop meaningful analytic solutions.

    Basic Qualifications:

    • Advanced degree in Statistics, Computer Science or related technical/scientific field.
    • 7+ years experience in a Data Engineer development role.
    • Advanced knowledge of SQL, Python, and data processing workflow.
    • Nice to have Spark/Scala, MLFlow, and AWS experience.
    • Strong experience and advanced technical skills writing APIs.
    • Extensive knowledge of Data Warehousing, ETL and BI architectures, concepts, and frameworks. And also strong in metadata definition, data migration and integration with emphasis on both high end OLTP and business Intelligence solutions.
    • Develop complex Stored procedure and queries to provide to the application along with reporting solutions too.
    • Optimize slow-running queries and optimize query performance.
    • Create optimized queries and data migration scripts
    • Leadership skillsets to mentor and train junior team members and stakeholders.
    • Capable of creating long-term and short-term data architecture vision and tactical roadmap to achieve the data architecture vision beginning from the current state
    • Strong data management abilities (i.e., understanding data reconciliations).
    • Capable of facilitating data discovery sessions involving business subject matter experts.
    • Strong communication/partnership skills to gain the trust of stakeholders.
    • Knowledge of professional software engineering practices & best practices for the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations.

    Preferred Qualifications:

    • Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.
    • Experience building data products incrementally and integrating and managing datasets from multiple sources.
    • Query performance tuning skills using Unix profiling tools and SQL
    • Experience leading large-scale data warehousing and analytics projects, including using AWS technologies – Snowflake, Redshift, S3, EC2, Data-pipeline and other big data technologies.
  • BU Soft Tech

    Data Engineer

    16 hours ago

    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...

  • HTC Global Services

    Data Engineer

    16 hours ago

    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • InfoCepts

    Data Engineering

    1 week ago

    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • OptiSol Business Solutions

    Data Engineer

    5 days ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...

  • Movate

    Data Engineer

    3 days ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • Ashley Global Capability Center

    Data Engineer

    5 days ago

    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • HTC Global Services

    Data Engineer

    5 days ago

    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • Blackstraw

    Data Engineer

    4 days ago

    Blackstraw Chennai, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...

  • Mindsprint

    Data Engineer

    5 days ago

    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    1 week ago

    TIGI HR Solution Pvt. Ltd. Chennai, India permanent

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • Change leaders

    Data Engineer

    5 days ago

    Change leaders Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, India permanent

    Primary Skill : · GCP + Python + SQL · OR · - GCP + Java + SQL · NP : Immediate to 35 Days max · Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineer ...

  • System Soft Technologies

    Data Engineer

    4 days ago

    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • Movate

    Data Engineer

    6 days ago

    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • iTechMinds Consulting LLP

    Data Engineer

    5 days ago

    iTechMinds Consulting LLP Chennai, India

    Position : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...

  • iMind Your Business Solutions Private Limited

    Data Engineer

    5 days ago

    iMind Your Business Solutions Private Limited Chennai/Mumbai/Pune, India permanent

    Company Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...

  • Randstad

    Data Engineer

    1 week ago

    Randstad Chennai, India permanent

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • Vysystems

    Data Engineer

    5 days ago

    Vysystems Chennai, India

    Top job opening for MNC Company · We have an immediate opening for "Data Engineer" with MNC Company for permanent Position - Chennai Location · Job Description : · Roles and Responsibilities: · Critical Skills to Possess: · Essential: · - Strong experience with Postgres and SQL a ...

  • CliqHR

    Data Engineer

    1 week ago

    CliqHR Chennai, India permanent

    Job Description : · Mandatory Skills : GCP, Python, SQL, Snap logic, Airflow, Data flow · - 6-8 years of experience in to GCP Data engineer. · - GCP Components (Composer, BQ, Data flow, Pub/Sub, Cloud functions, GCS storage) Intermediate · - SQL Advanced level · - ETL Processing ...

  • System Soft Technologies

    Data Engineer

    1 week ago

    System Soft Technologies Chennai, India

    Job Summary:We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ena ...

  • Hexaware Technologies

    Data Engineer

    3 days ago

    Hexaware Technologies Chennai, India

    Walk -in drive for Azure Data Engineer on 27 Apr at Chennai · Exp: 4 to 15 years · Drive Location: Hexaware Technologies, EB2 Ground Floor, SIPCOT IT Park,Navalur Siruseri Chennai, Tamil Nadu, 601301 · Contact Person: Manoj Kumar.k -TAG · Primary Skills : Databricks with Pyspark ...