Jobs
>
Data Engineer
>
Chennai

    Data Engineer - Chennai, India - Integrate

    Integrate
    Integrate Chennai, India

    1 week ago

    Default job background
    Technology / Internet
    Description


    Role:
    Data Engineer L2

    Experience:
    4-6 yrs

    Skills required:
    Snowflake, spark, SQL, python

    Work Location:
    Global Infocity, Chennai

    Model:
    Hybrid


    About us :


    Integrate is the leader in Demand Management, an emerging category to help B2B marketers develop and deliver an omnichannel demand strategy, convert leads to revenue and drive marketing ROI.

    Over the past decade, Integrate has evolved from solving complex challenges across each demand generation channel to powering buyer-driven omnichannel experiences.

    Today, we help marketers orchestrate connected buying experiences that drive qualified conversations at scale, simplify ABM management and accelerate revenue generation.

    Our culture has allowed Integrate to be recognized as one of the best places to work for many years. We are a remote-first type company where you will find Integrators across the globe.

    The

    Role:
    Integrate's data is treated as a critical corporate asset and is seen as a competitive advantage in our business. As a Lead Data Engineer you will be working in one of the world's largest cloud-based data lakes.

    You should be skilled in the architecture of data warehouse solutions for the Enterprise using multiple platforms (EMR, RDBMS, Columnar, Cloud, Snowflake).

    You should have extensive experience in the design, creation, management, and business use of extremely large datasets.

    You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions.

    Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change.


    Responsibilities:


    Design and develop workflows, programs, and ETL to support data ingestion, curation, and provisioning of fragmented data for Data Analytics, Product Analytics and AI.

    Work closely with Data Scientists, Software Engineers, Product Managers, Product Analysts and other key stakeholders to gather and define requirements for Integrate's data needs.

    Use Scala, SQL Snowflake, and BI tools to deliver data to customers.
    Understand MongoDB/PostgreSQL and transactional data workflows.
    Design data models and build data architecture that enables reporting, analytics, advanced AI/ML and Generative AI solutions.
    Develop an understanding of the data and build business acumen.
    Develop and maintain Datawarehouse and Datamart in the cloud using Snowflake.
    Create reporting dashboards for internal and client stakeholders.
    Understand the business use cases and customer value behind large sets of data and develop meaningful analytic solutions.


    Basic Qualifications:
    Advanced degree in Statistics, Computer Science or related technical/scientific field.
    3+ years experience in a Data Engineer development role.
    Advanced knowledge of SQL, Python, and data processing workflow.
    Nice to have Spark/Scala, MLFlow, and AWS experience.
    Strong experience and advanced technical skills writing APIs.
    Extensive knowledge of Data Warehousing, ETL and BI architectures, concepts, and frameworks.

    And also strong in metadata definition, data migration and integration with emphasis on both high end OLTP and business Intelligence solutions.

    Develop complex Stored procedure and queries to provide to the application along with reporting solutions too.
    Optimize slow-running queries and optimize query performance.
    Create optimized queries and data migration scripts
    Leadership skillsets to mentor and train junior team members and stakeholders.
    Capable of creating long-term and short-term data architecture vision and tactical roadmap to achieve the data architecture vision beginning from the current state
    Strong data management abilities (i.e., understanding data reconciliations).
    Capable of facilitating data discovery sessions involving business subject matter experts.
    Strong communication/partnership skills to gain the trust of stakeholders.

    Knowledge of professional software engineering practices & best practices for the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations.


    Preferred Qualifications:


    Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.

    Experience building data products incrementally and integrating and managing datasets from multiple sources.
    Query performance tuning skills using Unix profiling tools and SQL

    Experience leading large-scale data warehousing and analytics projects, including using AWS technologies – Snowflake, Redshift, S3, EC2, Data-pipeline and other big data technologies.

  • Seven Consultancy

    Jobs For Data Engineer

    5 days ago

    Seven Consultancy chennai, India

    SALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...

  • Seven Consultancy

    Jobs For Data Engineer

    5 days ago

    Seven Consultancy Chennai, India

    SALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...

  • BU Soft Tech

    Data Engineer

    1 week ago

    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...

  • OptiSol Business Solutions

    Data Engineer

    5 days ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, res ...

  • InfoCepts

    Data Engineering

    5 days ago

    InfoCepts chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, ...

  • Aspire Systems

    Data Engineer

    5 days ago

    Aspire Systems tamil nadu, India

    Data Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...

  • Altimetrik

    Data Engineer

    1 week ago

    Altimetrik Chennai, India

    Role: Data Engineer · Years of experience: 4-10. · Job Location: Chennai · Job Description: · Position Overview: We are seeking a skilled Data Engineer with a solid understanding of Google Cloud Platform (GCP) technologies. The ideal candidate will have extensive experience with ...

  • Live Connections

    Data Engineer

    5 days ago

    Live Connections chennai, India

    Immediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark. · Please connect on for a swift profile process. · Role: Data Engineer. · Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark, · Experience: 7+ Yrs Only · Notice Period: Immediat ...

  • Culture Highway

    Data Engineer

    5 days ago

    Culture Highway Chennai, India Full time

    Job Description : Tech Anchor- Data Engineering Role Overview : Tech Anchor- Data Engineering, you will play a crucial role in leading and driving data Engineering initiatives. · You will be responsible for designing, implementing and optimizing data pipelines, ensuring data qual ...

  • HTC Global Services

    Data Engineer

    5 days ago

    HTC Global Services chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be ...

  • Insight Global

    Data Engineer

    1 week ago

    Insight Global Chennai, India

    12-16hr USD · Required Skills & Experience · *Bachelors degree in computer science · 6-8 years of data engineering experience · Writing SQL and schema buildout, including star schemas, constellations, and snowflake schemas · Experience with ETL tool, such as SSIS · Big data techn ...

  • Movate

    Data Engineer

    3 weeks ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • Blackstraw

    Data Engineer

    5 days ago

    Blackstraw tamil nadu, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exampl ...

  • Mindsprint

    Data Engineer

    2 weeks ago

    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • iTechMinds Consulting LLP

    Data Engineer

    5 days ago

    iTechMinds Consulting LLP Chennai, India

    Position : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...

  • hubwork

    Data Engineer

    5 days ago

    hubwork Chennai, India permanent

    Summary : · We are looking for a data engineer who has experience in building data pipelines for large data · platforms. This role will be working with a team building a large data platform catering to the needs of a wealth manager for their application and analytics needs. This ...

  • System Soft Technologies

    Data Engineer

    1 week ago

    System Soft Technologies Chennai, India

    · Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, ...

  • Cortex Consulting Pvt. Ltd.

    Data Engineer

    5 days ago

    Cortex Consulting Pvt. Ltd. chennai, India

    Responsibilities : · - Design, construct, install, test, and maintain highly scalable data management systems. · - Develop and implement ETL processes to collect, store, and process data from various sources. · - Build and optimize data pipelines for efficient data ingestion and ...

  • U-SET

    Data Engineer

    5 days ago

    U-SET Chennai, India permanent

    Data Engineer - ETL with Python, Spark & Hadoop · Women's Drive - 2nd March -Chennai - Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions · - Craft and implement data pipelines ...

  • Randstad

    Data Engineer

    5 days ago

    Randstad Chennai, India

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...