Jobs
>
Data Engineer
>
Chennai

    Data Engineer - Chennai, India - Wenger & Watson Inc

    Wenger & Watson Inc
    Wenger & Watson Inc Chennai, India

    Found in: Appcast Linkedin IN C2 - 1 week ago

    Default job background
    Description

    Exp-3+ yrs

    Location-Chennai(WFO)

    compulsory work from office (1st and last saturday working)

    notice period-30-immediate joiner

    Job Description

    Should have a minimum 6+ years in Data Engineering, Data Analytics platform.

     Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements.

     Should be involved in Requirements Gathering and transforming them to into Functionally and technical design.  Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.

     Design, build and maintain batch or real-time data pipelines in production.  Develop ETL/ELT Data pipeline (extract, transform, load) processes to help extract and manipulate data from multiple sources.  Automate data workflows such as data ingestion, aggregation, and ETL processing and should have good experience with different types of data ingestion techniques: File-based, API-based, streaming data sources (OLTP, OLAP, ODS etc) and heterogeneous databases.  Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders.  Strong experience and implementation of Data lakes, Data warehousing, Data Lakehousing architectures.  Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.  Monitor data systems performance and implement optimization strategies.  Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership.  Experience of AWS tools (AWS S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, Kinesis, DynamoDB, QuickSight etc.).

     Strong experience with Python, SQL, pySpark, Scala, Shell Scripting etc.

     Strong experience with workflow management & Orchestration tools (Airflow,

     Should hold decent experience and understanding of data manipulation/wrangling techniques.

     Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review).

     Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR etc.

     Snowflake Data Warehouse/Platform.

     Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming.

     Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, Ansible etc

     Experience building and deploying solutions to AWS Cloud.  Good experience on NoSQL databases like Dynamo DB, Redis, Cassandra, MongoDB, or Neo4j etc.  Experience with working on large data sets and distributed computing (e.g., Hive/Hadoop/Spark/Presto/MapReduce).  Good to have working knowledge on Data Visualization tools like Tableau, Amazon QuickSight, Power BI, QlikView etc.

     Experience in Insurance domain preferred.

  • KAYA Global

    Data Engineer

    Found in: Talent IN 2A C2 - 5 days ago

    KAYA Global Chennai, India

    As a Senior Azure Data Engineer, your primary role is to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will work closely with data architects, data scientists, and other stakeholders to develop and optimize data pipelines, data storage, a ...

  • InfoCepts

    Data Engineering

    Found in: Appcast Linkedin IN C2 - 1 day ago

    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • iMind Your Business Solutions Private Limited

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    iMind Your Business Solutions Private Limited Chennai/Mumbai/Pune, India permanent

    Company Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...

  • Movate

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • HTC Global Services

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 days ago

    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • RiskInsight Consulting Pvt Ltd.

    Data Engineer

    Found in: Talent IN 2A C2 - 14 hours ago

    RiskInsight Consulting Pvt Ltd. Chennai, India

    Responsibilities · Design, develop, and maintain scalable and efficient data pipelines and ETL processes to support data integration and analytics · Collaborate with data scientists, analysts, and developers to understand data requirements and translate them into technical soluti ...

  • Movate

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • Notus

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    Notus Bangalore/Chennai, India permanent

    AWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintainin ...

  • System Soft Technologies

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 days ago

    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • Hexaware Technologies

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Hexaware Technologies Chennai, India

    Walk -in drive for Azure Data Engineer on 27 Apr at Chennai · Exp: 4 to 15 years · Drive Location: Hexaware Technologies, EB2 Ground Floor, SIPCOT IT Park,Navalur Siruseri Chennai, Tamil Nadu, 601301 · Contact Person: Manoj Kumar.k -TAG · Primary Skills : Databricks with Pyspark ...

  • Optisol Business Solutions

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    Optisol Business Solutions Chennai/Madurai/Coimbatore, India permanent

    Position : Data Engineer( Senior/Lead) · Experience : 4-10 yrs. · Locations : : Immediate -15 Days (Preferred) · Required Candidate Profile : · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pi ...

  • Change leaders

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    Change leaders Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, India permanent

    Primary Skill : · GCP + Python + SQL · OR · - GCP + Java + SQL · NP : Immediate to 35 Days max · Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineer ...

  • Neuron

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Neuron Chennai, India Full time

    Job Description- · Overview: · At Neuron, we believe in a future with seamless connectivity. That's why we're on a mission to transform the connectivity for things that move, making connectivity experiences better for · Everyone. · Our team of tech and telecom experts are buildi ...

  • Encora Inc.

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Encora Inc. Chennai, India

    Description here · Lead Data Engineer · JD : · Qualifications · 5 to 10 years of hands-on Big Data Engineering experience · Excellent communication and collaboration skills · Demonstrated strong leadership skills in leading a team · Key responsibilities include: · Create an ...

  • Hub Work

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Hub Work Chennai, India Full time

    As a Data Engineer - Specialist, you will be responsible for construction and development of "large-scale cloud data processing systems" The Data Engineer must have considerable expertise in data warehousing and the job requires proven coding expertise with Python, Java, SQL, and ...

  • Nityo Infotech

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Nityo Infotech Chennai, India

    Data Engineering- A/SA Relevant Experience in DE:- 5+ years -More than 6 years IT experience-Azure cloud experience is mandatory-ADF, Databricks, Azure DE/ML cloud work experience is mandatory-Good experience on Pyspark and Python-atleast worked 4-5 Data engineering use cases-sho ...

  • Forbes Advisor

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Forbes Advisor Chennai, India Full time

    Job Description · Responsibilities: · Assemble large, complex data that meet functional/non-functional business requirements. · Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing transformation for g ...

  • Vestas

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Vestas Chennai, India Full time

    Vestas is the world leader in wind technology and a driving-force in the development of the wind power industry. Vestas' core business comprises the development, manufacture, sale, marketing, and maintenance of Wind Turbines. Come and join us at Vestas · Applications, Controls & ...

  • Kiash Solutions LLP

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Kiash Solutions LLP Chennai, India Full time, Other

    Location:Chennai,Hyderabad,Bangalore · Mode of Work: Hybrid · Senior Azure Data Engineer: · a. 8+ years of experience in IT Industry · b. 5+ years of experience with Azure Data Engineering Stack (Data Factory, Databricks, Synapse, Event Hub, Cosmos DB, ADLS Gen2, Function app) ...

  • Snaphunt

    Data Engineer

    Found in: Talent IN C2 - 4 days ago

    Snaphunt Chennai, India Full time

    The Offer · Leadership Role · Flexible working options · Opportunity to make a positive impact · The Job · You will be responsible for : · Creating predictive and prescriptive models that could have a positive impact on the business. · Driving all data analytics activities rang ...