Jobs
>
Chennai

    Spark Scala Data Engineer - Chennai, India - CAPCO

    CAPCO
    Default job background
    Description
    Spark Scala Data Engineer - Bangalore/ Chennai

    at Capco India

    Job Title:
    Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with

    Consultancy of the year in the British Bank Award

    and has been ranked

    Top Best Companies for Women in India by

    . With our presence across 32 cities across globe, we support + clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.

    WHY JOIN CAPCO?You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry.

    The projects that will transform the financial services industry.
    MAKE AN IMPACTInnovative thinking, delivery excellence and thought leadership to help our clients transform their business.

    Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.#BEYOURSELFATWORKCapco has a tolerant, open culture that values diversity, inclusivity, and creativity.

    CAREER ADVANCEMENTWith no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

    DIVERSITY & INCLUSIONWe believe that diversity of people and perspective gives us a competitive advantage.
    Location-Sarjapur, Bangalore/ Sholinganallur, Chennai - Hybrid

    Key Skills:
    Data Engineering, Spark, Scala, Airflow, Azure

    Technical Requirement:

    Role:

    Data Engineer / Senior Data EngineerExp:

    7+ YearsResponsibilitiesResponsible for designing, building, and maintaining data pipelines and infrastructure on Microsoft AzureExtract, transform, and load data from various sources including databases, APIs, and flat files.

    Stay up to date with the latest advancements in Azure data technologies and best practices.
    Propose suitable data migration sets to the relevant stakeholders.
    Assist teams with processing the data migration sets as required.

    Assist with the planning, tracking and coordination of the data migration team and with the migration run book and the scope for each customer.

    Role RequirementsStrong Data Analysis experience in Financial ServicesKnowledge of and experience using data models and data dictionaries in a Banking and Financial Markets contextDemonstrate a continual desire to implement "strategic" or "optimal" solutions and where possible, avoid workarounds or short-term tactical solutions.

    Working with stakeholders to ensure that negative customer and business impacts are avoided.
    Manage stakeholder expectations and ensure that robust communication and escalation mechanisms are in place across the project portfolio.

    Good understanding of the control requirement surrounding data handlingExperience/SkillsetProven experience working with Microsoft Azure Data Services, including Data Factory, Data Lake Storage, Synapse Analytics, and Azure SQL Database.

    Strong knowledge of data warehousing, data modeling, and ETL/ELT principles.
    Hands-on experience in Airflow, ElasticPerform data cleansing, transformation, and integration tasks to ensure data quality and consistency.
    Develop and maintain data models for data warehousing, data lakes, and other data storage solutions.

    Proficiency in programming languages like Python, PySpark, Scala, or SQL.Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets contextKnowledge of CI/CD processes for application software integration and deployment, including Maven, Git, and JenkinsImplement and maintain security best practices for data storage and access.

    Monitor and troubleshoot data pipelines and data quality issues.
    Knowledge of COBOL copy book is preferable to migrate the COBOL copy book solution to Azure data solution.
    Document and communicate technical solutions effectively.
    Enthusiastic and energetic problem solver to join an ambitious team.
    Business analysis skills, defining and understanding requirements.
    Attention to detail.

    Good knowledge of SDLC and formal Agile processes, a bias towards TDD and a willingness to test products as part of the delivery cycle.

    Ability to communicate effectively in a multi-program environment across a range of stakeholders.
    Strong verbal and written communication skills


  • Seven Consultancy chennai, India

    SALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...


  • Seven Consultancy Chennai, India

    SALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...

  • Live Connections

    data engineer

    1 day ago


    Live Connections Chennai, India

    We are hiring for product based company for the Chennai location · Role: · Data Engineer. · Mandate Skill: · Data Engineer with Python, data bricks,cicd · Experience: · 2 yrs to 4.5yrs · Notice Period: · Immediate to 60 Days Only · Location: · Chennai (Tamil Nadu Only) · Working ...

  • Hiring Infinity

    Data Engineer

    3 weeks ago


    Hiring Infinity Chennai, India

    Role : Data Engineer · We are looking for a curious Data Engineer to join our extremely fast growing Tech Team · About the organization : · Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds. · Businesses can manage ads across ...

  • WPP

    Data Engineer

    5 days ago


    WPP Chennai, India

    WPP · is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients, and communities. · Working at WPP means being part of a global network of more than 115,000 accomplished people in 110 countries. WPP has headquar ...

  • OptiSol Business Solutions

    Data Engineer

    3 weeks ago


    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, res ...

  • Movate

    Data Engineer

    2 weeks ago


    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • ADCI MAA 15 SEZ

    Data Engineer

    3 weeks ago


    ADCI MAA 15 SEZ chennai, India Full time

    Are you passionate about working with Amazon-scale data, analytics, and data science? · Do you love bringing data together from diverse systems and sources and working on innovative analytics problems for creating deep understanding of customer behavior and generating actionable ...

  • NTT DATA Services

    Data Engineer

    6 days ago


    NTT DATA Services Chennai, India

    Req ID: · 282638 · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Data Engineer to join ou ...

  • WPP

    Data Engineer

    5 days ago


    WPP Chennai, India

    WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients, and communities. · Working at WPP means being part of a global network of more than 115,000 accomplished people in 110 countries. WPP has headquarte ...

  • Aspire Systems

    Data Engineer

    3 weeks ago


    Aspire Systems tamil nadu, India

    Data Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...

  • Encora Inc.

    Data Engineer

    3 weeks ago


    Encora Inc. Chennai, India

    here · Lead Data Engineer · JD : · Qualifications · 5 to 10 years of hands-on Big Data Engineering experience · Excellent communication and collaboration skills · Demonstrated strong leadership skills in leading a team · Key responsibilities include: · Create and maintain data p ...

  • Tessolve

    Data Engineer

    2 weeks ago


    Tessolve Chennai, India Regular Employee - Confirmed

    Job Summary Position : Data Engineer · Experience: years · Location – Chennai · Tessolve Semiconductors a venture of Hero Electronix, part of $5B Hero Group companies a Design and Test Engineering Service Company providing End to End Solutions from Product Engineer ...

  • HTC Global Services

    Data Engineer

    3 weeks ago


    HTC Global Services chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be ...

  • Randstad

    Data Engineer

    3 weeks ago


    Randstad Chennai, India

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • Tazapay Pte Ltd

    Data Engineer

    3 days ago


    Tazapay Pte Ltd Chennai, India Full time

    Job Title - Data Engineer · About Tazapay · Tazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anywhere and Tazapay offers ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    3 weeks ago


    TIGI HR Solution Pvt. Ltd. chennai, India

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • NTT DATA

    Data Engineer

    3 weeks ago


    NTT DATA Chennai, India

    Job Description · Req ID: · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Data Engineer ...

  • Snaphunt

    Data Engineer

    3 weeks ago


    Snaphunt Chennai, India

    The Offer · Leadership Role · Flexible working options · Opportunity to make a positive impact · The Job · You will be responsible for : · Creating predictive and prescriptive models that could have a positive impact on the business. · Driving all data analytics activities rangin ...

  • Live Connections

    Data Engineer

    3 weeks ago


    Live Connections chennai, India

    Immediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark. · Please connect on for a swift profile process. · Role: Data Engineer. · Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark, · Experience: 7+ Yrs Only · Notice Period: Immediat ...