Jobs
>
Chennai

    Spark Scala Data Engineer - chennai, India - CAPCO

    CAPCO
    CAPCO chennai, India

    2 weeks ago

    Default job background
    Description

    Spark Scala Data Engineer - Bangalore/ Chennai

    at Capco India

    Job Title: Data Engineer with Spark and Scala

    About Us

    "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top Best Companies for Women in India by . With our presence across 32 cities across globe, we support + clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.

    WHY JOIN CAPCO?

    You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

    MAKE AN IMPACT

    Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

    #BEYOURSELFATWORK

    Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

    CAREER ADVANCEMENT

    With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

    DIVERSITY & INCLUSION

    We believe that diversity of people and perspective gives us a competitive advantage.

    Location- Sarjapur, Bangalore/ Sholinganallur, Chennai - Hybrid

    Key Skills: Data Engineering, Spark, Scala, Airflow, Azure

    Technical Requirement:

    Role: Data Engineer / Senior Data Engineer

    Exp: 7+ Years

    Responsibilities

  • Responsible for designing, building, and maintaining data pipelines and infrastructure on Microsoft Azure
  • Extract, transform, and load data from various sources including databases, APIs, and flat files.
  • Stay up to date with the latest advancements in Azure data technologies and best practices.
  • Propose suitable data migration sets to the relevant stakeholders.
  • Assist teams with processing the data migration sets as required.
  • Assist with the planning, tracking and coordination of the data migration team and with the migration run book and the scope for each customer.

    • Role Requirements

  • Strong Data Analysis experience in Financial Services
  • Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context
  • Demonstrate a continual desire to implement "strategic" or "optimal" solutions and where possible, avoid workarounds or short-term tactical solutions.
  • Working with stakeholders to ensure that negative customer and business impacts are avoided.
  • Manage stakeholder expectations and ensure that robust communication and escalation mechanisms are in place across the project portfolio.
  • Good understanding of the control requirement surrounding data handling

    • Experience/Skillset

  • Proven experience working with Microsoft Azure Data Services, including Data Factory, Data Lake Storage, Synapse Analytics, and Azure SQL Database.
  • Strong knowledge of data warehousing, data modeling, and ETL/ELT principles.
  • Hands-on experience in Airflow, Elastic
  • Perform data cleansing, transformation, and integration tasks to ensure data quality and consistency.
  • Develop and maintain data models for data warehousing, data lakes, and other data storage solutions.
  • Proficiency in programming languages like Python, PySpark, Scala, or SQL.
  • Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context
  • Knowledge of CI/CD processes for application software integration and deployment, including Maven, Git, and Jenkins
  • Implement and maintain security best practices for data storage and access.
  • Monitor and troubleshoot data pipelines and data quality issues.
  • Knowledge of COBOL copy book is preferable to migrate the COBOL copy book solution to Azure data solution.
  • Document and communicate technical solutions effectively.
  • Enthusiastic and energetic problem solver to join an ambitious team.
  • Business analysis skills, defining and understanding requirements.
  • Attention to detail.
  • Good knowledge of SDLC and formal Agile processes, a bias towards TDD and a willingness to test products as part of the delivery cycle.
  • Ability to communicate effectively in a multi-program environment across a range of stakeholders.
  • Strong verbal and written communication skills
  • Seven Consultancy

    Jobs For Data Engineer

    2 weeks ago

    Seven Consultancy chennai, India

    SALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...

  • Seven Consultancy

    Jobs For Data Engineer

    1 week ago

    Seven Consultancy Chennai, India

    SALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...

  • OptiSol Business Solutions

    Data Engineer

    2 weeks ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, res ...

  • Randstad

    Data Engineer

    2 weeks ago

    Randstad Chennai, India

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • NTT DATA

    Data Engineer

    2 weeks ago

    NTT DATA Chennai, India

    Job Description · Req ID: · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Data Engineer ...

  • Hiring Infinity

    Data Engineer

    2 weeks ago

    Hiring Infinity Chennai, India

    Role : Data Engineer · We are looking for a curious Data Engineer to join our extremely fast growing Tech Team · About the organization : · Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds. · Businesses can manage ads across ...

  • Cynosure Corporate Solutions

    Data Engineer

    2 weeks ago

    Cynosure Corporate Solutions chennai, India

    Lead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data ...

  • Protiviti India Member Private limited

    Data Engineer

    2 weeks ago

    Protiviti India Member Private limited Chennai, India

    Job Description : · - Looking for Data engineer with minimum 5years exp in Data Migration, Data warehousing, AWS, SQL, Python. · - Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services · - Dyn ...

  • System Soft Technologies

    Data Engineer

    3 weeks ago

    System Soft Technologies Chennai, India

    · Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    2 weeks ago

    RiskInsight Consulting Pvt Ltd chennai, India

    About the job : · Responsibilities : · - Design, develop, and maintain scalable and efficient data pipelines and ETL processes to support data integration and analytics · - Collaborate with data scientists, analysts, and developers to understand data requirements and translate th ...

  • Movate

    Data Engineer

    1 week ago

    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • NTT DATA

    Data Engineer

    2 weeks ago

    NTT DATA Chennai, India

    Job Description · Req ID: · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Data Engineer ...

  • Ford Motor Company

    Data Engineer

    3 weeks ago

    Ford Motor Company Chennai, India Full time

    GDIA Data Tech Connected Vehicle is the business owner of the enterprise data lake for all global embedded modem, Smart Mobility experiment and Ford Pass data. The role of the Data Engineer is a critical enabler to the development of Ford's Data Supply Chain including Connected V ...

  • HTC Global Services

    Data Engineer

    2 weeks ago

    HTC Global Services chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be ...

  • Tessolve

    Data Engineer

    1 week ago

    Tessolve Chennai, India Regular Employee - Confirmed

    Job Summary Position : Data Engineer · Experience: years · Location – Chennai · Tessolve Semiconductors a venture of Hero Electronix, part of $5B Hero Group companies a Design and Test Engineering Service Company providing End to End Solutions from Product Engineer ...

  • Live Connections

    Data Engineer

    2 weeks ago

    Live Connections chennai, India

    Immediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark. · Please connect on for a swift profile process. · Role: Data Engineer. · Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark, · Experience: 7+ Yrs Only · Notice Period: Immediat ...

  • Snaphunt

    Data Engineer

    2 weeks ago

    Snaphunt Chennai, India

    The Offer · Leadership Role · Flexible working options · Opportunity to make a positive impact · The Job · You will be responsible for : · Creating predictive and prescriptive models that could have a positive impact on the business. · Driving all data analytics activities rangin ...

  • Blackstraw

    Data Engineer

    2 weeks ago

    Blackstraw tamil nadu, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exampl ...

  • Talent Join

    Data Engineer

    2 weeks ago

    Talent Join Chennai, India

    We have an immediate need for the DataEngineer role for one of our clients. Please have a look at the jobdescription and let us know if you are interested. Please shareyour updated profile on () or can call () and I will getback to you soon. · Role:Data Engineer · Location:Banga ...

  • BU Soft Tech

    Data Engineer

    3 weeks ago

    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...