Jobs
>
Chennai

    Spark Scala Data Engineer - chennai, India - CAPCO

    CAPCO
    CAPCO chennai, India

    3 weeks ago

    Default job background
    Description

    Spark Scala Data Engineer - Bangalore/ Chennai

    at Capco India

    Job Title: Data Engineer with Spark and Scala

    About Us

    "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top Best Companies for Women in India by . With our presence across 32 cities across globe, we support + clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.

    WHY JOIN CAPCO?

    You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

    MAKE AN IMPACT

    Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

    #BEYOURSELFATWORK

    Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

    CAREER ADVANCEMENT

    With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

    DIVERSITY & INCLUSION

    We believe that diversity of people and perspective gives us a competitive advantage.

    Location- Sarjapur, Bangalore/ Sholinganallur, Chennai - Hybrid

    Key Skills: Data Engineering, Spark, Scala, Airflow, Azure

    Technical Requirement:

    Role: Data Engineer / Senior Data Engineer

    Exp: 7+ Years

    Responsibilities

  • Responsible for designing, building, and maintaining data pipelines and infrastructure on Microsoft Azure
  • Extract, transform, and load data from various sources including databases, APIs, and flat files.
  • Stay up to date with the latest advancements in Azure data technologies and best practices.
  • Propose suitable data migration sets to the relevant stakeholders.
  • Assist teams with processing the data migration sets as required.
  • Assist with the planning, tracking and coordination of the data migration team and with the migration run book and the scope for each customer.

    • Role Requirements

  • Strong Data Analysis experience in Financial Services
  • Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context
  • Demonstrate a continual desire to implement "strategic" or "optimal" solutions and where possible, avoid workarounds or short-term tactical solutions.
  • Working with stakeholders to ensure that negative customer and business impacts are avoided.
  • Manage stakeholder expectations and ensure that robust communication and escalation mechanisms are in place across the project portfolio.
  • Good understanding of the control requirement surrounding data handling

    • Experience/Skillset

  • Proven experience working with Microsoft Azure Data Services, including Data Factory, Data Lake Storage, Synapse Analytics, and Azure SQL Database.
  • Strong knowledge of data warehousing, data modeling, and ETL/ELT principles.
  • Hands-on experience in Airflow, Elastic
  • Perform data cleansing, transformation, and integration tasks to ensure data quality and consistency.
  • Develop and maintain data models for data warehousing, data lakes, and other data storage solutions.
  • Proficiency in programming languages like Python, PySpark, Scala, or SQL.
  • Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context
  • Knowledge of CI/CD processes for application software integration and deployment, including Maven, Git, and Jenkins
  • Implement and maintain security best practices for data storage and access.
  • Monitor and troubleshoot data pipelines and data quality issues.
  • Knowledge of COBOL copy book is preferable to migrate the COBOL copy book solution to Azure data solution.
  • Document and communicate technical solutions effectively.
  • Enthusiastic and energetic problem solver to join an ambitious team.
  • Business analysis skills, defining and understanding requirements.
  • Attention to detail.
  • Good knowledge of SDLC and formal Agile processes, a bias towards TDD and a willingness to test products as part of the delivery cycle.
  • Ability to communicate effectively in a multi-program environment across a range of stakeholders.
  • Strong verbal and written communication skills
  • Seven Consultancy

    Jobs For Data Engineer

    3 weeks ago

    Seven Consultancy chennai, India

    SALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...

  • Seven Consultancy

    Jobs For Data Engineer

    2 weeks ago

    Seven Consultancy Chennai, India

    SALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...

  • Live Connections

    data engineer

    1 day ago

    Live Connections Chennai, India

    We are hiring for product based company for the Chennai location · Role: · Data Engineer. · Mandate Skill: · Data Engineer with Python, data bricks,cicd · Experience: · 2 yrs to 4.5yrs · Notice Period: · Immediate to 60 Days Only · Location: · Chennai (Tamil Nadu Only) · Working ...

  • WPP

    Data Engineer

    5 days ago

    WPP Chennai, India

    WPP · is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients, and communities. · Working at WPP means being part of a global network of more than 115,000 accomplished people in 110 countries. WPP has headquar ...

  • OptiSol Business Solutions

    Data Engineer

    3 weeks ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, res ...

  • NTT DATA Services

    Data Engineer

    6 days ago

    NTT DATA Services Chennai, India

    Req ID: · 282638 · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Data Engineer to join ou ...

  • Randstad

    Data Engineer

    3 weeks ago

    Randstad Chennai, India

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • HTC Global Services

    Data Engineer

    3 weeks ago

    HTC Global Services chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be ...

  • NTT DATA

    Data Engineer

    3 weeks ago

    NTT DATA Chennai, India

    Job Description · Req ID: · NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. · We are currently seeking a Data Engineer ...

  • Live Connections

    Data Engineer

    3 weeks ago

    Live Connections chennai, India

    Immediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark. · Please connect on for a swift profile process. · Role: Data Engineer. · Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark, · Experience: 7+ Yrs Only · Notice Period: Immediat ...

  • Astonishic LLC

    Data Engineer

    3 weeks ago

    Astonishic LLC Chennai, India

    Title : Data Engineer - Databricks Specialist · Location : Chennai, Tamil Nadu · Experience : 2-6 years · Employment Type : Onsite · Number of Positions : 10 · Job Description : · - Design, build, and maintain scalable and robust data pipelines using Databricks. · - Develop an ...

  • Movate

    Data Engineer

    2 weeks ago

    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • Cynosure Corporate Solutions

    Data Engineer

    3 weeks ago

    Cynosure Corporate Solutions chennai, India

    Lead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data ...

  • Snaphunt

    Data Engineer

    3 weeks ago

    Snaphunt Chennai, India

    The Offer · Leadership Role · Flexible working options · Opportunity to make a positive impact · The Job · You will be responsible for : · Creating predictive and prescriptive models that could have a positive impact on the business. · Driving all data analytics activities rangin ...

  • Blackstraw

    Data Engineer

    3 weeks ago

    Blackstraw tamil nadu, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exampl ...

  • Talent Join

    Data Engineer

    3 weeks ago

    Talent Join Chennai, India

    We have an immediate need for the DataEngineer role for one of our clients. Please have a look at the jobdescription and let us know if you are interested. Please shareyour updated profile on () or can call () and I will getback to you soon. · Role:Data Engineer · Location:Banga ...

  • Tessolve

    Data Engineer

    2 weeks ago

    Tessolve Chennai, India Regular Employee - Confirmed

    Job Summary Position : Data Engineer · Experience: years · Location – Chennai · Tessolve Semiconductors a venture of Hero Electronix, part of $5B Hero Group companies a Design and Test Engineering Service Company providing End to End Solutions from Product Engineer ...

  • Cynosure Corporate Solutions

    Data Engineering

    3 weeks ago

    Cynosure Corporate Solutions Chennai, India Full time

    Job Description: · We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data syst ...

  • Hiring Infinity

    Data Engineer

    3 weeks ago

    Hiring Infinity Chennai, India

    Role : Data Engineer · We are looking for a curious Data Engineer to join our extremely fast growing Tech Team · About the organization : · Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds. · Businesses can manage ads across ...

  • ADCI MAA 15 SEZ

    Data Engineer

    3 weeks ago

    ADCI MAA 15 SEZ chennai, India Full time

    Are you passionate about working with Amazon-scale data, analytics, and data science? · Do you love bringing data together from diverse systems and sources and working on innovative analytics problems for creating deep understanding of customer behavior and generating actionable ...