Jobs
>
Bengaluru

    Senior Azure Data Engineer - Anywhere in India/Multiple Locations/Bangalore - Marktine Technology Solutions

    Default job background
    permanent Technology / Internet
    Description

    Position :
    Azure Data Engineer.

    Experience : 6+ years.

    Location Remote.


    Skills:
    Snowflake, ADF, python and ETL, spark, scala, SQL.

    • An offshore Data Engineer to work with the Investment Analytics team.
    • This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python.
    • A strong candidate to work with the Data Science team.
    • Collaborate with all the teams to drive discovery and requirements gathering for data management and business analytics efforts.
    • Automate ETL for data feeds many sources, and maintain databases.
    • Automate data validation of data feeds from many sources, to enhance data accuracy.
    • Design and optimize processes for data intake, validation, mining, and engineering.
    • Work on a Scrum team to deliver on projects and initiatives that impact business development, client support, business management, investment management, and all functional areas of the firm.
    • Designing and developing data pipelines: You will design and implement scalable and efficient data pipelines using Azure Databricks, PySpark, and Scala.
    • This includes data ingestion, data transformation, and data loading processes.
    • Data modeling and database design: You will design and implement data models to support efficient data storage, retrieval, and analysis.
    • This may involve working with relational databases, data lakes, or other storage solutions on the Azure platform.
    • Data integration and orchestration: You will leverage Azure Data Factory (ADF) to orchestrate data integration workflows and manage data movement across various data sources and targets.
    • This includes scheduling and monitoring data pipelines.
    • Data quality and governance: You will implement data quality checks, validation rules, and data governance processes to ensure data accuracy, consistency, and compliance with relevant regulations and standards.
    • Performance optimization: You will optimize data pipelines and queries to improve overall system performance and reduce processing time.
    • This may involve tuning SQL queries, optimizing data transformation logic, and leveraging caching techniques.
    • Monitoring and troubleshooting: You will monitor data pipelines, identify performance bottlenecks, and troubleshoot issues related to data ingestion, processing, and transformation.
    • You will work closely with crossfunctional teams to resolve datarelated problems.
    )

  • NatWest Group

    Data Enginer

    6 days ago


    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    1 week ago


    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    1 week ago


    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    3 days ago


    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Deutsche Bank

    Data Engineer-2

    11 hours ago


    Deutsche Bank Bengaluru, Karnataka, India

    **Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...

  • Commonwealth Bank

    Data Engineer-1

    1 week ago


    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...


  • HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...


  • Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Genpact

    Data Engineer

    19 hours ago


    Genpact Bengaluru, India

    Inviting applications for the role of · Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago


    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Recro

    Data Engineer

    19 hours ago


    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · - Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · - Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · - Orchestratio ...

  • Multplyr

    Data Engineers

    1 week ago


    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • Joveo

    Data Engineer

    19 hours ago


    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • SP Software Solutions

    Data Engineer

    5 days ago


    SP Software Solutions Bengaluru, India

    Azure Date Engineer · Multiple Locations in India · (Bengaluru, Chennai, Hyderabad, Kochi, Kolkata, Lucknow, Mumbai, Noida, Pune) · Strong experience in SQL, Azure, Azure Data Factory, Databricks, Python, Spark, PySpark · Moderate experience in CI/CD · Requirements: · Strong pr ...

  • Mobile Programming LLC

    Data Engineer

    1 day ago


    Mobile Programming LLC Bangalore, India

    Job Description : · Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. · As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring t ...

  • Ascendion

    Data Engineer

    19 hours ago


    Ascendion Bengaluru, India

    · Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...

  • Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd

    Data Engineer

    1 week ago


    Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Bengaluru, India

    Greetings from @Teamware Solutions. . · Hope you doing well Join our family Here we are hiring Data Engineer · Job Position: Data Engineer · Job Type: Full-Time · Job Location: Pan India · Job Description: · The right candidate has (Responsibilities); · Provide Wealth Management ...

  • JRD Systems

    Data Engineer

    19 hours ago


    JRD Systems Bengaluru, India

    Role · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...


  • Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • C5i

    Data Engineer

    19 hours ago


    C5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...