Jobs
>
Hyderabad

    Azure Data Engineer - hyderabad, India - ValueLabs

    ValueLabs
    ValueLabs hyderabad, India

    3 weeks ago

    ValueLabs background
    Technology / Internet
    Description

    Job Title:
    Azure Data Engineer

    Experience: 5+ years


    Must have Skills:
    ADF, SQL Server, Databricks Notebooks, Data Pipelines, SPROCs (Stored Procedures), DataWarehouse, Databricks DataLake

    Job Description:


    The Data Engineer is responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes for an organization.

    They work closely with data scientists, analysts, and other stakeholders to ensure that data is efficiently stored, processed, and accessible for analysis.

    The Data Engineer must have a strong understanding of various data technologies, including ADF (Azure Data Factory), SQL Server, Databricks Notebooks, and SPROCs (Stored Procedures).


    Key Responsibilities:

    • Design and develop data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes.
    • Create and maintain data models, schemas, and data structures in SQL Server and Databricks Data Lake.
    • Develop and optimize SPROCs for efficient data retrieval and manipulation.
    • Collaborate with data scientists, analysts, and other team members to understand data requirements and ensure data quality.
    • Monitor and troubleshoot data pipeline issues, and implement improvements to enhance performance and reliability.
    • Develop and maintain data documentation, including data dictionaries, pipeline diagrams, and data quality reports.
    • Stay current with new technologies, tools, and best practices in the data engineering field.

    Requirements:

    • Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
    • Strong programming skills in languages such as Python, R, or Scala.
    • Experience with data engineering tools and platforms, including ADF, SQL Server, Databricks Notebooks, and data pipelines.
    • Familiarity with data warehousing concepts and technologies.
    • Strong understanding of data modeling, ETL processes, and data quality principles.
    • Excellent problem-solving, analytical, and communication skills.
    • Ability to work independently and collaboratively in a fast-paced environment.
  • programming

    Data Engineer

    3 weeks ago

    programming Hyderabad, India

    Job Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...

  • Akrivia HCM

    Data Engineer

    2 weeks ago

    Akrivia HCM Hyderabad, India

    We are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...

  • G5

    Data Engineer

    3 weeks ago

    G5 hyderabad, India

    We are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...

  • Highspot

    Data Engineer

    3 weeks ago

    Highspot hyderabad, India

    What You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    6 days ago

    RiskInsight Consulting Pvt Ltd Hyderabad, India Full time

    Key Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...

  • ADP

    Data Engineer

    3 weeks ago

    ADP Hyderabad, India

    ***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago

    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...

  • Innova Solutions India

    Data Engineer

    3 weeks ago

    Innova Solutions India hyderabad, India

    JOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...

  • ServCrust

    Data Engineer

    3 weeks ago

    ServCrust hyderabad, India

    Job Title: Data Engineer · Experience Level: 3-4 years · Location: Hyderabad · Job Type: Full-time · About Us: · ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP and Fintech platform. Its ease of commerce solutions are b ...

  • Microsoft

    Data Engineer

    3 weeks ago

    Microsoft hyderabad, India

    Overview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...

  • WALLERO TECHNOLOGIES PRIVATE LIMITED

    Data Engineer

    5 days ago

    WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, India

    Roles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...

  • State Street

    Data Engineer

    1 week ago

    State Street Hyderabad, India Full time

    Role Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...

  • Appen

    Data Engineer

    3 weeks ago

    Appen hyderabad, India

    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In add ...

  • Unison Consulting Pte Ltd

    Data Engineer

    3 weeks ago

    Unison Consulting Pte Ltd hyderabad, India

    Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions. · Continuously improve security & observability telemetry services based on input from a divers ...

  • Anblicks

    Data Engineer

    4 weeks ago

    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago

    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineering - Senior Manager PwC US - Acceleration Center is seeking a seasoned and visionary GenAI Data Engineer to join our team at the Senior Manager level. In this leadership role, you will oversee the development and enhancement of data pipeline ...

  • Two95 International Inc.

    Data Engineer

    4 weeks ago

    Two95 International Inc. Hyderabad, India

    Title: Data Engineer · Type: Full Time · Location: Hyderabad · Salary: · Open (INR) · Requirements · Job Description · Apply strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting sol ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    1 week ago

    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • Nityo Infotech

    Data Engineer

    3 weeks ago

    Nityo Infotech hyderabad, India

    · •More than 6 years IT experience · •Azure cloud experience is mandatory · •ADF, Databricks, Azure DE/ML cloud work experience is mandatory · •Good experience on Pyspark and Python · •atleast worked 4-5 Data engineering use cases · •should good understanding of DE concepts · •C ...

  • Aragen Life Sciences

    Data Engineer

    3 weeks ago

    Aragen Life Sciences hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...