Jobs
>
Data Engineer
>
Hyderabad

    Data Engineer - Hyderabad, India - Akrivia HCM

    Akrivia HCM
    Akrivia HCM Hyderabad, India

    2 weeks ago

    Default job background
    Description

    We are in search of a Data Engineer who specializes in cloud-based data warehousing solutions to bolster our advanced analytics and data science initiatives.

    The perfect candidate will possess vast expertise in crafting, constructing, and upkeeping scalable and dependable data warehouses, along with proficiency in data retrieval and orchestration within cloud environments like AWS and Azure.


    Location:
    Hyderabad/Visakhapatnam


    Main Responsibilities:
    - Devise and execute resilient, scalable data warehouse solutions on AWS and Azure platforms.
    - Establish and uphold an efficient data pipeline architecture for data intake, transformation, and dissemination processes.

    - Construct efficient ETL processes and frameworks for data loading from diverse sources leveraging AWS or Azure 'big data' technologies.

    - Collaborate with stakeholders from Executive, Product, Data, and Design teams to address data-related technical challenges and cater to their data infrastructure requirements.

    - Ensure data security across different regions and data centers within AWS.
    - Compile extensive, intricate datasets that fulfill business requirements, both functional and non-functional.
    - Recognize, devise, and execute internal process enhancements such as automation of manual tasks, enhancing data delivery, and restructuring infrastructure for enhanced scalability, among others.

    - Collaborate with analytics and business team members to refine data models powering business intelligence tools, enhancing data accessibility, and promoting data-influenced decision-making company-wide.

    - Develop data utilities for analytics and data science teams to aid them in enhancing and refining our product to become a frontrunner in the industry.


    Requirements:
    - BA/BS in Computer Science, Engineering, or a related field, or equivalent practical experience.
    - Proficient analytical skills in handling unstructured datasets.
    - Hands-on experience in constructing and optimizing 'big data' data pipelines, architectures, and datasets.

    Experience with AWS services:
    - EC2, EMR, RDS, Redshift.

    Experience with Azure services:
    - Azure SQL Data Warehouse, Azure Data Lake, HDInsight.
    - Familiarity with stream-processing systems like Kinesis, Kafka, Storm, or Spark-Streaming.
    - Proficiency in object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.
    - Proficient in message queuing, stream processing, and highly scalable 'big data' data stores.
    - Strong project management and organizational capabilities.


    Preferred Skills:
    - Familiarity with data pipeline and workflow management tools like Azkaban, Luigi, Airflow, etc.
    - Experience in data retrieval and orchestration, coupled with knowledge of best practices in data warehousing.
    - Certifications in AWS or Azure cloud technologies.

    - Profound understanding of SQL and hands-on experience with relational databases, query formulation, and familiarity with various database types.

  • ADP

    Data Engineer

    3 weeks ago

    ADP Hyderabad, India

    ***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago

    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...

  • programming

    Data Engineer

    3 weeks ago

    programming Hyderabad, India

    Job Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...

  • Innova Solutions India

    Data Engineer

    3 weeks ago

    Innova Solutions India hyderabad, India

    JOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...

  • Microsoft

    Data Engineer

    3 weeks ago

    Microsoft hyderabad, India

    Overview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...

  • WALLERO TECHNOLOGIES PRIVATE LIMITED

    Data Engineer

    5 days ago

    WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, India

    Roles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...

  • G5

    Data Engineer

    3 weeks ago

    G5 hyderabad, India

    We are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...

  • Highspot

    Data Engineer

    3 weeks ago

    Highspot hyderabad, India

    What You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...

  • State Street

    Data Engineer

    1 week ago

    State Street Hyderabad, India Full time

    Role Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...

  • Appen

    Data Engineer

    3 weeks ago

    Appen hyderabad, India

    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In add ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    1 week ago

    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    6 days ago

    RiskInsight Consulting Pvt Ltd Hyderabad, India Full time

    Key Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...

  • ServCrust

    Data Engineer

    3 weeks ago

    ServCrust hyderabad, India

    Job Title: Data Engineer · Experience Level: 3-4 years · Location: Hyderabad · Job Type: Full-time · About Us: · ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP and Fintech platform. Its ease of commerce solutions are b ...

  • Aragen Life Sciences

    Data Engineer

    3 weeks ago

    Aragen Life Sciences hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...

  • Microsoft

    Data Engineer

    3 weeks ago

    Microsoft Hyderabad, India

    Overview · Come join an evolving team with a growth mindset, explore your passion and do your best work. "Operations Digital Solutions" Organization under "Finance Data & Experiences" is an Org that enables digital transformation for "Microsoft Business Operations". One of the ke ...

  • Nityo Infotech

    Data Engineer

    3 weeks ago

    Nityo Infotech hyderabad, India

    · •More than 6 years IT experience · •Azure cloud experience is mandatory · •ADF, Databricks, Azure DE/ML cloud work experience is mandatory · •Good experience on Pyspark and Python · •atleast worked 4-5 Data engineering use cases · •should good understanding of DE concepts · •C ...

  • Anblicks

    Data Engineer

    4 weeks ago

    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...

  • DAZN

    Data Engineer

    4 weeks ago

    DAZN Hyderabad, India

    We are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. ...

  • TechnoGen India Pvt. Ltd.

    Data Engineer

    3 weeks ago

    TechnoGen India Pvt. Ltd. hyderabad, India

    5+ years served as Data Engineer or Data Operations role · 5+ years of experience working with SQL · Extensive experience with Microsoft Azure Data Lake, Azure Data Bricks, Spark, Spark Architecture , Data Factory, and SQL Database products or equivalent products from other clo ...

  • Anblicks

    Data Engineer

    1 week ago

    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...