Jobs
>
Hyderabad

    Data Engineer - Hyderabad, India - Prudent Technologies and Consulting, Inc.

    Prudent Technologies and Consulting, Inc.
    Prudent Technologies and Consulting, Inc. Hyderabad, India

    1 week ago

    Default job background
    Description

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candidate will have a robust background in data engineering principles, ETL design, and web services development using frameworks like Flask or Django.

    Key Responsibilities:

    Design, build, and maintain efficient, reliable, and scalable ETL pipelines using Python to extract, transform, and load data from various sources into data stores.

    Develop RESTful APIs using Flask or Django to enable seamless data access and manipulation by internal and external systems.

    Ensure optimal data processing architecture by implementing effective database solutions and data storage practices.

    Collaborate with the engineering team to integrate ETL processes and APIs into application ecosystems.

    Monitor, troubleshoot, and optimize data systems to ensure reliability and performance.

    Manage data security, backup, and recovery specifications to ensure data integrity and availability.

    Document ETL processes, API endpoints, and data models, maintaining clear and concise documentation for all developed systems.

    Keep abreast of new technologies and advocate for their adoption, where they can enhance the functionality and efficiency of data systems.

    Qualifications:

    Bachelor's or master's degree in Computer Science, Engineering, Information Technology, or a related field.

    3+ years of proven experience in data engineering with a strong emphasis on ETL pipeline design and API development.

    Expertise in Python, with extensive experience using data processing libraries (e.g., Pandas, NumPy) and ETL tools.

    Proficient in developing RESTful APIs with Flask or Django and familiar with API authentication and authorization mechanisms.

    Solid understanding of SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).

    Experience with cloud services (e.g., AWS, Google Cloud, Azure) and their data services is highly desirable.

    Strong knowledge of data warehousing concepts, modeling, and schema design.

    Excellent problem-solving skills and the ability to manage complex projects with tight deadlines.

    Strong communication skills, capable of working collaboratively with technical and non-technical team members.

  • ValueLabs

    Data Engineer

    6 days ago

    ValueLabs Hyderabad, India

    Role: Data Engineer with AWS · Experience: 5-9 years · Notice Period: Immediate - 10 days · Location: Hyderabad · We are seeking a highly skilled Data Engineer to join our dynamic team. · Job Description · Key Responsibilities: · Develop and maintain data models, data flow diagra ...

  • ValueLabs

    Data Engineer

    1 week ago

    ValueLabs Hyderabad, India

    Experience - 6+Years · Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake · Secondary Skills - PowerBl, Data modeling · Notice Period - Immediate - 15 days · Job Description: The Data Engineer is responsible for d ...

  • D2N Solutions

    Data Engineer

    21 hours ago

    D2N Solutions Hyderabad, India

    Company Description · D2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate ...

  • ACL Digital

    Data Engineer

    2 weeks ago

    ACL Digital Hyderabad, India

    Dear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days Max · Designation : AWS Data Engineer · Experience Required : 3 to 12 ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 day ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Job Description: · We are seeking a skilled and motivated Data Engineering Support Analyst to join our team. As a Data Engineering Support Analyst, you will play a crucial role in ensuring the smooth operation and support of our data engineering. Your primary responsibility will ...

  • Aragen Life Sciences

    Data Engineer

    1 hour ago

    Aragen Life Sciences Hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve a ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 week ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Key Responsibilities: · We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will be req ...

  • The Ksquare Group

    Data Engineer

    6 days ago

    The Ksquare Group Hyderabad, India

    Requirements · Bachelor's degree in computer science, information technology, or a related field. · Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must. · Demonstrate advanced understanding in data engineering practices, Incl ...

  • Tech Mahindra

    Data Engineer

    1 week ago

    Tech Mahindra Hyderabad, India

    Title: Data Operations Associate · Location: Hyderabad · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create susta ...

  • Anblicks

    Data Engineer

    4 days ago

    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with AWS S3/ Azure ADLS Storage Accounts and Snowflake. · Strong experience in data engi ...

  • Inspire

    Data Engineer

    1 week ago

    Inspire Hyderabad, India

    We are looking for a Master Data Management (MDM) Engineer for the Enterprise Data Organization to build and maintain MDM data products across multiple data domains that will support key data consolidation and governance initiatives. The candidate will be required to possess stro ...

  • Live Connections

    Data Engineer

    4 days ago

    Live Connections Hyderabad, India

    Role - Data Engineer · Experience - 5+ years out of which 4 years should be relevant · Location - Hyderabad · Work Mode - Hybrid · Must Have · 4 years as a Data Engineer · Proven experience as a Data Engineer, with a focus on designing and implementing scalable data solutions ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 week ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    About Inspire: · Inspire Brands is a multi-brand restaurant company whose current portfolio includes nearly 32,000 Arbys, Baskin-Robbins, Buffalo Wild Wings, Dunkin, Jimmy Johns, and SONIC Drive-In locations worldwide. The company was founded in 2018 and is headquartered in Atlan ...

  • Talentoj

    Data Engineer

    1 day ago

    Talentoj Hyderabad/Pune/Ahmedabad, India permanent

    Azure Data Engineer : · We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required. · The ideal can ...

  • C1 Global Innovation & Capability Center

    Data Engineer

    1 week ago

    C1 Global Innovation & Capability Center Hyderabad, India

    The Data Engineer's role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and re ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 week ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Key Responsibilities: · We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will be req ...

  • Infosys

    Engineer – Data Engineering

    5 days ago

    Infosys Hyderabad, India

    Engineer – Data Engineering (Immediate Joiners only) · What you will be responsible for: · The design and development of data solutions for one of the world's largest corporations involved in the marketing and distribution of food products. · Implement distributed and highly ava ...

  • Growel Softech Pvt. Ltd.

    Data Engineer

    1 week ago

    Growel Softech Pvt. Ltd. Bangalore/Hyderabad, India permanent

    Job Description : · Role : Data Engineer · Required Technical Skills : · - More than 5 years' experience implementing data solutions · - Strong proficiency in Python with an emphasis in building data pipelines · - Experience in big data technologies like HDFS, YARN, Map-Reduce, K ...

  • Recruitment

    Data Engineer

    1 week ago

    Recruitment Hyderabad, India permanent

    Job Description : · Develop and maintain databases in Azure environment. · - Build ETL processes with Azure Data Factory, Azure Databricks, Data queries · - Perform migration processes to or from Azure environment. · - Azure Data Engineering: Azure Data Factory, Azure Data Lake, ...

  • HuQuo

    Data Engineer

    2 days ago

    HuQuo Hyderabad, India permanent

    Must-Have : · - 4+ years of experience in Data Engineering experience on Azure and Databricks · - Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required · - Experience Developing and tuning Spark Application and SparkSQL queries- · - Expertise t ...