Jobs
>
Hyderabad

    senior data engineer - Hyderabad, India - Advitha Tech Solutions

    Advitha Tech Solutions
    Advitha Tech Solutions Hyderabad, India

    4 days ago

    Default job background
    Full time
    Description

    1. Apache Spark:

    Extensive experience in designing, implementing, and optimizing Spark-based

    data processing workflows.

    Strong knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL.

    Ability to leverage Spark for large-scale data processing and analytics.

    2. Python:

    Proficient in Python programming with a focus on data processing and

    manipulation.

    Experience using Python libraries for data analysis, such as Pandas and NumPy.

    Familiarity with building and deploying Python-based data pipelines.

    3. Trino:

    Hands-on experience with Trino (formerly PrestoSQL) for fast and scalable query

    processing.

    Knowledge of Trino architecture and optimization techniques for efficient data

    querying.

    4. Presto:

    Previous exposure to Presto for distributed SQL queries on large datasets.

    Ability to design and implement Presto-based solutions for complex data access

    requirements.

    5. Data Lakes:

    Understanding of the principles and best practices for managing and utilizing

    data lakes.

    Experience in working with data lakes for storing and retrieving diverse datasets.

  • ValueLabs

    Data Engineer

    2 hours ago

    ValueLabs Hyderabad, India

    Role: Data Engineer with AWS · Experience: 5-9 years · Notice Period: Immediate - 10 days · Location: Hyderabad · We are seeking a highly skilled Data Engineer to join our dynamic team. · Job Description · Key Responsibilities: · Develop and maintain data models, data flow diagra ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    1 day ago

    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • ValueLabs

    Data Engineer

    1 day ago

    ValueLabs Hyderabad, India

    Experience - 6+Years · Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake · Secondary Skills - PowerBl, Data modeling · Notice Period - Immediate - 15 days · Job Description: The Data Engineer is responsible for d ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    3 days ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Job Description: · We are seeking a skilled and motivated Data Engineering Support Analyst to join our team. As a Data Engineering Support Analyst, you will play a crucial role in ensuring the smooth operation and support of our data engineering. Your primary responsibility will ...

  • Aragen Life Sciences

    Data Engineer

    1 day ago

    Aragen Life Sciences Hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve a ...

  • The Ksquare Group

    Data Engineer

    2 hours ago

    The Ksquare Group Hyderabad, India

    Requirements · Bachelor's degree in computer science, information technology, or a related field. · Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must. · Demonstrate advanced understanding in data engineering practices, Incl ...

  • Tech Mahindra

    Data Engineer

    1 day ago

    Tech Mahindra Hyderabad, India

    Title: Data Operations Associate · Location: Hyderabad · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create susta ...

  • Anblicks

    Data Engineer

    6 days ago

    Anblicks Hyderabad, India

    Position: Data Engineer - Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with AWS S3/ Azure ADLS Storage Accounts and Snowflake. · Strong experience in data eng ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 day ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Key Responsibilities: · We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will be req ...

  • ACL Digital

    Data Engineer

    1 week ago

    ACL Digital Hyderabad, India

    Dear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days Max · Designation : AWS Data Engineer · Experience Required : 3 to 12 ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 day ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    About Inspire: · Inspire Brands is a multi-brand restaurant company whose current portfolio includes nearly 32,000 Arbys, Baskin-Robbins, Buffalo Wild Wings, Dunkin, Jimmy Johns, and SONIC Drive-In locations worldwide. The company was founded in 2018 and is headquartered in Atlan ...

  • C1 Global Innovation & Capability Center

    Data Engineer

    1 day ago

    C1 Global Innovation & Capability Center Hyderabad, India

    The Data Engineer's role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and re ...

  • Talentoj

    Data Engineer

    3 days ago

    Talentoj Hyderabad, India permanent

    Azure Data Engineer : · We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required. · The ideal can ...

  • Inspire

    Data Engineer

    4 days ago

    Inspire Hyderabad, India

    We are looking for a Master Data Management (MDM) Engineer for the Enterprise Data Organization to build and maintain MDM data products across multiple data domains that will support key data consolidation and governance initiatives. The candidate will be required to possess stro ...

  • Growel Softech Pvt. Ltd.

    Data Engineer

    1 day ago

    Growel Softech Pvt. Ltd. Bangalore/Hyderabad, India permanent

    Job Description : · Role : Data Engineer · Required Technical Skills : · - More than 5 years' experience implementing data solutions · - Strong proficiency in Python with an emphasis in building data pipelines · - Experience in big data technologies like HDFS, YARN, Map-Reduce, K ...

  • Recruitment

    Data Engineer

    3 days ago

    Recruitment Hyderabad, India permanent

    Job Description : · Develop and maintain databases in Azure environment. · - Build ETL processes with Azure Data Factory, Azure Databricks, Data queries · - Perform migration processes to or from Azure environment. · - Azure Data Engineering: Azure Data Factory, Azure Data Lake, ...

  • ACL Digital

    Data Engineer

    5 days ago

    ACL Digital Hyderabad, India

    Dear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days MaxDesignation : AWS Data EngineerExperience Required : 3 to 12 yearsQ ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 day ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Key Responsibilities: · We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will be req ...

  • Appen

    Data Engineer

    1 day ago

    Appen Hyderabad, India Permanent - Regular Full time

    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In addi ...

  • G5

    Data Engineer

    19 hours ago

    G5 Hyderabad, India

    We are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...