Jobs
>
Hyderabad

    Senior Data Engineer - Hyderabad, India - Talent500

    Talent500
    Talent500 background
    Description

    Position Summary:

    Land O'Lakes is looking to add a Data Engineer to our WinField United Data & Analytics product team. The Senior data engineer will design & execute solutions and work with a team of engineers to ensure consistent, reliable, efficient and sustainable solutions are delivered. The data engineer will also contribute towards improving data management processes that result in highly accurate and trusted data assets for use in Winfield United and across the organization.

    Job Description & Responsibilities:

    • Ability to obtain a clear understanding of business needs and value, mapping out the solution, and working on its implementation.
    • Ability to collaborate across all levels and areas of the product & business team as well as perform hands-on implementation.
    • Excellent communication, presentation, and documentation skills, including the ability to distill highly technical concepts and communicate them effectively to non-technical stakeholders
    • Capable of using agile methodology and implementing Continuous Integration/Continuous Delivery (CI/CD) pipelines
    • Exposure to data vault method, model, and architecture
    • Ability to monitor the overall data landscape: meta data, processing patterns, and data quality
    • Ability to work closely with developers and data analysts to design and optimize data access, query, reporting and analysis strategies to solve complex business problems
    • Ability to proactively communicate and manage technology and projects risks
    • Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in challenging situations
    • Establish platform-wide standards
    • Perform root cause analysis when there are issues
    • Ability to proactively communicate and manage technology and projects risks
    • Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in challenging situations.

    Experience Required:

    • Strong experience in working with heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using various data integration technologies (ETL/ELT, data replication/CDC, message-oriented data movement, API design, etc.)
    • Hands on experience with programming languages such as Python, SQL to create automated processes for data gathering, cleansing, reporting, and visualization

    Experience Desired:

    • Experience with DevOps, CI/CD pipelines and Data bricks
    • Experience in working with Cloud data warehouse like Snowflake, AWS Redshift, Azure Synapse or Google Big Query.
    • Collaborate with cross functional team to resolve data quality and operational issues.
    • Demonstrating best practices for code development and optimization, unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response in order to ensure data availability, data quality, usability and required performance.
    • Experience working with Qlik technologies (Replicate and Compose)
    • Experience with any scripting languages, preferably Python
    • Experience working using agile methodologies
    • Experience in Manufacturing, Retail or Agriculture industry

    Education and Training Required:

    • Bachelor's or Master's degree in Business Analytics, Computer Science, Mathematics, Statistics, or a related discipline; or an equivalent combination of demonstrated skills and experience

    Primary Skills:

    • 4+ years of experience with SQL & data engineering techniques.
    • 4+ years of experience building data integration solutions using tools like Informatica, Talend, Mulesoft, Qlik, etc.

    Additional Skills:

    • Ability to work closely with business partners to influence decisions on technology investments
    • Ability to provide technical leadership to evangelize best practices/proven patterns and promote the use of Corporate IT standards
    • Working knowledge of data privacy regulations including GDPR and CCPA as well as how to design solutions to drive compliance

  • programming

    Data Engineer

    3 weeks ago


    programming Hyderabad, India

    Job Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...

  • Akrivia HCM

    Data Engineer

    2 weeks ago


    Akrivia HCM Hyderabad, India

    We are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...

  • G5

    Data Engineer

    3 weeks ago


    G5 hyderabad, India

    We are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...

  • Highspot

    Data Engineer

    3 weeks ago


    Highspot hyderabad, India

    What You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    1 week ago


    RiskInsight Consulting Pvt Ltd Hyderabad, India Full time

    Key Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    2 weeks ago


    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • Aragen Life Sciences

    Data Engineer

    3 weeks ago


    Aragen Life Sciences hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...

  • ADP

    Data Engineer

    3 weeks ago


    ADP Hyderabad, India

    ***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago


    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...

  • Techelligence, Inc

    Data Engineer

    1 day ago


    Techelligence, Inc Hyderabad, India

    Company Overview: · Welcome to the forefront of data innovation with Techelligence, the premier consulting firm specializing in harnessing the full potential of the Databricks ecosystem. We are the architects of data transformation, dedicated to empowering businesses to make the ...

  • Innova Solutions India

    Data Engineer

    3 weeks ago


    Innova Solutions India hyderabad, India

    JOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...

  • TechnoGen India Pvt. Ltd.

    Data Engineer

    3 weeks ago


    TechnoGen India Pvt. Ltd. hyderabad, India

    5+ years served as Data Engineer or Data Operations role · 5+ years of experience working with SQL · Extensive experience with Microsoft Azure Data Lake, Azure Data Bricks, Spark, Spark Architecture , Data Factory, and SQL Database products or equivalent products from other clo ...

  • Awign Expert

    Data Engineer

    2 weeks ago


    Awign Expert Hyderabad, India

    Job Description · About the Role · Location: Hyderabad · Timings: Full Time (As per company timings) · Notice Period: (Immediate Joiner - Required) · Duration: 6 months · Experience – 5 to 9yrs · Work Mode– WFO · Job Description · We're looking for a Data/Web Engineer who will b ...

  • Splunk Inc

    Data Engineer

    1 day ago


    Splunk Inc Hyderabad, India

    We are excited to hire a Data Engineer with a Minimum of 6 years of experience in data engineering, including 3+ years with DBT, and proven expertise in designing and implementing complex data transformation pipelines. · Strong proficiency in Python, SQL, and modern cloud data wa ...

  • EDGESOFT

    Data Engineer

    2 weeks ago


    EDGESOFT Hyderabad, India

    Job Description : · The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastruc ...

  • Microsoft

    Data Engineer

    3 weeks ago


    Microsoft hyderabad, India

    Overview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...

  • WALLERO TECHNOLOGIES PRIVATE LIMITED

    Data Engineer

    1 week ago


    WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, India

    Roles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...

  • State Street

    Data Engineer

    1 week ago


    State Street Hyderabad, India Full time

    Role Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...

  • Appen

    Data Engineer

    3 weeks ago


    Appen hyderabad, India

    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In add ...

  • CGI

    Data Engineer

    3 weeks ago


    CGI Hyderabad, India Full time

    Position Description: · At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm ...