Jobs
>
Hyderabad

    Senior Data Engineer - Hyderabad, India - Anblicks

    Anblicks
    Anblicks Hyderabad, India

    4 days ago

    Default job background
    Technology / Internet
    Description

    Role Title

    Lead Data Engineer - Snowflake

    Reporting To:

    Location

    India – Ahmedabad or Hyderabad

    Who we are ?

    Anblicks is Data and AI Company – We bring value to your data.

    Anblicks is a Data and AI company, specializing in data modernization and transformation, that helps organizations across industries make decisions better, faster, and at scale. Enabling Enterprises with Data-Driven Decision Making. Since 2004, Anblicks has been enabling customers across the globe, with their digital transformation journey. Anblicks is headquartered in Addison, Texas, and employs more than 550 technology professionals, data analysts, and data science experts in the USA, India, and Australia.

    Anblicks is committed to bringing value to various industries using CloudOps, Data Analytics, and Modern Apps. Global customers benefited from our Anblicks Ignite Enterprise Data Platform and Accelerators.

    Why Join Anblicks ?

    Anblicks, a company, advancing in leaps and bounds, places tremendous emphasis on values. A fundamental ideology is crucial to manoeuvre an organisation towards success. Through a stable value system, Anblicks is enabling an unprecedented transformation. Not just a digital transformation; it is something as expansive as people and a best-in-class global culture.

    Key Facts:

    • than 550 Technology Professionals
    • than 200 Customer Served
    • than 900 Project Completed
    • by happy clients including Fortune 500 companies
    • Books authored by Employees
    • in India, USA & Australia

    Role Purpose

    We are seeking a Lead Data Engineer to join our team of data experts. The ideal candidate will have a passion for designing and implementing end-to-end data solutions, from data ingestion and processing to analytics and reporting. As a Lead Data Engineer, you will work closely with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs.. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines and ETL processes using technologies such as Snowflake, DBT, Matallion in Data warehousing. As a Lead Data Engineer, you will work closely with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs. You will also be responsible for leading a team of data engineers and ensuring that all data engineering projects are completed on time and within budget.

    Role Responsibilities

    • with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs
    • and implement end-to-end data solutions using technologies such as Snowflake, Apache Spark, and Hadoop
    • a team of data engineers and ensure that all data engineering projects are completed on time and within budget
    • novel query optimization, major security competencies with encryption.
    • performance issues and scalability issues in the system.
    • management with distributed data processing algorithms
    • ownership right from start to finish.
    • monitor, and optimizeETL and ELT processes with data models
    • solutions from on-premises setup to cloud-based platforms.
    • and implement the latest delivery approaches based on data architecture.
    • documentation and tracking based on understanding user requirements.
    • data integration with third-party tools including architecting, designing, coding, and testing phases.
    • documentation of data models, architecture, and maintenance processes
    • review and audit data models for enhancement
    • of ideal data pipeline based on ETL tools.
    • with BI experts and analysts for customized data models and integration
    • updates, new code development, and reverse engineering
    • tuning, user acceptance training, application support
    • confidentiality of data
    • assessment, management, and mitigation plans
    • engagement with teams for status reporting and routine activities
    • activities from one database to another or on-premises to cloud

    Skills & Experience

    • or master's degree in computer science, Information Systems, or a related field
    • years of experience in data engineering and data architecture
    • Experience in working with AWS S3/ Azure ADLS Storage Accounts and Snowflake.
    • Strong experience in data engineering fundamentals (SQL, RDBMS, Data Models, Data Structures, orchestration, Devops etc.)
    • Knowledge of SQL language and cloud-based technologies
    • Strong experience building data pipelines with Spark and Python/Scala
    • Strong experience building ELT pipelines (batch and streaming) in Snowflake cloud warehouse
    • Good working knowledge of leveraging DBT (SQL and Python models) to perform transformations in Snowflake
    • Able to write structured and efficient queries on large data sets using Statistical Aggregate functions and Analytical functions and reporting datamarts.
    • Experience in working with Snowflake concepts like Snowpipe, Streams, Tasks, Cloning, TimeTravel, Data Sharing, Data Replication e.t.c.
    • Handling large and complex datasets like JSON, ORC, PARQUET,CSV filesfrom various sources like AWS S3,Azure DataLake Gen2.
    • Understanding customer requirements, analysis, design, development and implementation into the system, gather and define business requirements and enhancing business processes.
    • Knowledge in Snowflake tools like Snowsight and SnowSQL and any partner connects.
    • Performance tuning and setting up resource monitors
    • Snowflake modeling – roles, databases, schemas
    • SQL performance measuring, query tuning, and database tuning
    • ETL tools with cloud-driven skills
    • SQL-based databases like Oracle SQL Server, Teradata, etc.
    • Snowflake warehousing, architecture, processing, administration
    • Data ingestion into Snowflake
    • Enterprise-level technical exposure to Snowflake applications
    • with data modelling is a plus.
    • problem-solving and analytical skills
    • to work independently and as part of a team.
    • working in an Agile environment.
    • in building relationships with clients and in practice development activities.
    • written and oral communication skills; Ability to communicate effectively with technical and non-technical staff.
    • be open to travel.
  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    8 hours ago

    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    2 days ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Job Description: · We are seeking a skilled and motivated Data Engineering Support Analyst to join our team. As a Data Engineering Support Analyst, you will play a crucial role in ensuring the smooth operation and support of our data engineering. Your primary responsibility will ...

  • ValueLabs

    Data Engineer

    1 week ago

    ValueLabs Hyderabad, India

    Role: Data Engineer with AWS · Experience: 5-9 years · Notice Period: Immediate - 10 days · Location: Hyderabad · We are seeking a highly skilled Data Engineer to join our dynamic team. · Job Description · Key Responsibilities: · Develop and maintain data models, data flow diagra ...

  • ACL Digital

    Data Engineer

    2 weeks ago

    ACL Digital Hyderabad, India

    Dear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days Max · Designation : AWS Data Engineer · Experience Required : 3 to 12 ...

  • Aragen Life Sciences

    Data Engineer

    1 day ago

    Aragen Life Sciences Hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve a ...

  • D2N Solutions

    Data Engineer

    2 days ago

    D2N Solutions Hyderabad, India

    Company Description · D2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate ...

  • The Ksquare Group

    Data Engineer

    1 week ago

    The Ksquare Group Hyderabad, India

    Requirements · Bachelor's degree in computer science, information technology, or a related field. · Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must. · Demonstrate advanced understanding in data engineering practices, Incl ...

  • Tech Mahindra

    Data Engineer

    1 week ago

    Tech Mahindra Hyderabad, India

    Title: Data Operations Associate · Location: Hyderabad · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create susta ...

  • Anblicks

    Data Engineer

    5 days ago

    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with AWS S3/ Azure ADLS Storage Accounts and Snowflake. · Strong experience in data engi ...

  • ValueLabs

    Data Engineer

    8 hours ago

    ValueLabs Hyderabad, India

    Experience - 6+Years · Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake · Secondary Skills - PowerBl, Data modeling · Notice Period - Immediate - 15 days · Job Description: The Data Engineer is responsible for d ...

  • Inspire

    Data Engineer

    1 week ago

    Inspire Hyderabad, India

    We are looking for a Master Data Management (MDM) Engineer for the Enterprise Data Organization to build and maintain MDM data products across multiple data domains that will support key data consolidation and governance initiatives. The candidate will be required to possess stro ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    9 hours ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Responsibilities: · Design, develop and maintain reliable automated data solutions based on the identification, collection and evaluation of business requirements. Including but not limited to data models, database objects, stored procedures and views. · Developing new and enhanc ...

  • Arjava Consultants LLP

    Data Engineer

    8 hours ago

    Arjava Consultants LLP Hyderabad, India

    Title : Data Engineer · Location : Hyderabad · Experience : 5+ (as Data Engineer) · Must have : Snowflakes, python, ETL, Data Bricks, Cloud, Spark. · Key Responsibilities : · - Lead and mentor a team of data engineers to design, develop, and maintain our data infrastructure, inc ...

  • C1 Global Innovation & Capability Center

    Data Engineer

    1 week ago

    C1 Global Innovation & Capability Center Hyderabad, India

    The Data Engineer's role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and re ...

  • Live Connections

    Data Engineer

    6 days ago

    Live Connections Hyderabad, India

    Role - Data Engineer · Experience - 5+ years out of which 4 years should be relevant · Location - Hyderabad · Work Mode - Hybrid · Must Have · 4 years as a Data Engineer · Proven experience as a Data Engineer, with a focus on designing and implementing scalable data solutions ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    9 hours ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong tech ...

  • TechnoGen India Pvt. Ltd.

    Data Engineer

    1 day ago

    TechnoGen India Pvt. Ltd. Hyderabad, India

    5+ years served as Data Engineer or Data Operations role · 5+ years of experience working with SQL · Extensive experience with Microsoft Azure Data Lake, Azure Data Bricks, Spark, Spark Architecture , Data Factory, and SQL Database products or equivalent products from other cloud ...

  • Inspire Brands Hyderabad Support Center

    Data Engineer

    1 week ago

    Inspire Brands Hyderabad Support Center Hyderabad, India

    Key Responsibilities: · We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will be req ...

  • Infosys

    Engineer – Data Engineering

    6 days ago

    Infosys Hyderabad, India

    Engineer – Data Engineering (Immediate Joiners only) · What you will be responsible for: · The design and development of data solutions for one of the world's largest corporations involved in the marketing and distribution of food products. · Implement distributed and highly ava ...

  • Recruitment

    Data Engineer

    1 week ago

    Recruitment Hyderabad, India permanent

    Job Description : · Develop and maintain databases in Azure environment. · - Build ETL processes with Azure Data Factory, Azure Databricks, Data queries · - Perform migration processes to or from Azure environment. · - Azure Data Engineering: Azure Data Factory, Azure Data Lake, ...