Data Engineer - Pune/Hyderabad/Anywhere in India/Multiple Locations - Huquo

Huquo Pune/Hyderabad/Anywhere in India/Multiple Locations

4 days ago

Technology / Internet

Description

Basic understanding of :

Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar
Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
Agile Process (Scrum cadences, Roles, deliverables) & basic understanding in either Azure DevOps, JIRA, or Similar
Architecture and data modeling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)
Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt, or Similar

Strong In:

Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar
Big Data Framework & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), SparkScala or SparkSQL) or Similar
Data warehouse working experience of concepts and development using SQL on single (SQL Server, Oracle or Similar) and parallel platforms (Azure SQL Data Warehouse or Snowflake)
Code Management & working experience in GIT Hub, Azure DevOps, or Similar
End to End Architecture and ETL processes & working experience in ETL Tool or Similar
Reading Data Formats & working experience in JSON, XML, or Similar
Data integration processes (batch & real time) using tools & working experience in either Informatica PowerCenter and/or Cloud, Microsoft SSIS,
MuleSoft, DataStage, Sqoop, or Similar
Writing requirement, functional & technical documentation & working experience in the Integration design document, architecture documentation, data testing plans or Similar
SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar
Database & working experience in any of the database like MS SQL, Oracle, or Similar

Analytical Problem

Solving skills & working experience in resolving complex problems or Similar
Communication (read & write in English), Collaboration & Presentation skills & working experience as a team player or Similar.

Good to have :

Stream Processing & working experience in either Databricks Streaming, Azure Stream Analytics or HD Insight or Kinesis Data Analytics or Similar
Analytical Warehouse & working experience in either SQL Data Warehouse or Amazon Athena or AWS Redshift or Big Query or Similar

Real

Time Store & working experience in either Azure Cosmos DB or Amazon Dynamo
DB or Cloud Bigdata or Similar
Batch Ingestion & working experience in Data Factory or Amazon Kinesis or Lambda or Cloud Pub/Sub or Similar Storage & working experience in Azure Data Lake Storage
GEN1/GEN2 or Amazon S3 or Cloud Storage or Similar
Batch Data Processing & working experience in either Azure Databricks or HD Insight or Amazon EMR or AWS Glue or Similar
Orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar

)

DATA ENGINEER

1 week ago

23DATA GmbH india, India

Job Description · Dies ist ein Remote Job. · Du arbeitest eng mit unseren Kunden zusammen und unterstützt sie bei der Anforderungsanalyse und dem Datenmanagement · Hierzu entwickelst du Datenpipelines mittels Daten-Integrations-Tools wie Ab Initio · Du erstellst die Datenarchit ...
Data Engineer

4 days ago

ReleWant india, India

Job Description · Chi siamo? · Relewant è una società di consulenza specializzata in ambito informatico con sede a Chiasso, in Svizzera. · Con noi, potrai mettere a frutto il tuo potenziale in un team coeso e vincente ed esplorare tecnologie sempre più innovative in contesti mu ...
Data engineer

1 week ago

Reboot-Conseil india, India

Job Description · En 2020, dans un climat défavorable et démoralisant, nous avons décidé d'être cette jeune pousse porteuse d'espoir que l'on voit après un incendie ayant décimé toute une forêt, d'être ce vent nouveau qui veut faire évoluer les choses, d'être ce bouton Reboot qu ...
WH371561 - Data Engineer

4 days ago

Westhouse india, India

Job Description · Westhouse è una società leader che opera nel campo della ricerca & selezione del personale, gestione · di progetti ed è autorizzata a tempo indeterminato per la somministrazione di lavoro con Autorizzazione Ministeriale Prot. n del 03/08/2018 · Per un nostro im ...
Data engineer

4 days ago

alfabet india, India

Job Description · Wij zijn gepassioneerd door innovatie in de vastgoedsector. Als een dynamisch team met een platte organisatiestructuur, streven we ernaar om door middel van geavanceerde data-analyse en AI-technologie de vastgoedwereld te revolutioneren. · We zijn op zoek naar ...
Data Engineer

2 weeks ago

TekJobs India

Responsibilities: · We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics. · In this position, you will be responsi ...
Data Engineer

3 weeks ago

Eaglytics Co. India

Data Engineer · Job Title: Data Engineer / ETL Engineer / Google Cloud Platform Developer · Location: India · Company: Eaglytics Co. · About Us: Join Eaglytics Co: Empowering Data-Driven Innovations · At Eaglytics Co, we're a remote team with roots in Dubai, UAE, now spanning the ...
Data Engineer

2 weeks ago

Idyllic Services Pvt. Ltd. India

Job Description: · Data Engineer role is expected to own and manage end to end activities within the team. Person would be entrusted to developed solutions/design ideas related to Data Engineering, service upkeep, developing new capabilities and identify design ideas to enable th ...
Data Engineer

4 days ago

EXL india, India

Data Engineer · Location – Gurgaon, Noida, Pune, Bangalore · Candidate should be highly comfortable with python (Libraries pandas, datetime, NumPy, config parser, sys, os, Json, requests, warnings) · We don't have any cloud-based solution, our whole framework is developed wit ...
Data Engineer

4 days ago

Macropace Technologies Delhi Ncr/chennai/bangalore/hyderabad/noida/pune/trivandrum/thiruvananthapuram/cochin/kochi, India Full time

Role : Data Engineer Job Description : We are seeking a highly skilled Data Engineer to join our team. · The ideal candidate will have a strong foundation in SQL and Snowflake, with a passion for transforming and optimizing data pipelines. · As a Data Engineer, you will play a cr ...
Data Engineer

2 days ago

Capleo Global india, India

Lead Data Engineer · Experience: 8-10 years · Location: Bengaluru · Availability: Immediate to 30 days · Mandatory Skills: · Spark · Databricks · PySpark or Scala · SQL & Python · Github · DWH (Snowflake or Presto or Hive or Hadoop) · Data Pipeline & Data Model · We ...
Data Engineer

4 days ago

Pro5 (formerly Mangtas) india, India

The Data Engineer will have strong software engineering skills, designing and creating data architectures for the data engineering and machine learning solutions we build. · Responsibilities include understanding of Data Engineering requirements, design, development of data pipe ...
Data Engineer

3 weeks ago

CareerXperts Consulting India

We are searching for a skilled and passionate Data Engineer to join our growing team. You will play a pivotal role in designing, building, and maintaining the data pipelines that power our analytics and machine learning initiatives. · Responsibilities: · Design, develop, and impl ...
Data Engineer

4 days ago

STAFIDE india, India

Job Description · About us: · Stafide is the premier destination for tech talent consulting, providing comprehensive employment services throughout Europe. Our mission is straightforward: to effortlessly connect job seekers with employers, focusing on the rapidly changing techn ...
Data Engineer

4 days ago

Resources valley Jaipur/Remote, India

Job Description : · Ownership of Data Engineering solution development, including ingestion, transformation, loading, modelling, curation, profiling, migration, and validation of data, also maintaining security, access control, compliance, and SLAs · - Design and create data mod ...
Data Engineer

4 days ago

System Soft Technologies india, India

Job Summary · Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposes · Qualification · As a data engineer, your main resp ...
Data Engineer

4 days ago

Stealth AI Startup india, India

The Data Engineer will be responsible for developing real-time and batch data integration pipelines. This role will ensure that data pipelines adhere to defined standards and are included in the established data integration framework. The Data Engineer will work closely with data ...
Data Engineer

2 weeks ago

CST - Cyber Sapient India

About Us: · At Cyber Sapient Technologies, we are at the forefront of innovation, leveraging cutting-edge technologies to drive digital transformation for our clients. As a leading technology solutions provider, we empower businesses to thrive in the digital age through strategic ...
Data Engineer

3 weeks ago

Amicus Technology India

This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises. · ROLES AND RESPONSIBILITIES: · Designing, developing, and testing Azure-based applications and services that meet business and technical requirement ...
Data Engineer

4 days ago

Dexian India india, India

Job Role: Data Engineer · Working Type: Remote · Experience: 6 - 8 Years · Skills: Data Integration, ETL Development( Informatica), Greenplum / Teradata · Roles and Responsibilities: · Minimum 6 years' experience in information management, data warehousing and analytics tech ...