Data Engineer - india, India - Prescience Decision Solutions

Prescience Decision Solutions india, India

3 weeks ago

Description

Job Description

Build and support ETL jobs and components using Apache Spark, Python, Pyspark, Talend, Kafka, Hadoop, Airflow, and Google Cloud Platform (GCP).
Conduct requirement gathering sessions and comprehend project needs, translating them into technical tasks utilizing Spark and Airflow.
Create detailed Technical ETL design documents, implement, and maintain ETL processes according to established specifications.
Perform systems analysis including design, coding, unit testing, and other Software Development Life Cycle (SDLC) activities to ensure robustness and efficiency of ETL solutions.
Provide ongoing support for business continuity by monitoring ETL processes, troubleshooting, and resolving integration issues promptly to maintain data availability within Service Level Agreements (SLA).

Requirements

Experience in Data Engineering, with expertise in designing and building data pipelines, ETL processes, and data warehousing solutions.
Proficiency in programming languages such as Python, SQL, and scripting languages.
Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, or equivalent.
Experience with cloud platform such as Google Cloud Platform (GCP).
Strong analytical and problem-solving skills with the ability to troubleshoot complex data issues.
Familiarity with the Hadoop ecosystem and experience in migrating from Hadoop to GCP is a plus.
Strong problem-solving skills and the ability to work both independently and as part of a team.
Excellent communication and collaboration skills with the ability to work effectively in a team environment.

Benefits

Competitive salary and performance-based bonuses.
Comprehensive insurance plans.
Collaborative and supportive work environment.
Chance to learn and grow with a talented team.
A positive and fun work environment.

Requirements
Expert in one of SQL Databases like MySQL, PostgreSQL, SQL Server. Working knowledge on one of NoSQL Databases. Expert in DB modelling and DWH schemas (like Snowflake, Star schemas). Expert in enterprise DWH (Redshift, Azure Synapse) or Lakehouse (Delta lake) architectures. Expert in ETL and ELT setups in AWS/Azure cloud. Hands on experience in setting up datamarts and data products. Hands on experience with cloud services like (Glue, Lambda, API Gateway, CloudFormation, S3, Redshift, SQS or respective Azure services). Proficiency in Python and SQL coding. Understanding and implementation of coding design patterns. Working experience in Spark and Spark SQL frameworks. Working experience with Big Data (Data partitioning, Data cleaning, Data transformation techniques). Knowledge of CI/CD pipelines and tools like Git, Jenkins, Docker, K8 etc.

Data Engineer

3 weeks ago

ReleWant india, India

Job Description · Chi siamo? · Relewant è una società di consulenza specializzata in ambito informatico con sede a Chiasso, in Svizzera. · Con noi, potrai mettere a frutto il tuo potenziale in un team coeso e vincente ed esplorare tecnologie sempre più innovative in contesti mu ...
WH371561 - Data Engineer

3 weeks ago

Westhouse india, India

Job Description · Westhouse è una società leader che opera nel campo della ricerca & selezione del personale, gestione · di progetti ed è autorizzata a tempo indeterminato per la somministrazione di lavoro con Autorizzazione Ministeriale Prot. n del 03/08/2018 · Per un nostro im ...
Operations Specialist

3 weeks ago

Data Engineer Academy india, India

Job Title: Operations Analyst · Location : Remote · Company Overview: · Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to ...
Data engineer

3 weeks ago

alfabet india, India

Job Description · Wij zijn gepassioneerd door innovatie in de vastgoedsector. Als een dynamisch team met een platte organisatiestructuur, streven we ernaar om door middel van geavanceerde data-analyse en AI-technologie de vastgoedwereld te revolutioneren. · We zijn op zoek naar ...
Data Engineer

3 weeks ago

Paralleldots Anywhere in India/Multiple Locations permanent

Job Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets ...
Data Engineer

3 weeks ago

Connectio IT Pvt Ltd Bangalore/Anywhere in India/Multiple Locations

This is a full-time on-site role for a GCP Data Engineer. · As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. · Job Description : · You will work closely with the developme ...
Data Engineer

3 weeks ago

Pro5 (formerly Mangtas) india, India

The Data Engineer will have strong software engineering skills, designing and creating data architectures for the data engineering and machine learning solutions we build. · Responsibilities include understanding of Data Engineering requirements, design, development of data pipe ...
Data Engineer

3 weeks ago

Coders Brain Technology Pvt. Ltd. Anywhere in India/Multiple Locations

Position Name : Data Engineer (Integration) · Experience Required : 10+yrs · Salary : As per the Market Standard or Else whatever budget you have · Notice period : Immediate joiner · Job Type : Full time · Location : Remote · Job Description : · - Understand all forms of da ...
Data Engineer

3 weeks ago

HARP Technologies and Services india, India

Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...
Data Engineer

3 weeks ago

Huquo Consulting india, India

Position : Data Engineer · Location : Gurgaon · Experience : Min 4+ years · Role & Responsibilities Overview : · - A seasoned data team member with a good grasp of both business and technical aspects. · Good familiarity with data stack · - Interact with the other members of the ...
Data Engineer –

3 weeks ago

HARMAN International india, India

HARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of ...
Data Engineer

4 days ago

Anomaly Business Consult India

Location: Remote · Experience: 6+ years · Compensation: Better than industry standards · Only Immediate Joiners Requried · We are looking for a seasoned Azure Data Engineer to join our client's team. The successful candidate will possess extensive experience in designing, develo ...
Data Engineer

3 weeks ago

Aricent india, India permanent

Job Profile : Data Engineer · Location : WFO/WFH (Both Available) · Specialization : IT/Cloud/Data Management · Job Description : · - Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; ca ...
Data Engineer

3 weeks ago

EXL india, India

Data Engineer · Location – Gurgaon, Noida, Pune, Bangalore · Candidate should be highly comfortable with python (Libraries pandas, datetime, NumPy, config parser, sys, os, Json, requests, warnings) · We don't have any cloud-based solution, our whole framework is developed wit ...
Data Engineer

3 weeks ago

Artefact india, India

Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing grow ...
Data Engineer

3 weeks ago

System Soft Technologies india, India

Job Summary · Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposes · Qualification · As a data engineer, your main resp ...
Data Engineer

3 weeks ago

DEME india, India

At DEME we believe in the value of data and becoming data driven. As a data engineer you will join the Data & Analytics Office (DAO) within the IT Services department. Together with the team you will be transforming DEME's data into high quality (BIG) data sets and reports. You w ...
Data Engineer

3 weeks ago

KARYA CONSULTANTS PRIVATE LIMITED india, India

As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...
Data Engineer

3 weeks ago

Cynosure Corporate Solutions india, India

Job Description · Job Description: · We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by ...
Data Engineer

3 weeks ago

Capleo Global india, India

Lead Data Engineer · Experience: 8-10 years · Location: Bengaluru · Availability: Immediate to 30 days · Mandatory Skills: · Spark · Databricks · PySpark or Scala · SQL & Python · Github · DWH (Snowflake or Presto or Hive or Hadoop) · Data Pipeline & Data Model · We ...