Senior Data Engineer - Delhi, India - Randstad

Randstad Delhi, India

1 day ago

permanent Technology / Internet

Description

Job Description:

We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field.

The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations.

This role offers an exciting opportunity to work on cutting-edge projects, contribute to the design and architecture of applications, and collaborate closely with business users.

Key Responsibilities:

Data Engineering: Handson experience in PySpark, including Dataframe core functions and Spark SQL, for data processing and analytics.
SQL Databases: Proficiency in SQL databases to write queries of varying complexity for data retrieval and manipulation.
Big Data Programming: Experience in Big Data programming for data transformation, aggregations, and analytics.
Customer Communication: Excellent communication skills to interact effectively with customers and stakeholders.
Analytical Skills: Strong analytical skills to understand complex data requirements and troubleshoot issues effectively.
Design & Architecture: Contribute to the overall design and architecture of applications developed and deployed.
Performance Tuning: Optimize application performance by tuning executor sizing, environmental parameters, code optimization, and partition tuning.
Requirements Gathering: Interact with business users to understand their requirements and translate them into functional specifications.
Project Implementation: Implement projects based on functional specifications, ensuring timely and accurate Bachelor's/Master's degree in Computer Science, Information Systems, or a related field.
Minimum of 5+ years of experience in data engineering.
Strong proficiency in PySpark, Python, Spark, and SQL.
Experience with Big Data technologies and programming languages.
Excellent communication and interpersonal skills.
Strong analytical and problemsolving abilities.

Technical Skills & Competencies:

Expertise in PySpark, Python, Spark, and SQL.
Handson experience in Big Data programming and analytics.
Ability to design and architect data solutions.
Strong performance tuning skills.
Excellent communication and collaboration skills.
Detailoriented with a focus on quality and accuracy.

)

Data Engineer

3 days ago

Layer7 SAPI de CV New Delhi, India

Job DescriptionThis is a remote position. · • Diseñar, crear y mantener canalizaciones de datos por lotes o en tiempo real en producción. · • Mantener y optimizar la infraestructura de datos necesaria para una extracción, transformación y carga precisas de datos de una amplia var ...
Data Engineer

3 days ago

Straive New Delhi, India

Job Role- AWS Data EngineerExperience- 4 to 6 yearsMode- Remote · The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabili ...
Data Engineer

1 day ago

Resources valley Delhi, India permanent

Job Description : · Ownership of Data Engineering solution development, including ingestion, transformation, loading, modelling, curation, profiling, migration, and validation of data, also maintaining security, access control, compliance, and SLAs · - Design and create data mode ...
Data Engineer

3 days ago

ZIDEA New Delhi, India

ResponsibilitiesDesign, build, and maintain scalable data pipelines on AWS using services such as Amazon S3, Glue, and EMR.Develop and optimize ETL processes to ingest data from various sources into our data lake and data warehouse.Collaborate with data scientists and analysts to ...
Data Engineer

3 days ago

Blackstraw Delhi, India

Data Engineer · Company Name: · Office Location: Delhi (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exa ...
Data Engineer

2 hours ago

KARYA CONSULTANTS PRIVATE LIMITED Any Location/Bangalore, India permanent

As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...
Data Engineer

1 day ago

HARP Technologies and Services Delhi, India permanent

Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...
Data Engineer

1 day ago

SIENT TECHOLOGIES PVT LTD New Delhi, India

Company Overview: · SIENT Technologies is a pioneering technology firm at the forefront of innovation, dedicated to revolutionizing industries through the power of advanced solutions. Committed to excellence, we specialize in creating transformative technology that enhances effic ...
Data Engineer

1 day ago

Triumph Ladders Pvt. Ltd. Delhi Division, India permanent

Title - Data Engineer · Exp years · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group ...
Data Engineer

3 days ago

iENGINEERING New Delhi, India

Job DescriptionWhat we're looking for: · To support our mission of delivering high quality AI services to revolutionalize the way American transportation authorities manage and maintain US road infrastructure, we're seeking a motivated Data Engineer to join our team at Transconom ...
Data Engineer

3 days ago

Cayian India Pvt Limited New Delhi, India

Job DescriptionCayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find o ...
Data Engineer

3 days ago

Aprisity Technologies New Delhi, India

We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems wi ...
Data Engineer

1 day ago

Triumph Ladders Pvt. Ltd. Delhi Division, India permanent

Title - Data Engineer · Exp yrs · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group · - ...
Data Engineers

3 days ago

Cubiccode Digital Media LLP New Delhi, India

We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaini ...
Data Engineer

3 days ago

ICF New Delhi, India

ICF (NASDAQ: ICFI) is a global consulting services company with over 9,000 full- and part-time employees, but we are not your typical consultants. At ICF, business analysts and policy specialists work together with digital strategists, data scientists and creatives. We combine un ...
Data Engineer

3 days ago

ATRIBS METSCON GROUP New Delhi, India

Job Description · Data Engineer as part of the Core production team. · Ideally through experience you will enhance your skills on Prod fixes/Enhancements/Bug Tracking · The candidate should have a strong foundation in Informatica Big Data Management, including development, mainte ...
Data Engineer

1 day ago

USEReady Technology Pvt. Ltd. Any Location/Bangalore, India permanent

Role Responsibility : · - Translate functional specifications and change requests into technical specifications. · - Translate business requirement document, functional specification, and technical specification to related coding. · - Develop efficient code with unit testing and ...
Data Engineer

1 day ago

Ally eXecutive HR Consulting Delhi, India

Job Description : · Technical Expertise : · - Should have experience of working on Microsoft Azure tools like Spark, Databrick, Synapse (knowledge of these will be an added advantage). · - Should be very strong on BI and EDWH concepts. · - Must have good experience on working on ...
Data Engineering Manager

5 days ago

Woolworths Group International Delhi, India

What we're like · At BIG W every day's a big day. For you, this could be the start of something big. · There are over 15,000 of us, in the biggest cities and the tiniest towns. And each of us has an important role to play to help make a real difference for families by providing r ...
Azure Data Engineer

3 days ago

YALLO Retail New Delhi, India

Role Type: · ContractLocation: · RemoteDuration: · 6 · monthsStart: · ASAP · As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams ...