- Design, develop, and deploy scalable and reliable data pipelines to ingest, process, and analyze large volumes of structured and unstructured data.
- Implement data processing solutions using distributed computing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink.
- Develop and maintain ETL (Extract, Transform, Load) processes to ensure data quality and consistency across multiple sources and platforms.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
- Optimize and tune data processing workflows for performance, scalability, and efficiency.
- Implement data security and governance best practices to ensure compliance with regulatory requirements and protect sensitive data.
- Monitor and troubleshoot data pipelines and systems, identifying and resolving issues in a timely manner.
- Stay updated with the latest technologies and trends in big data and distributed computing, evaluating and recommending new tools and frameworks as needed.
- Document design decisions, technical specifications, and operational procedures for reference and knowledge sharing.
- Provide technical guidance and mentorship to junior members of the team, fostering a culture of learning and innovation.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Big Data Engineer or similar role, with a focus on designing and implementing data processing systems.
- Proficiency in programming languages such as Java, Scala, or Python, with experience in big data frameworks and tools (e.g., Hadoop, Spark).
- Strong understanding of distributed computing principles and concepts, including parallel processing, data partitioning, and fault tolerance.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform for deploying and managing big data infrastructure.
- Knowledge of SQL and NoSQL databases for data storage and retrieval.
- Familiarity with data warehousing concepts and technologies (e.g., Apache Hive, Apache HBase, Amazon Redshift).
- Excellent problemsolving and analytical skills, with attention to detail.
- Effective communication and collaboration skills, with the ability to work in a team environment.
- Commitment to continuous learning and selfimprovement in the field of big data and distributed computing.
-
Data Integration Developer
6 days ago
Pearce Services Gurugram, IndiaWe are searching for an integration developer to build and maintain integrations across various business platforms. In this role you will identify, plan, and implement integration patterns, create data sets for other developers, and ensure ongoing monitoring and maintenance of ex ...
-
Big Data Developer
6 days ago
Impetus Gurugram, IndiaTitle: Big data Developer · Type: Full-Time · Location: Gurgaon · Experience: 6-9 Years · Preference - Immediate Joiners · Qualifications: · years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and Hive · Good hands-on experien ...
-
Big Data Developer
1 week ago
Workassist Gurgaon/Gurugram/Bangalore, India permanentOur hiring partner is looking for : · - This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram. · - The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, ...
-
Data Plane Developer
2 days ago
Xenspire Technologies Gurugram, India permanentJob Title: Data Plane Development (DPDK, IP Networking) · Experience: 4 to 12 years · Location: Gurgaon, Bengaluru and Hyderabad · Job Description: · We are looking for a highly talented Software professional as part of our Wireless Core Network and Data Plane Group. He/she will ...
-
Big Data Developer
2 days ago
Wise Skulls India, Gurgaon / Gurugram Full timeTitle: Big Data Developer · Location: Gurgaon, Hyderabad (Day 1 Onsite) (Hybrid) · Duration: 12+ Months (Possibility of Extension) · Implementation Partner: Infosys · Jd · Must have 4+ Years of Experience. · Must have Big Data, Spark and Java Experience. · ...
-
Big Data Developer
4 days ago
IntraEdge Gurugram, IndiaBig Data Engineer Position Available in Gurgaon · We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent). · ...
-
Specialist Data Developer
6 hours ago
Hollister Gurugram, IndiaSummary: · The Specialist Data Developer's role is to implement and support data warehouses, data marts, and data stores. This individual is also responsible for adhering to data standards and models for warehouse architectures. · Responsibilities: · Governance · Implement go ...
-
Big Data/Scala Developer
2 days ago
Waytogo Consultants Gurugram, India permanentJob Description : · In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. · You will collaborate closely with data engineers and data scientists to understand their data ...
-
Data Engineer/ETL Developer
1 day ago
Huquo Gurgaon/Gurugram, India permanentJob Description : · Expertise on SQL, Python, ETL tools, AWS or other cloud · - Ability to improve existing ETL pipelines, automate ETL pipelines, and analytical workflows · - Experience in the extraction and manipulation of data to conduct analysis to develop understanding on mu ...
-
C++ Developer for Data Navigator
1 week ago
FIS Global Gurugram, India OTHERPosition Type : · Full time Type Of Hire : · Experienced (relevant combo of work and education) Education Desired : · Bachelor of Computer Engineering Travel Percentage : · 1 - 5%C++ with Data Navigator experience · Chennai/ Bangalore and Gurgaon · Are you curious, motivated, ...
-
C++ Developer for Data Navigator
3 days ago
FIS Gurugram, India Experienced (relevant combo of work and education)Position Type : · Full time Type Of Hire : · Experienced (relevant combo of work and education) Education Desired : · Bachelor of Computer Engineering Travel Percentage : · 1 - 5% C++ with Data Navigator experience · Chennai/ Bangalore and Gurgaon · Are you curious, mo ...
-
Sureminds Solutions Pvt. Ltd. Gurgaon/Gurugram, India permanentJob Description : · Essential Functions On Below Odi Tasks : · - 5 to 8 years of proven experience in design and development of Data Warehouse solutions, ETL, Software Development and system Integration projects. · - Mandatory : 2 years of experience in BIAPPS Financial Analytics ...
-
Data Scientist
21 hours ago
Maruti Suzuki India Ltd Gurgaon, India**Data Scientist Responsibilities**: · Architect a data based solution for the business problem presented. Develop contextual automotive domain knowledge around the problem. Collaborate with the domain knowledge expert if required. · Understand the IoT device (Telematics Control ...
-
Data Scientist
5 days ago
Akhil Systems Gurugram, Haryana, India**Designation**: · Data Scientist · **Job Location**: · Gurugram, Udyog Vihar Phase 4 · **Job Purpose**: · As a Data Scientist, you will play a pivotal role in leveraging data to drive actionable insights and solutions that support business objectives and drive innovation. You wi ...
-
Intern for Data Analysis
5 days ago
Exprto Gurgaon, India**Responsibilities**: · Analyze large data sets using Excel, MS Office, SQL, and data visualization tools like Tableau, PowerBI, or Maven · Create compelling data visualizations and reports to communicate insights and findings · Collaborate with team members to understand busines ...
-
People Analytics Behavioral Scientist
2 days ago
Nestle Operational Services Worldwide SA Gurugram, Haryana, IndiaPeople Analytics Behavioral Scientist · **Conducting research to understand human behaviour** · Conduct in-depth research and analysis to understand human behavior and its impact on organizational goals. · - Develop and implement strategic initiatives based on behavioral insights ...
-
Data Modeller
2 days ago
Coforge Ltd. Gurugram, Haryana, India**Title - Data Modeler** · **Duration: Full Time** · **Location: Gurugram/Gurgaon (WFO)** · - Responsibilities · - Data analysis to understand the data and relationship in source systems · - Updating and optimizing local and metadata models · - Define and govern data modelling an ...
-
Data Eng
21 hours ago
Boston Scientific Corporation Gurgaon, India**Data Eng - P2**: · - Remote Eligible: Hybrid- Onsite Location(s): Gurgaon, HR, IN**Additional Locations**: India-Haryana, Gurgaon · **Diversity - Innovation - Caring - Global Collaboration - Winning Spirit - High Performance** · At Boston Scientific, we'll give you the opportun ...
-
Business Intelligence Planning Execution
2 days ago
Hewlett Packard Gurugram, Haryana, India**Job Summary** · As a BIPE professional, your main responsibility is to analyze complex data, generate reports, and provide valuable insights to the organization's decisionmakers. Your role will require a deep understanding of the company's business operations and goals, as well ...
-
Oac Architect
1 week ago
USEReady Gurgaon, IndiaOracle Analytics Cloud ( OAC) architect · Leads the design and development of ETL and Data Integration routines using Oracle Integration Cloud · This position will partner with extended team business analysts to work with business leaders, business users, and IT teammates to plan ...
Big Data Developer - Gurgaon/Gurugram, India - Rocket Consulting
Description
Big Data EngineerPosition Overview :
We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies.
As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data warehouses, and analytical systems to support our organization's data-driven initiatives.
Key Responsibilities :
Qualifications :