- Design, develop, and maintain data processing pipelines using Apache Spark.
- Optimize Spark jobs for performance and scalability in distributed environments.
- Work with large datasets to perform ETL (Extract, Transform, Load) operations.
- Collaborate with data scientists, analysts, and engineers to deliver robust data solutions.
- Ensure adherence to best practices for data quality, security, and governance.
- Troubleshoot and resolve issues related to data processing and performance tuning.
- Proficiency in Spark Core, Spark SQL, and Spark Streaming.
- Strong programming skills in Scala (preferred), or Python/Java.
- Experience with distributed computing and parallel processing concepts.
- Familiarity with the Hadoop ecosystem, Hive, or related technologies.
- Solid understanding of data structures, algorithms, and performance optimization.
-
We're hiring for one of the world's leading professional services firms. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate comple ...
Pune ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Job Summary: Dynamic and motivated IT professional with excellent communication skills and over 6-8 years of experience as a Data Engineer. · Key Skills: Python, PySpark, AWS CloudFormation, SQL programming (PostgreSQL/MySQL), Extract, Transform, Load (ETL), data warehouse,Excell ...
Pune4 weeks ago
-
Skills and Qualifications: · Mandatory Skills: · Strong hands-on experience with DataStage development and administration. · Proficiency in SQL and PL/SQL for complex data manipulation and query optimization. · Experience deploying and managing DataStage solutions. · Deep underst ...
Pune ₹900,000 - ₹2,200,000 (INR) per year Full time3 hours ago
-
We are seeking an experienced Big Data Developer with strong expertise in the Hadoop ecosystem and hands-on experience in Scala, Spark, Hive, MapR, and Python. The ideal candidate will have a strong foundation in object-oriented programming ,experience building enterprise-grade d ...
Pune1 month ago
-
The Big Data Developer plays a key role in the modernization of data ecosystem — supporting the migration of legacy MAPR/Cloudera/Hortonworks applications to open-source frameworks compatible with NexusOne.Analyze, refactor, and modernize Spark/MapReduce/Hive/Tez jobs for executi ...
Pune Full time1 month ago
-
We're hiring for one of the world's leading professional services firms. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory and financial advisory — helping Fortune 500 companies and governments navigate complex ...
Pune ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Design and implement data virtualization solutions using Denodo to support business intelligence and analytics initiatives. · ...
Pune1 month ago
-
We are looking for a skilled IBM DataStage Developer to design develop and maintain robust ETL solutions for enterprise data warehousing and analytics platforms. · Design develop test and deploy ETL jobs using IBM DataStageAnalyze source systems and translate business requirement ...
Pune4 weeks ago
-
About job description for the role of DataStage developer. Total IT experience of 5 to 7 years with relevant experience in ETL area esp. DataStage tool. · ...
Pune4 weeks ago
-
Translate requirements items into user stories compatible with robust engineering designs and logical units of work. · ...
Pune1 month ago
-
We're hiring for one of the world's leading professional services firms. · With a presence in over 150 countries,this organization provides services across consulting audit tax risk advisory and financial advisory — helping Fortune 500 companies and governments navigate complex c ...
Pune, Maharashtra, India1 week ago
-
We are looking for a Big Data Developer to carry out coding or programming of Hadoop applications and developing software using Hadoop technologies like Spark, Scala, Python, Hbase, Hive, · Cloudera.In this role you will need to concentrate in creating testing implementing and mo ...
Pune, Maharashtra1 month ago
-
We are hiring for IBM Data Stage Developer. Proficiency in creating and importing ISX files, migrating connections, and updating scripts are mandatory skills. · ...
Pune ₹900,000 - ₹2,200,000 (INR) per year1 day ago
-
Provide assistance with product development within technology domain Conduct product evaluations Assist with training activities Mentor junior team members Ensure team's adherence to control initiatives Provide third line support Identify root cause of issues React to systems out ...
Pune Full time3 weeks ago
-
The Engineer Intmd Analyst is an intermediate level position responsible for a variety of engineering activities including the design acquisition and development of hardware software and network infrastructure in coordination with the Technology team. The overall objective of thi ...
Pune Full time3 weeks ago
-
This job involves creating data visualizations using Tableau and SQL. The ideal candidate will have 5-8 years of experience in systems analysis and programming. · ...
Pune Full time1 month ago
-
Big data developer responsible for designing and developing scalable big data systems using core frameworks such as Apache Spark. · ...
Pune, Maharashtra4 weeks ago
-
Squircle IT Consulting Services is a leading IT solutions and services company. · ...
Pune, India2 weeks ago
-
The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. · Conduct tasks related to f ...
Pune Full time1 month ago
-
Experience in Datastage and strong experience in SQL are required. · ...
Pune1 month ago
Big Data Developer - Pune - Tata Consultancy Services
Description
TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project.
Role- Big Data Engineer
Location- Pune
Experience- 4+ years
Please find the job description below:
About the Role:
We are looking for an experienced Big Data Engineer with proven hands-on expertise in Apache Spark. The role involves designing, developing, and optimizing large-scale data processing pipelines. Proficiency in Scala is preferred; however, experience in any JVM-based language for Spark development is acceptable.
Key Responsibilities:
Required Skills & Qualifications:
-
Big Data Developer
Full time Only for registered members Pune
-
Python Data Developer/ Data Engineer
Only for registered members Pune
-
Data Stage Developer
Full time confidential- Pune
-
Big Data Developer
Only for registered members Pune
-
Big Data Developer
Full time Only for registered members Pune
-
Big Data Developer
Full time Only for registered members Pune
-
Data Modelling developer
Only for registered members Pune
-
Data Stage Developer
Only for registered members Pune
-
Data Stage Developer
Only for registered members Pune
-
Python Data Developer
Only for registered members Pune
-
Big Data Developer
Only for registered members Pune, Maharashtra, India
-
Big Data Developer
Only for registered members Pune, Maharashtra
-
Data Stage Developer
Only for registered members Pune
-
Big Data Developer
Full time Only for registered members Pune
-
Big Data Developer
Full time Only for registered members Pune
-
Tableau Data Developer
Full time Only for registered members Pune
-
Big Data Developer
Only for registered members Pune, Maharashtra
-
Data Stage Developer
Only for registered members Pune, India
-
Tableau Data Developer
Full time Only for registered members Pune
-
Data Stage Developer
Only for registered members Pune