- Design, develop, and maintain data processing pipelines using Apache Spark and Scala
- Optimize Spark jobs for performance, scalability, and reliability
- Collaborate with data engineers and data scientists to implement data-driven solutions
- Develop and maintain ETL processes to ingest, transform, and load large volumes of data
- Perform data analysis and troubleshooting to ensure data quality and integrity
- Work with cross-functional teams to understand business requirements and translate them into technical solutions
- Participate in code reviews, unit testing, and documentation
- Bachelor's degree in Computer Science, Engineering, or related field
- Strong proficiency in Scala programming language
- Hands-on experience with Apache Spark, including Spark Core, Spark SQL, and Spark Streaming
- Experience with big data technologies such as Hadoop, Hive, and Kafka
- Proficiency in SQL for data querying and manipulation
- Familiarity with distributed computing principles and parallel processing techniques
- Experience with data modeling, data warehousing, and database design
- Strong analytical and problem-solving skills
- Hadoop
- Scala
- Spark
-
Spark Scala
3 weeks ago
Cognizant Chennai, IndiaPrimary Skill : Spark, Scala · - Secondary Skill : Python, AWS, Shell Scripting- Strong hands on experience on Spark/Scala · - Good Understanding experience in Hadoop, Hive, Oozie, HDFS, YARN, Sqoop · - Good understanding in AWS services · - Should have experience/understanding o ...
-
Scala Spark Developers
3 weeks ago
PTS Consulting Chennai, IndiaWe are seeking Experienced Scala Spark developers with extensive experience to join our growing Data Engineering practice delivering transformative solutions. We strongly encourage immediate joiners. · Location :Pune, Bangalore & Chennai · Skill : Spark Scala · Total Exp: 5-8year ...
-
Spark Scala Developer
2 weeks ago
RiskInsight Consulting Pvt Ltd chennai, IndiaDesign, develop, and maintain data processing pipelines using Apache Spark and Scala. · Optimize Spark jobs for performance, scalability, and reliability. · Work closely with data engineers and data scientists to implement data-driven solutions. · Develop and maintain ETL proc ...
-
Big Data- Spark Scala
2 weeks ago
Nityo Infotech chennai, IndiaA , Bangalore , Big Data , Data , Level , Level A , Location , Pune , Scala , Spark Experience Required · 3 - 9 Years · Industry Type · IT · Employment Type · Permanent · Location · India · ...
-
Spark Scala Data Engineer
2 weeks ago
CAPCO chennai, IndiaSpark Scala Data Engineer - Bangalore/ Chennai · at Capco India Job Title: Data Engineer with Spark and Scala · About Us · "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and ...
-
Spark Scala Data Engineer
1 week ago
CAPCO Chennai, IndiaSpark Scala Data Engineer - Bangalore/ Chennai · at Capco India · Job Title: Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with · Consultancy of the year in the British Bank Award · and has been r ...
-
Big Data- Spark Scala
1 week ago
Nityo Infotech Chennai, IndiaA , Bangalore , Big Data , Data , Level , Level A , Location , Pune , Scala , SparkExperience Required · 3 - 9 Years · Industry Type · IT · Employment Type · Permanent · Location · India ...
-
Scala Developer
2 weeks ago
Alp Consulting Limited Chennai, IndiaExp:-6+Yrs · Location:-Bangalore · Job Type:- Contract to Hire · job Description:- · 6+ years of experience designing, developing, and implementing complex enterprise Java applications using Java 8, Spring, Spring Boot and Microservices · Leverage Apache Spark for big data proces ...
-
Scala developer
1 month ago
Cognizant Technology Solutions Chennai, India OTHER· Level · JD · M · Role: Scala Developer · Tech Stack: · Working knowledge in Scala – min 50% - Java – 100% · Working knowledge in ReactJs and backboneJS – min 25% · Working knowledge in Terraform AWS, strong CI/CD understanding and experience – Mandatory · Working knowledge o ...
-
Scala Developer
1 week ago
Alp Consulting Limited Chennai, IndiaExp:-6+YrsLocation:-BangaloreJob Type:- Contract to Hire · job Description:- · 6+ years of experience designing, developing, and implementing complex enterprise Java applications using Java 8, Spring, Spring Boot and MicroservicesLeverage Apache Spark for big data processing and ...
-
Java with Scala Developer
1 month ago
DATA SOFTWARE RESEARCH COMPANY Chennai, India Full timeApply for Java With Scala Developer DSRC, Career Progress Consultants in Chennai for 6 - 8 Year of Experience on ...
-
Aws Databricks
3 weeks ago
Cognizant Chennai, India**Detail JD **:Databricks on AWS** · Strong knowledge on streaming using databricks · Databricks Admin knowledge · Strong experience using Pyspark, Spark and Scala · Strong experience and/or exposure to Databricks ML feature store, Floor tracking server, ML capabilities · Strong ...
-
Nsp Big Data
3 weeks ago
Incedo Chennai, IndiaCompany Overview · Incedo is a US-based consulting, data science and technology services firm with over 2,500 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniquene ...
-
Platform Architect
3 weeks ago
NielsenIQ Chennai, Tamil Nadu, India**Job Description** REFID948632** · **Platform Architect, Chennai.** · **Responsibilities**: · - Help with architecture designs for key products on the NIQ platforms. · - Help identify future solutions and drive innovations through PoCs, technology migration planning to get to pr ...
-
Data Scientist
3 weeks ago
Ford Motor Company Chennai, India**Responsibilities**: · - Acquire deep understanding of the business problems and translate them into appropriate business solutions · - Collaborate internally and externally to identify new and novel data sources and explore their potential use in developing actionable business ...
-
Spark + Python
3 weeks ago
Cognizant Chennai, IndiaEXP: 4 to 10 years · Skill: Pyspark · Location: Chennai, Cochin, Coimbatore & Kolkata · **Required**: · - Hands-On experience into PySpark, ETL development experience · - Working experience into Spark for data processing, aggregation and transformation with unit tests and design ...
-
Aws Glue
3 weeks ago
Cognizant Chennai, India**EXP**: 4 to 12 years · **Skill**: AWS Glue · **Location**: Chennai, Cochin, Coimbatore & Kolkata · - Expertise in the design, data modelling creation, and management of large datasets/data models · - Strong experience with AWS services( Glue,Lambda, Spark, S3, and Github, Redsh ...
-
Databricks Platform Administrator
3 weeks ago
Tiger Analytics Chennai, Tamil Nadu, IndiaThe Databricks Administrator will be responsible for providing technical expertise in deploying · administration, configuration, and optimization of the Databricks platform to enable data analytics, · machine learning, and data engineering activities within the organization. You ...
-
Nets Holding
1 week ago
RARR Technologies Chennai, India**Job Details - Nets holding**: · **Job ID**: · - RARR Job 2880**Job Title**: · - Nets holding**Job Type**: · - Permanent**Job Location**: · - CHENNAI, MUMBAI, PUNE**Total Experience**: · Years**Skills**: · - SCALA, SPARK**Posted - **17/01/2023 · **Job Description**: · Primary:sc ...
-
Data Architect
2 weeks ago
Virtusa Chennai, Tamil Nadu, India**JOB DESCRIPTION** · **Skill: Data Architect** · **Role / Tier: - Data with Spark / Scala Python Tier 1 / Tier 0** · **Required Qualifications**: · 10 years' Experience in software development using programming languages & tools/services Java or Python or Scala and SQL. · - Expe ...
Spark/Scala Developer - Chennai, India - RiskInsight Consulting Pvt Ltd
![Default job background](https://contents.bebee.com/public/img/bg-user-ex-1.jpg)
Description
We are hiring a Data Engineer, and we are looking for someone to join our team. Check out the job details below:
Requirements:
Desired Skills and Experience: