- Develop, test, and deploy data processing applications using Apache Spark and Scala.
- Optimize and tune Spark applications for better performance on large-scale data sets.
- Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
- Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
- Design and implement high-performance data processing and analytics solutions.
- Ensure data integrity, accuracy, and security across all processing tasks.
- Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
- Implement version control and CI/CD pipelines for Spark applications.
- Minimum 8 years of experience in application development.
- Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
- Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
- Ability to troubleshoot and optimize Spark and Cloudera platform performance.
- Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).
-
Extensive development experience with Spark, Scala and other Big Data technologies. · Experience with object oriented/scripting language. · Hands-on experience in Spark, Scala, Spark Streaming, Big Data technologies(Hive, Sqoop, Impala), Eclipse, Bitbucket. · Understanding Busine ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
Roles & Responsibilities · Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment · Participate in design and implementation of the analytics architecture. · Experience in working on Hadoop Distributi ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment · Participate in design and implementation of the analytics architecture. · Experience in working on Hadoop Distribution, good understanding of c ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment · Participate in design and implementation of the analytics architecture. · Experience in working on Hadoop Distribution, good understanding of c ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
KEY RESPONSIBILITIES: · 5+ years of experience working in a software product development organization building modern and scalable big data applications · • Expertise with functional programming, preferably Scala · • Fluency in Hadoop technologies and big data processing technolo ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,800,000 (INR) per year Full time2 days ago
-
Full Stack Development background with Java and JavaScript/CSS/HTML Knowledge of ReactJs/Angular is a plus Big Data Engineer with solid background with the larger Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop · CLI / MapReduce / Storm / ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...
Hyderabad / Secunderabad, Telangana, India Full time2 days ago
-
Role- Big data Lead · Job Description · Desired Competencies (Technical/Behavioral Competency) · Big data · Spark · Scala · Project Management · Responsibilities · Good experience in MQ or kafka or Rabbit MQ · Exp in .Terraform, Kubernete · CI/CD, Cloud · Good stakeholder managem ...
Hyderabad / Secunderabad, Telangana ₹1,200,000 - ₹2,400,000 (INR) per year Full time6 days ago
-
What the Candidate Will Need / Bonus Points · What the Candidate Will Do · Collaborate with engineering/product/analyst teams across tech sites to collectively accomplish OKRs to take Uber forward · Enrich data layers to effectively deal with the next generation of products whic ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time6 days ago
-
As a Senior Software Engineer on the AI Engineering Team at Cotiviti, you will be a leading force in developing robust, scalable machine learning solutions for healthcare applications. This senior-level position involves significant responsibility, including leading design and de ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
Job description · Job Summary: · We are looking for a Big Data Developer with expertise in Apache Spark, the Hadoop ecosystem. · Required Skills: · 5+ years of experience in big data technologies. · Strong programming skills in Java (Scala/Python is a plus). · Hands-on experience ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time6 days ago
-
Key Responsibilities: · Design and implement scalable, fault-tolerant data pipelines using Scala, Kafka, and other Big Data technologies. · Build real-time data streaming applications to process high-volume datasets from various sources. · Integrate and manage containerized appli ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,800,000 (INR) per year Full time6 days ago
-
Job description: · Bachelors degree in Computer Science, Engineering, Math, or a related field, or equivalent experience · 4+ years of experience with big data technologies, particularly Hadoop and Spark · Proficiency in programming languages such as Scala or Java · Experience wi ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time2 days ago
-
Bachelors or master's degree in computer science, Engineering, or a related field. · 10+ years of overall experience and 8+ years of relevant in Data bricks, DLT, Py spark and Data modelling concepts-Dimensional Data Modelling (Star Schema, Snowflake Schema) · Proficiency in prog ...
Hyderabad / Secunderabad, Telangana Full time6 days ago
-
Basic Qualifications: · Bachelordegree in Computer Science, Engineering, Math, or a related field, or equivalent experience · 7+ years of experience with Hadoop tech stack (Spark, Kafka) · Should have experience with batch processing on large scale data with Spark and real-time w ...
Hyderabad / Secunderabad, Telangana Full time2 days ago
-
No of years' experience 5+ Years Detailed job description Skill Set:. · Expertise in database testing and should be able to write complex SQL queries. · Proficient in any 1 programming language (Python, Java, Scala etc). · Hands-on experience in system, integration and regression ...
Hyderabad / Secunderabad, Telangana ₹400,000 - ₹1,200,000 (INR) per year Full time6 days ago
-
Role & Responsibilities: · Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow/Beam, Dataproc/Spark, and Airflow/Composer. · Model and optimize datasets in BigQuery using partitioning, clustering, materialized views, and UDFs. · Build streaming and near-real-tim ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time6 days ago
-
Roles & Responsibilities: · Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow (Apache Beam), Dataproc/Spark, and Cloud Composer (Airflow). · Model and optimize datasets in BigQuery, including partitioning, clustering, materialized views, and UDFs. · Build stre ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time6 days ago
-
4+ years of relevant IT experience in the BI/DW domain with minimum 2 years of hands-on experience on Azure modern data platform that includes Data Factory, Databricks, Synapse (Azure SQL DW) and Azure Data Lake Meaningful experience of data analysis and transformation using Pyth ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,200,000 (INR) per year Full time2 days ago
-
6+ years of total experience with 4+ years as a lead developer in Datawarehouse, Big Data, and Hadoop implementation within Azure environment · Participate in the design and implementation of analytics architecture · Hands-on experience with Hadoop Distribution and solid understa ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,800,000 (INR) per year Full time6 days ago
Spark, Scala - Hyderabad / Secunderabad, Telangana - Cognizant Technology Solutions India Pvt Ltd
Description
Required Skills & Experience:
-
Spark, Scala, Spark Streaming
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Azure Databricks, Databricks, Notebooks, Spark-Scala
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Azure Databricks,Databricks,Notebooks,Spark-Scala,Bigdata professional
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Azure Databricks,Databricks,Notebooks,Spark-Scala,Bigdata professional
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Big Data Engineer
Full time Hucon Solutions- Hyderabad / Secunderabad, Telangana
-
Fullstack -professional
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer-Data Platforms-AWS
Full time IBM- Hyderabad / Secunderabad, Telangana, India
-
Big data Lead
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Software Engineer II
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Sr Software Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Big Data Developer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Big Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time COTIVITI- Hyderabad / Secunderabad, Telangana
-
Senior Databricks engineer(DLT
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Sr Software Engineer
Full time COTIVITI- Hyderabad / Secunderabad, Telangana
-
Functional Testing
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Modeler
Full time IDESLABS- Hyderabad / Secunderabad, Telangana
-
Big Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana