- Data Pipeline Development: Design, build, and maintain robust and scalable ETL (Extract, Transform, Load) pipelines for ingesting, transforming, and loading large datasets from various sources into Big Data platforms.
- Big Data Ecosystem Utilization: Work with and optimize components of the Hadoop ecosystem (e.g., HDFS, Hive) and Apache Spark for distributed data processing and analysis.
- Data Processing & Transformation: Develop efficient code using programming languages (e.g., Python, Scala, Java) to perform data manipulation, cleansing, and transformation for analytical purposes.
- Database Management: Interact with and manage various databases, including relational (SQL) and NoSQL databases (e.g., Cassandra, MongoDB, HBase), for data storage and retrieval.
- Troubleshooting & Optimization: Identify, troubleshoot, and resolve performance bottlenecks and issues within Big Data pipelines and infrastructure.
- Data Quality & Governance: Assist in implementing data quality checks and contribute to data governance practices to ensure data accuracy, consistency, and reliability.
- Collaboration: Collaborate effectively with Data Scientists, Data Analysts, and other engineering teams to understand data requirements and deliver reliable data solutions.
- Monitoring & Support: Monitor Big Data jobs and processes, providing operational support and maintenance for developed solutions.
- Continuous Learning: Stay updated with the latest trends and advancements in Big Data technologies and contribute to the adoption of new tools and best practices.
- Experience: 2 to 4 years of hands-on experience in Big Data engineering or a related data-centric role.
- Big Data Technologies: Practical experience with key Big Data technologies such as Apache Hadoop, Apache Spark, and data warehousing concepts (e.g., Hive).
- Programming Skills: Proficiency in at least one programming language relevant to Big Data (e.g., Python, Scala, or Java).
- Database Skills: Strong command of SQL for data querying and manipulation. Familiarity with NoSQL databases is a plus.
- Cloud Exposure (Plus): Exposure to Big Data services on cloud platforms (e.g., AWS EMR, Azure Data Lake Analytics, Google Cloud Dataproc) is advantageous.
- Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail in complex data environments.
- Communication: Good verbal and written communication skills to effectively collaborate with team members and stakeholders.
- Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related quantitative field.
-
Responsibilities: · Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud, combined with other technologies · Ensure the use of Big Query SQL, Java/Python/Scala and Spark reduces l ...
Bengaluru / Bangalore ₹600,000 - ₹2,200,000 (INR) per year Full time3 days ago
-
Must have Skills: Big data SQL Java · Job Type Full time · ...
Bengaluru, Karnataka1 month ago
-
We are looking for a hands-on Data Engineer to join a high-impact data engineering team with a focus on developing the data platform and working with the product team to develop data and analytics pipeline.Work and enhance big data related opensource technologies. · Build and ope ...
Bengaluru3 weeks ago
-
We are looking for a hands-on Data Engineer to join a high-impact data engineering team with a focus on developing the data platform and working with the product team to develop data and analytics pipeline. · ...
Bengaluru, Karnataka3 weeks ago
-
We're hiring for one of the world's leading professional services firms. This organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies navigate complex challenges. · About the Role: · We are seeking a high ...
Bengaluru ₹900,000 - ₹2,500,000 (INR) per year Full time5 days ago
-
Job Position: GCP Big Data Engineer · Job Type: Full-Time · Location: Bengaluru/Gurgaon · Experience: 5 to 10+ Years · Mandatory Skills: · Python for DATA, GCP Big Query, Python, GCP Data stream, ANSI-SQL · Job Summary · Seeking a Specialist with 5 years of experience in GCP Data ...
Bengaluru, Karnataka ₹900,000 - ₹2,500,000 (INR) per year4 days ago
-
As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform. · ...
Bengaluru, Chennai, Hyderabad2 weeks ago
-
Analyze and understand the current Apache Spark platform codebase including performance nuances work with large-scale distributed systems for big data processing and analytics implement best practices for data storage processing and retrieval. · ...
Bengaluru, Chennai, Pune1 month ago
-
Design, develop, test, deploy and maintain large-scale big data solutions using Scala/Python programming languages. · Collaborate with cross-functional teams to gather requirements and deliver high-quality software products on time. · Develop scalable and efficient algorithms for ...
Bengaluru, Hyderabad2 weeks ago
-
We are seeking a · Data Engineer · to build, enhance, and support · large-scale · batch and streaming data pipelines · for fraud detection and risk analysis. · The role focuses on processing user and transactional data using Spark SQL Flink SQL Hadoop/HDFS light Java work for Map ...
Bengaluru, Karnataka1 month ago
-
Need to have experience in Big Data technologies and support projects. Able to quickly analyze complex SQL queries and grasp underlying functionality and able to provide RCA. · ...
Bengaluru1 month ago
-
We are looking for a Data Engineer with 3+ years of experience in building, maintaining, and supporting large-scale data pipelines. · Develop and optimize ETL/ELT pipelines using Spark, Hive, and Airflow · Manage data ingestion workflows including Sqoop transfers (Oracle Hive) an ...
Bengaluru1 month ago
-
We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark ...
Bengaluru / Bangalore ₹900,000 - ₹2,800,000 (INR) per year Full time3 days ago
-
Key Responsibilities: · Data Architecture: Design and implement scalable storage solutions using Hadoop, NoSQL databases, HBase, and Cassandra. · Big Data Processing: Develop and maintain pipelines using Apache Spark, Apache Storm, Apache Pig, MapReduce, and Oozie. · Scripting & ...
Bengaluru / Bangalore ₹900,000 - ₹2,800,000 (INR) per year Full time3 days ago
-
As a Custom Software Engineer you will engage in the development of custom software solutions that are designed to meet specific business needs. · Design and build end-to-end data pipelinesUnit testing of the pipelines and UAT supportUnderstand the current codes pipelines and scr ...
Bengaluru, Karnataka1 month ago
-
We are seeking a highly skilled Big Data Developer with strong expertise in Spark and Scala to join our dynamic team. · ...
Bengaluru ₹900,000 - ₹2,500,000 (INR) per year Full time5 days ago
-
Job Title: Big Data Engineer · Location:Bangalore · Experience: 5-10 Years (STRICTLY) · Employment Type: Permanent · Notice Period: Immediate to Max 30 Days Only · Interview Mode: Face-to-Face (Saturday, 28th February 2026) · Job Description: · Understanding & familiarity with a ...
Bengaluru ₹900,000 - ₹2,800,000 (INR) per year4 hours ago
-
We have multiple roles for Big data developer - Top brand - Bangalore / Chennai locations. · We need hands on experience Spark,Scala,AWS & Big data. ...
Bengaluru, Chennai ₹900,000 - ₹2,500,000 (INR) per year5 days ago
-
Job Title: Big Data Lead / Data Engineer · Location: Chennai & Bangalore · Grade: G6 (9+ year) · Industry: IT · About the Role: · We are looking for an experienced Big Data Lead / Data Engineer with strong hands-on expertise in data engineering, pipeline automation, and cloud tec ...
Bengaluru, Chennai ₹2,500,000 - ₹5,500,000 (INR) per year1 day ago
-
We are looking for an experienced Senior Big Data Engineer to design, build and maintain scalable big data platforms. · 6+ years of hands-on experience in Big Data engineering using Spark and Scala. · Strong understanding of distributed systems and Big Data technologies such as H ...
Bengaluru2 weeks ago
Big Data - Bengaluru / Bangalore - confidential
Description
Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute significantly to ensuring smooth data operations and enabling data-driven insights to meet various business objectives for our clients.
Roles and Responsibilities:
Preferred Candidate Profile:
-
Big Data
Full time confidential- Bengaluru / Bangalore
-
Big Data
Only for registered members Bengaluru, Karnataka
-
Data Engineer – Big Data
Only for registered members Bengaluru
-
Data Engineer – Big Data
Only for registered members Bengaluru, Karnataka
-
Big Data Developer
Full time Only for registered members Bengaluru
-
Big Data Developer
Only for registered members Bengaluru, Karnataka
-
Big Data Engineer
Only for registered members Bengaluru, Chennai, Hyderabad
-
Big Data Engineer
Only for registered members Bengaluru, Chennai, Pune
-
Big Data Developer
Only for registered members Bengaluru, Hyderabad
-
Data Engineer – Big Data
Only for registered members Bengaluru, Karnataka
-
Big Data Engineer
Only for registered members Bengaluru
-
Big Data Engineer
Only for registered members Bengaluru
-
Big Data Engineer
Full time confidential- Bengaluru / Bangalore
-
Big Data Engineer
Full time confidential- Bengaluru / Bangalore
-
Big Data Admin
Only for registered members Bengaluru, Karnataka
-
Big Data Developer
Full time Only for registered members Bengaluru
-
Big Data Engineer
Only for registered members Bengaluru
-
Big data developer
Only for registered members Bengaluru, Chennai
-
Big Data Lead
Only for registered members Bengaluru, Chennai
-
Big Data Engineer
Only for registered members Bengaluru