- Design and implement scalable and efficient data processing pipelines using Apache Spark, Scala.
- Solid understanding of big data technologies and ecosystems (Kafka, airflow, etc.) and also good knowledge on Python and ML concepts.
- Experience in AWS cloud-based architecture, development, and deployment
- Familiarity with DevOps tools and practices, including Docker, Kubernetes, Jenkins, and Git.
- Collaborate with cross-functional teams to understand data requirements and deliver innovative data solutions.
- Ensure high data quality and integrity by implementing robust testing and validation practices.
- Lead the adoption of best practices in code quality, CI/CD, and DevOps within the data engineering team.
- Bachelor's or master's degree in computer science, Engineering, or a related field.
- At least 8+ years of software development experience
- Excellent problem-solving skills, with the ability to tackle challenges in large-scale data environments.
- Strong communication and collaboration skills, with the ability to work effectively in a team and interface with technical stakeholders.
-
Hashmap Bengaluru, India: · The Data Integration Developer standardizes the quality assurance procedure for software. Oversees testing and debugging and develops fixes. Researches complaints and makes necessary adjustments and/or recommendations to resolve complex software related issues. Understands de ...
-
Big Data Developer
1 week ago
Concentrix Bengaluru, IndiaData Engineer Big Data · Job Description · Develops and maintains scalable data pipelines · Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across ...
-
Lead Data Developer
5 days ago
Airbus Bengaluru, IndiaQualification & Experience : · ● Graduate in an area such as Information Technology, Engineering . · ● At least 8 years experience in BigData Development. · ○ Strong Hands On Experience on Python, PySpark, Java Script · ● Primary Skills · ○ Knowledge of SQL and relational dat ...
-
Big Data Developer
1 day ago
Impetus Bangalore Urban, IndiaLooking for #immediatejoiners preferred · Experience - 2-6 years · Location - Gurgaon /Bangalore · Job Description · Experience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriate · Hands-on expertise with application des ...
-
Big Data Developer
7 hours ago
HTC Global Services Bangalore Urban, IndiaAbout HTC Global Services · HTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 ...
-
Big Data Developer
1 week ago
Impetus Bengaluru, IndiaLooking for #immediatejoiners preferredExperience - 2-6 yearsLocation - Gurgaon /BangaloreJob DescriptionExperience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriateHands-on expertise with application design, software d ...
-
Big Data Developer
1 week ago
ARR Recruitment Solutions Bangalore/Hyderabad/Noida/Gurgaon/Gurugram/Indore, India permanentRequirement : · - Solid Experience of software development experience and leading teams of engineers and scrum teams. · - 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java). · - Solid Data warehousing concepts. · - Knowledge of Financial ...
-
Big Data Developer
1 day ago
Codersbrain technology pvt ltd Bengaluru, IndiaSalary : LPA · Requirements : · - Bachelor's/Master's degree in Computer Science, Engineering, or a related field. · - Master's degree preferred. · - Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems. · - Hands-on e ...
-
Data Informatica Developer
1 day ago
HS Solutions Inc Bengaluru, IndiaSkill : Data Informatica Developer · Experience : 7- 12 Years · Job Type : Full-Time Employment · Notice Period : Immediate to 15 Days Only · Role & Responsibilities : · - We are seeking Data Developer with a minimum of 7-12 years of work experience in designing, developing, test ...
-
Big Data Developers
3 days ago
Andor Tech (India) Pvt Ltd Bengaluru / Bangalore, India Full time· Job Description : Development Engineer Mid Data Science & Analytics Spark, Scala, Hadoop, Hive Experience in building highly scalable data pipelines. Support to Build the work needed to implement features from the product backlog Support to Size user stories Support for Unit t ...
-
Big Data Developer
1 day ago
Treyas Infotech and Consulting Pvt Ltd Bengaluru, IndiaJOB DESCRIPTION : · Data Engineering, you will be responsible for translating client requirements · into design, architecting, and implementing GCP Cloud-based big data solutions for clients. · Your role will be focused on delivering high-quality solutions by independently drivin ...
-
Data Backend Developer
2 days ago
IBU Consulting Bengaluru, India permanentWe are hiring a Backend Developer for our most reputated Clint as on Contract basis, · Working Mode - 1 year Contract · Location : Gurugram, Bangalore and Mumbai, India · Notice Period : Immediate · Mandatory Skill Set : · - Python · - Terraform · - Generative AI · - Azure · Job ...
-
Big Data Developer
5 days ago
HTC Global Services Bengaluru, India4+ years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible · Expertise on Data processing, Orchestration, Parallelization, and Transformation · Expertise in Spark Job, Joblets and Scala ...
-
Big Data Developer
6 days ago
HTC Global Services Bengaluru, IndiaThe project team will be spread between Paris and Bangalore. So, the candidate with an experience of 4-7 years is expected to work and coordinate on daily basis with the remote teams. Ability to learn new technology / framework / methodology. · • Hands-on individual responsible f ...
-
Big Data Developer
1 week ago
LTIMindtree Bengaluru, IndiaJob Description- · Strong candidate with minimum 5-12 years' of experience with good knowledge in Hadoop Ecosystem · Having core experience on Apache Spark, Scala, Python, Hive, HDFS, Hbase, Sqoop to deliver end to end solutions · Good hands-on creating Database, schemas and Hive ...
-
Developer - Data visualisation
10 hours ago
Louis Dreyfus Company Bengaluru, IndiaCompany Description Louis Dreyfus Company is a leading merchant and processor of agricultural goods. Our activities span the entire value chain from farm to fork, across a broad range of business lines, we leverage our global reach and extensive asset network to serve our custom ...
-
Azure Data Bricks Developer
1 week ago
Tech Mahindra Bengaluru, IndiaData bricks DBT Data engineer: · Data Engineer - Databricks and DBT MUST · Worked as Data Engineer in area of Data Warehousing/Business Intelligence · Very hands on heavy on quickly learning Databricks and DBT. · Data Migration experience if possible · Must have experience workin ...
-
Big Data Development Manager
1 week ago
Mobileum Bengaluru, IndiaWe are Mobileum and finding meaning in data is what we do. · We are a leading provider of analytics solutions for the Telecom industry. We believe in a world where people make decisions based on facts and truthful data. We optimize roaming, protect networks and improve customer ...
-
Big Data Development Manager
1 week ago
Mobileum Bengaluru, IndiaWe are Mobileum and finding meaning in data is what we do. · We are a leading provider of analytics solutions for the Telecom industry. We believe in a world where people make decisions based on facts and truthful data. We optimize roaming, protect networks and improve customer ...
-
Snowflake Data Warehouse Developer
1 day ago
Dimiour Bangalore/Anywhere in India/Multiple Locations permanentAbout the Role : · - We are seeking a talented Snowflake Data Warehouse Developer to join our team and play a key role in designing, developing, and maintaining our data warehouse built on Snowflake. · - You will work closely with stakeholders to understand business needs and tr ...
Big Data Developer - Bengaluru, India - Tavant
Description
With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.
Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions is routinely rated high by the industry.
Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. Furthermore, we do not focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We will create a world of opportunities for you.
Job Details
Job Title: Big Data – Kafka & Airflow expert
Location: Bangalore / Pune / Hyderabad / Noida / Kolkata
Quick joiners needed.
Key Responsibilities:
Required Qualifications: