Big Data Engineer-4+ Years - Bangalore, Karnataka, India
15 hours ago
Job description
Total IT / development experience of 3+ years- Experience in Spark (Scala-Spark or PySpark) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB+B4+A3:B5d technology strategies
- Exposure to deploying on Cloud platforms
- At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala/PySpark
- At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
- At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support DevOps
- Banking domain knowledge
- Hands-on experience in SAS toolset / statistical modelling migrating to Machine Learning models
- Banking Risk, Fraud or Digital Marketing Machine Learning models and use cases
- ETL / Data Warehousing, SQL and Data Modelling experience prior to Big Data experience
Chennai / Bangalore / Pune
Experience
4-7 Yrs
Similar jobs
Job Summary · The core engineer uses code to connect data from back-end systems to a variety of endpoints and process data for financial systems. May create domain APIs for service engineering. · An engineer is responsible for understanding business problems, designing, developi ...
12 hours ago
The Global Information Systems Group is dedicated to the success of Lam through providing best-in-class and innovative information system solutions and services. Together, we support users globally with data, information, and systems to achieve their business objectives. · We are ...
1 month ago
Job Summary · The core engineer uses code to connect data from back-end systems to a variety of endpoints and process data for financial systems. May create domain APIs for service engineering. An engineer is responsible for understanding business problems, designing, developing ...
12 hours ago
We are seeking a HPC Systems Engineer to lead the evaluation, · deployment and ongoing management of our large-scale CPU · and GPU-clustered environments.Lam Research (Lam) is an equal opportunity employer. · ...
1 month ago
We are seeking a HPC Systems Engineer to lead the evaluation deployment and ongoing management of large-scale CPU and GPU-clustered environments. · ...
1 month ago
We are looking for a skilled DevOps Engineer with strong hands-on experience in Python scripting, Ansible automation, and IT service management tools such as ServiceNow (SNOW). · 4-6 years of Experience on Devops. · Python Scripting is must · ...
1 month ago
We are looking for a skilled DevOps Engineer with strong hands-on experience in Python scripting, Ansible automation, · and IT service management tools such as ServiceNow (SNOW). The ideal candidate will be responsible for supporting · Designing, developing, and maintaining autom ...
1 month ago
We're looking for people who are excited about what we're doing -you don't need to know everything about IoT, but should be excited to learn. We're building in an entirely new space, so you'll be able to use creativity to help us solve problems and delight our customers. · Firmwa ...
1 month ago
Machine learning engineer with 4+ years of experience. · ...
1 month ago
Description · Minimum Qualification: · 5–8+ years of experience in automation engineering, detection engineering, data engineering, or cloud/SaaS security. · Strong programming and automation skills (Python/Go) with expertise in CI/CD, testing automation, and pipeline orchestrati ...
15 hours ago
Join Amadeus as we transform our platform for the future of travel. · ...
1 month ago
The Firmware team is responsible for designing and implementation of wearable and handheld receiver firmware at Dexcom. · This includes early research through to product manufacturing.You will bring expertise in bare metal firmware and embedded RTOS software design & development. ...
1 month ago
Minimum Qualifications · 6+ years in security engineering, detection engineering, or cloud security with exposure to SaaS and API-based environments. · Strong expertise in anomaly detection, behavioural analytics, and applied data science concepts for cybersecurity. · Hands-on ex ...
12 hours ago
We are seeking a detail-oriented and analytical Technician 4, Engineering to join our team in Bengaluru, India. · Bachelor's degree in Engineering (Electronics, Electrical, Computer Science, or related discipline). · 8-15 years of hands-on experience in a similar engineering tech ...
1 week ago
Amadeus aspires to be a leader in Diversity and Inclusion in the tech industry enabling every employee reach their full potential by fostering a culture of belonging and fair treatment attracting best talent from all backgrounds. · Diversity & Inclusion · ...
2 weeks ago
We are looking for an exceptional developer with experience or interest in building and deploying security tools to join our team. · Design and develop models and checkers for various languages. · ...
2 weeks ago
Amadeus aspires to be a leader in Diversity, Equity and Inclusion in the tech industry. · fostering a culture of belonging and fair treatment, · attracting the best talent from all backgrounds,, · and a role model for an inclusive employee experience. · ...
1 month ago
Amadeus aspires to be a leader in Diversity, Equity and Inclusion in the tech industry... · ...
1 month ago
Drive the quality strategy for complex backend systems APIs and provider integrations. · Define and execute test strategies for functional and non-functional areas ensuring alignment with CI/CD and industry standards e.g ISTQB SDL. · Design automate and execute test cases for bac ...
2 weeks ago
We are seeking an experienced Security Engineer to join our team in Bengaluru. The successful candidate will have a strong background in automation engineering and security with expertise in CI/CD, testing automation, and pipeline orchestration. · Automation-Driven Detection Engi ...
1 month ago