- Mandatory
- Scala, Spark and Java / Python
- Experience in following technologies
- MapReduce, HDFS, YARN, Spark Streaming.
- Experience in creating e2e pipelines in Hadoop.
- Experience in SQL, Hive and NoSQL databases
- Experience in Linux / Unix platform
- Experience of cloud design patterns
- Experience in Jenkins, GitHub, Debugging the code, and error handling.
- Experience in Building end to end ETL Pipelines
- Selfstarter & resourceful personality with the ability to manage pressure situations.
- Experience working with geographically distributed teams.
- Work on high level business and technical problems, contribute to architectural decisions.
- Create the core framework/templates that gives a starting point for the team members to get started with implementation/ execution.
- Build Data and ETL pipelines in Hadoop.
- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python
- Interact with customers daily to ensure smooth engagement.
- Exposure to GCP
- Responsible for timely and quality deliveries.
- Exposure to Scrum and Agile Development best practices
-
TeacherOn Pune, India Part timeI want to learn about basics of data engineering workflow including ,Kafka, Hadoop, pyspark , from non technical background but need it as I have switched to Business Intelligence role. · Level: Beginner · Gender Preference: None · Meeting options: · Available online - via skype ...
-
Hadoop Administrator
2 days ago
FIS Global Pune, Maharashtra, India**Position Type**: · Full time · **Type Of Hire**: · Experienced (relevant combo of work and education) · **Education Desired**: · Bachelor's Degree · **Travel Percentage**: · 0% · **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** · Are you cur ...
-
Aws/azure de with Snowflake
3 days ago
Abzooba Pune, India**Key Responsibilities**: · - Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities · - Monitoring performance and advising any necessary infrastructure changes · **Required Experience, Skills and Qualifications**: · - MUST have HA ...
-
Big Data Architect
2 days ago
RSI Retail Solutions India Pvt. Ltd. Pune, India**Good to have skills**: - Data Migration experience for big data workloads · - Experience with Data on Cloud, Data Management, and Data Visualization skills · - Exposure to Data Governance, Data Catalogues, MDM and other Meta Data Management solutions · - Strong knowledge of pla ...
-
DevOps - I
2 days ago
Helpshift Pune, IndiaSome numbers which illustrate our scale: · - ~30k/rps · - ~700 VMs · - ~50ms avg response time · - ~350GB data transfer out / hour · **About the Role**: · - Understand, automate and scale Helpshift cloud infrastructure. This will involve learning and working with various cloud te ...
-
Principal Data Scientist
1 day ago
CRUTZ LEELA ENTERPRISES Pune, IndiaPrincipal Data Scientist Required · A Master's degree in machine learning, mathematics, computer science, · statistics/economics or related fields. · solutions in a corporate or consulting setting, preferably Healthcare · industries. · - Ability to solve data science problems usi ...
-
Data Architect
2 days ago
NewVision Softcom & Consultancy Pune, Maharashtra, IndiaDataPunePosted On · - 15 Feb 2024 · - Required Experience · Years · Basic SectionGrade · Role · Data Architect · Employment Type · Full Time · Employee Category · OrganisationalGroup Company · NewVision · Company Name · New Vision Softcom & Consultancy Pvt. Ltd · Function · Busin ...
-
Data Scientist
1 day ago
GITCS India Pvt. Ltd. Pune, IndiaDesign and develop scalable solutions using AI tools and machine-learning models. · Perform research and testing to develop machine-learning algorithms and predictive models. · Conduct model training and evaluation. · Implement end-to-end solutions for batch and real-time algorit ...
-
Aws Architect
11 hours ago
Brillanz Software Solution Pune, Maharashtra, IndiaPosition: AWS Architect - Data Engineering · Location: Bangalore, Pune, Kolkata, NCR, Mumbai, Chennai · Experience: 8+ years to 15 years · Relevant Experience: 5+ Years in AWS Services/ 6+ Years in Data Engineering and Experience with Solution Designing(mandatory). · **Salary**: ...
-
Agile Product Owner
11 hours ago
Deutsche Bank Pune, India**Job Title: Full Stack Associate** · **Location: Pune** · Enterprise Risk Technology (ERT) is the technology partner to the Risk divisions of Credit Risk, Market Risk and Non-Financial Risk. This includes definition of the IT strategy and provision of solutions to allow Risk to ...
-
Solution Architect
3 days ago
Yash Technologies Pune, Maharashtra, IndiaDate: Apr 4, 2024- Job Requisition Id: Location: Indore, MP, IN Indore, IN Pune, MH, IN Hyderabad, IN Indore, MP, INYASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exc ...
-
Scrum Master
2 days ago
Deutsche Bank Pune, India**Job Title: Scrum Master** · **Location: Pune** · **Role Description** · Enterprise Risk Technology (ERT) is the technology partner to the Risk divisions of Credit Risk, Market Risk and Non-Financial Risk. This includes definition of the IT strategy and provision of solutions to ...
-
Digital Scrum Master
2 days ago
Michelin Pune, IndiaDigital Scrum Master · MISSION : The Scrum Master is in charge of: · - Promote, support, implement and help everyone understand Scrum theory, practices, rules and values in accordance with the chosen project approach (Agile, Kanban ). · - Organize the work within the team to opti ...
-
Ab Initio Systems Administrator
1 day ago
TransUnion Pune, IndiaTransUnion's Job Applicant Privacy Notice · **What We'll Bring**: · Dynamics of the Role · The Team's Focus · At Transunion, Abinitio is not used as just another ETL tool but an end to end data processing solution. We use the full Abinitio product suite across projects and set st ...
-
Citi Pune, IndiaAs a bank with a brain and a soul, Citi creates economic value that is systemically responsible and in our clients' best interests. As a financial institution that touches every region of the world and every sector that shapes your daily life, our **Enterprise Operations & Techno ...
-
Aep Architect
2 days ago
CRUTZ LEELA Shivaji Nagar, Pune, Maharashtra, India**AEP architect (Adobe Experience Platform Architect)** · Experience: 10+ Years · Work Model: Hybrid (Minimum 2 days from Client Office) · Client Office Locations: Noida, Gurgaon, Hyd, Bangalore, Pune, Nagpur, Chennai · **Job Description -** · - Strong Architect experience with A ...
-
Principal Snowflake Architect
4 days ago
Securonix Pune, India**Cloud Snowflake Search Engineer Job Description**: · - Securonix provides the Next-Generation Security and Information Event Management (SIEM) solution. As a recognized leader in the SIEM industry, Securonix helps some of the largest organizations globally to detect sophisticat ...
-
Associate - Projects
3 days ago
Cognizant Technology Solutions Pune, Maharashtra, India**Not Applicable** · **Qualification**: · **Post-grad in one of the following fields with strong academic credentials**: · - Computer Science/IT. · - Operations Research/Applied Math. · - Engineering. · - Statistics. · **Responsibility**: · **Business**: · - 'Works with the busin ...
-
UI Dev
1 day ago
Deutsche Bank Pune, Maharashtra, India**UI Dev**: · **Job ID**:R0317572**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Pune**Position Overview**: · **Job Title: Engineer UI** · **Corporate Title: Assistant Vice President** · **Location: Pune, India** · **Role Description** · The AFC ...
-
Data Scientist
4 days ago
Eaton Hadapsar, Pune, Maharashtra, India**What you'll do**: · If you desire to be part of something special, to be part of a winning team, to be part of a fun team - winning is fun. We are looking forward to** **Data Scientist** **based in **Pune, India**. In Eaton, making our work exciting, engaging, and meaningful; e ...
Senior Hadoop Engineer - Pune, India - HuQuo Consulting Pvt. Ltd.
Description
Job Description :
5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.
Programming background :
Role & Responsibilities: