- Programming background
- Mandatory
- Scala, Spark and Java / Python
- Experience in following technologies
- MapReduce, HDFS, YARN, Spark Streaming.
- Experience in creating e2e pipelines in Hadoop.
- Experience in SQL, Hive and NoSQL databases
- Experience in Linux / Unix platform
- Experience of cloud design patterns
- Experience in Jenkins, GitHub, Debugging the code, and error handling.
- Experience in Building end to end ETL Pipelines
- Selfstarter & resourceful personality with the ability to manage pressure situations.
- Experience working with geographically distributed teams.
- Work on high level business and technical problems, contribute to architectural decisions.
- Create the core framework/ templates that gives a starting point for the team members to get started with implementation/ execution.
- Build Data and ETL pipelines in Hadoop.
- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python
- Interact with customers daily to ensure smooth engagement.
- Exposure to GCP
- Responsible for timely and quality deliveries.
- Exposure to Scrum and Agile Development best practices
- Fulfil organization responsibilities
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Coditas Pune, IndiaWe are looking for data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space. A passion for shipping high-quality data products, interest in the data products space; curiosity about the b ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
ACS International India Pvt. Ltd. (ACSII) Pune, IndiaACS-I India is looking for a 5+ years experienced Data Engineer who will support a rapidly growing Business Data & Analytic Platform focused on providing data product solutions that empower our core business users to turn data into actionable insights. The data engineer will work ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
PeopleLogic Pune, IndiaCompany Profile · We are hiring for a multi-national company providing IT services. It provides software and consultancy services in different industries like Finance, Education, Insurance, Retail, Energy, Life Science, and Healthcare. · Experience Range : 10-15 · Desired Compet ...
-
Data Engineer
Found in: Talent IN 2A C2 - 4 days ago
Nilasu consulting Bangalore/Hyderabad/Chennai/Pune, India permanentResponsibilities: · - Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake. · - Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API ...
-
Data Engineer
Found in: Talent IN 2A C2 - 6 days ago
Perficient Pune, IndiaJob Description: Data Engineer · Experience Total: 4- 7 · Location: Pune · Qualification: · Advanced working SQL knowledge and performance tuning · Good knowledge of Relational Model, Dimensional Data Modelling, Data Warehouse · Experience working with relational databases, fo ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
TMF Group Pune, IndiaAbout TMF Group · TMF Group is a leading provider of critical administrative services, helping clients invest and operate safely around the world. Our 10,000 experts and 120 offices in 85 jurisdictions worldwide serve corporates, financial institutions, asset managers, private cl ...
-
Data Engineer
Found in: Talent IN 2A C2 - 1 day ago
Tech Mahindra Pune, IndiaGCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage, · Strong python programming experience in using Google Cloud python client libraries, · Strong SQL and data analysis skills, · Proficient ETL/ELT experience in workflows, data modelling and data pipeli ...
-
Data Engineer
Found in: Appcast Linkedin IN C2 - 1 day ago
Tech Mahindra Pune, IndiaTitle: Reltio GCP Data Engineer · Location: Pune · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable ...
-
Data Engineer
Found in: Talent IN 2A C2 - 4 days ago
Talentoj Hyderabad/Pune/Ahmedabad, India permanentAzure Data Engineer : · We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required. · The ideal can ...
-
Data Engineer
Found in: Talent IN 2A C2 - 4 days ago
ADVANSOFT Pune/Bangalore/Chennai, India permanentSkills : · - Hadoop · - Python · - Spark · - PySpark · - ETL (Extract, Transform, Load) · Roles & Responsibilities : · - Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem. · - Data Processing: Utilize Python ...
-
Data Engineer
Found in: Talent IN 2A C2 - 9 hours ago
PeopleLogic Pune, IndiaCompany ProfileWe are hiring for a multi-national company providing IT services. It provides software and consultancy services in different industries like Finance, Education, Insurance, Retail, Energy, Life Science, and Healthcare.Experience Range : 10-15Desired Competencies Mus ...
-
Data Engineer
Found in: Talent IN 2A C2 - 4 days ago
Huquo Pune/Hyderabad, India permanentMust-Have : · - 4+ years of experience in Data Engineering experience on Azure and Databricks · - Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required · - Experience Developing and tuning Spark Application and SparkSQL queries- · - Expertise t ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Promaynaov Advisory Services Pvt Ltd Pune, IndiaRole : Data Engineer · Location : Pune/Hyderabad · In this role, you will : · Principal Responsibilities : · As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects o ...
-
Data Engineer
Found in: Appcast Linkedin IN C2 - 3 days ago
Atyeti Inc Pune, IndiaDesignation: Data Engineer · Experience: 5+Years · Location: Pune · Skills: GCP / AWS, Python, Spark, Hive, Hadoop and Big Data · Bachelor's degree in computer science, information systems, or other related field or equivalent work experience. · 5+ years of high-tech industry int ...
-
Data Engineer
Found in: Talent IN 2A C2 - 9 hours ago
Mindpool Technologies Pune, IndiaMindpool Technology is hiring for Data Engineer for Pune Location · Job Description Our Technical team is looking for a Data Engineer to part of EDWBI platform team to help build Data Validation framework and related validation reports leveraging existing EDWBI platform along wit ...
-
Data Engineer
Found in: Talent IN 2A C2 - 5 days ago
ACS International India Pvt. Ltd. (ACSII) Pune, IndiaACS-I India is looking for an 8+ years experienced Data Engineer with data modeling experience who will support a rapidly growing Business Data & Analytic Platform focused on providing data product solutions that empower our core business users to turn data into actionable insigh ...
-
Data Engineer
Found in: Appcast Linkedin IN C2 - 4 days ago
Sigmaways Inc Pune, IndiaThis position is a Hybrid Role candidate should be 2 days onsite in Pune Office ( Prefer Local candidates). · Position : Data Engineer · Type : Long Term Contract Role · Location : Pune / Hybrid · Job Description: · This position is for Data warehouse group . · This position is a ...
-
Data Engineer
Found in: Talent IN 2A C2 - 9 hours ago
Virtusa Pune, IndiaData Engineer - CREQ184791 Description 8-10years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real t ...
-
Data Engineer
Found in: Betterteam US S2 T2 - 1 week ago
Mindpool Technologies Pune, India Full timeMindpool Technology is hiring for Data Engineer for Pune Location · Job DescriptionOur Technical team is looking for a Data Engineer to part of EDWBI platform team to help build Data Validation framework and related validation reports leveraging existing EDWBI platform along with ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
vipsa solutions Bangalore/Pune, India permanentSALARY : 15LPA - Engineer: · Location: Pune, Bangalore · Experience: 6-9 years · NP: Immediate- 15 days · Key accountabilities: · As a Data Engineer you will be accountable for: · - Understanding operational needs by collaborating with specialized teams · - Supporting key, involv ...
Big Data Engineer/Manager - Pune, India - Huquo
Description
Job Description :
Must Have :
Tech savvy engineer - willing and able to learn new skills, track industry trend.
years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.
Role & Responsibilities :
)