- Data Pipeline Design & Implementation: Design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL) using technologies such as Pyspark, Scala, and relevant big data frameworks.
- Data Governance & Optimization: Govern and optimize data pipelines to ensure high reliability, efficiency, and data quality across on-premise and cloud environments.
- Cross-functional Collaboration: Collaborate closely with data scientists, ML engineers, and business stakeholders to understand data requirements and translate them into robust technical solutions.
- Best Practices & Compliance: Implement best practices for data governance, metadata management, and compliance with regulatory requirements.
- Team Leadership: Lead a team of data engineers, providing technical guidance, mentorship, and fostering a culture of innovation and collaboration.
- Continuous Improvement: Stay updated with industry trends and advancements in big data technologies, contributing to the continuous improvement of data engineering practices.
- Strong experience in data engineering with hands-on experience in designing and implementing data pipelines.
- Strong proficiency in programming languages such as Pyspark and Scala, with experience in big data technologies (Cloudera, Hadoop ecosystem).
- Proven leadership experience in managing and mentoring a team of data engineers.
- Excellent communication skills with the ability to collaborate effectively across teams and stakeholders.
- Experience working in a banking or financial services environment is a plus.
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field, or equivalent practical experience.
-
Wir suchen einen DevOps-und Data Engineering Experten mit 7-12 Jahren Erfahrung. · Kubeflow Thingsboard Apache Superset Dremio usw. · ...
Bengaluru, Karnataka3 weeks ago
-
Weiterhin suchen wir einen DevOps-Experten mit 7 bis 12 Jahren Erfahrung in relevanten Technologien, Konfiguration und Wartung von Kubernetes-Umgebungen einschließlich GitOps (ArgoCD), Ressourcen-Templating mit Helmcharts und Kustomize · ...
Bengaluru3 weeks ago
-
Sviluppare pipeline dati utilizzando Python e SQL. · ...
Bengaluru, Chennai, Hyderabad3 weeks ago
-
The Amazon IN Platform Development team is looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · ...
Bengaluru, Karnataka2 weeks ago
-
Design and implement data infrastructure for analytics needs. · Interface with other teams to extract and load data from various sources using SQL and AWS technologies. · ...
Bengaluru1 week ago
-
Amazon IN Platform Development team is looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · ...
Bengaluru2 weeks ago
-
We are looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · The BI Engineer will play a key role in contributing to the success of each focus area by partnering with respective business owners and leveraging data to identify areas of improvemen ...
Bengaluru, Karnataka2 weeks ago
-
· At ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wellbeing and sustainability of our millions of customers. · ...
Bengaluru Full time1 week ago
-
+Job summary · A rock star Data/BI Engineer to build for pan Amazon India businesses. · +Responsibilities · Design, implement and support an data infrastructure for analytics needs of large organization,Interface with other technology teams to extract, transform, and load data fr ...
Bengaluru Full time2 weeks ago
-
Safran est un groupe international de haute technologie opérant dans les domaines de l'aéronautique (propulsion, équipements et intérieurs), de l'espace et de la défense. · ...
Bengaluru, Karnataka ₹10 - ₹15 (INR) per year1 week ago
-
Le rôle consiste à concevoir et mettre en œuvre des solutions de lac de données et lakehouse scalables sur AWS pour les teas & analytics workloads. · AWS Core Services : S3, Lambda, DynamoDB, · RDS (PostgreSQL), API Gateway, CloudFormation, · CloudWatch. · Data Engineering Tools ...
Bengaluru1 week ago
-
We invite you to join our digital transformation journey. In this role, you will have the opportunity to boost your skills and become the heart of an innovative engine that is contributing to global impact and improvement. · ...
Bengaluru Full time2 weeks ago
-
Data Engineer role involves participating in the software development lifecycle for enterprise data projects, designing & maintaining robust ETL processes & data pipelines using modern platforms. · ...
Bengaluru, Hyderabad1 week ago
-
We are experts in data working to make it cost-effective trustworthy and understandable. We build pipelines processing billions of events daily and are stewards of canonical data warehouses and datasets delivering products for Stripe Users while embedding with teams to build thei ...
Bengaluru, Karnataka1 month ago
-
· Company Description · Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the ...
Bengaluru, India14 hours ago
-
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be pa ...
Bengaluru, Karnataka ₹900,000 - ₹1,200,000 (INR) per year13 hours ago
-
Requirements · Job Title: Data Engineer – II / Senior Data Engineer · Job Location: Bengaluru, India · Job Summary: We are a leading Software as a Service (SaaS) company that specializes in the transformation of data in the US healthcare industry through cutting-edge Artificial I ...
Bengaluru1 week ago
-
· Company Description · Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the ...
Bengaluru ₹900,000 - ₹1,200,000 (INR) per year Full time1 day ago
-
We're looking for a manager to drive the Data Engineering Solutions Team in solving high-impact,cutting-edge data problems. · Deliver cutting-edge data pipelines that scale to users' needs,focusing on reliability and efficiency. · ...
Bengaluru Full time1 month ago
-
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be pa ...
Bengaluru1 day ago
-
Who we are · About Stripe · Stripe is a financial infrastructure platform for businesses.Millions of companies—at the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. · ...
Bengaluru1 month ago
Data Engineer - Bengaluru / Bangalore - Skillventory
Description
We are seeking a Data Engineer to design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL). You will be responsible for governing and optimizing these pipelines to ensure high reliability and data quality across both on-premise and cloud environments. This role requires strong proficiency in Pyspark and Scala, experience with big data technologies, and proven leadership skills to guide a team of data engineers.
Roles & Responsibilities:
Skills Required:
QUALIFICATION:
-
Data Engineer
Only for registered members Bengaluru, Karnataka
-
Data Engineer
Only for registered members Bengaluru
-
Data Engineer
Only for registered members Bengaluru, Chennai, Hyderabad
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru, Karnataka
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru, Karnataka
-
Data Engineer Data Engineer
Full time Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Full time Only for registered members Bengaluru
-
Senior Data Engineer
Only for registered members Bengaluru, Karnataka
-
Senior Data Engineer
Only for registered members Bengaluru
-
Data Engineer for Data
Full time Only for registered members Bengaluru
-
Data Engineer, senior data engineer
Only for registered members Bengaluru, Hyderabad
-
Data Engineer, Data Engineering Solutions
Only for registered members Bengaluru, Karnataka
-
Staff Data Engineer, Data Engineering
Only for registered members Bengaluru, India
-
Staff Data Engineer, Data Engineering
Only for registered members Bengaluru, Karnataka
-
Data Engineer/Senior Data Engineer
Only for registered members Bengaluru
-
Staff Data Engineer, Data Engineering
Full time Only for registered members Bengaluru
-
Data Engineer, Data Engineering Solutions
Full time Only for registered members Bengaluru
-
Staff Data Engineer, Data Engineering
Only for registered members Bengaluru
-
Data Engineer, Data Engineering Solutions
Only for registered members Bengaluru
