-
Weiterhin suchen wir einen DevOps-Experten mit 7 bis 12 Jahren Erfahrung in relevanten Technologien, Konfiguration und Wartung von Kubernetes-Umgebungen einschließlich GitOps (ArgoCD), Ressourcen-Templating mit Helmcharts und Kustomize · ...
Bengaluru3 weeks ago
-
Wir suchen einen DevOps-und Data Engineering Experten mit 7-12 Jahren Erfahrung. · Kubeflow Thingsboard Apache Superset Dremio usw. · ...
Bengaluru, Karnataka3 weeks ago
-
Sviluppare pipeline dati utilizzando Python e SQL. · ...
Bengaluru, Chennai, Hyderabad2 weeks ago
-
+Job summary · A rock star Data/BI Engineer to build for pan Amazon India businesses. · +Responsibilities · Design, implement and support an data infrastructure for analytics needs of large organization,Interface with other technology teams to extract, transform, and load data fr ...
Bengaluru Full time2 weeks ago
-
The Amazon IN Platform Development team is looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · ...
Bengaluru, Karnataka1 week ago
-
· At ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wellbeing and sustainability of our millions of customers. · ...
Bengaluru Full time1 week ago
-
Design and implement data infrastructure for analytics needs. · Interface with other teams to extract and load data from various sources using SQL and AWS technologies. · ...
Bengaluru1 week ago
-
Amazon IN Platform Development team is looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · ...
Bengaluru2 weeks ago
-
We are looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · The BI Engineer will play a key role in contributing to the success of each focus area by partnering with respective business owners and leveraging data to identify areas of improvemen ...
Bengaluru, Karnataka1 week ago
-
We invite you to join our digital transformation journey. In this role, you will have the opportunity to boost your skills and become the heart of an innovative engine that is contributing to global impact and improvement. · ...
Bengaluru Full time1 week ago
-
Data Engineer role involves participating in the software development lifecycle for enterprise data projects, designing & maintaining robust ETL processes & data pipelines using modern platforms. · ...
Bengaluru, Hyderabad5 days ago
-
We are experts in data working to make it cost-effective trustworthy and understandable. We build pipelines processing billions of events daily and are stewards of canonical data warehouses and datasets delivering products for Stripe Users while embedding with teams to build thei ...
Bengaluru, Karnataka1 month ago
-
Who we are · About Stripe · Stripe is a financial infrastructure platform for businesses.Millions of companies—at the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. · ...
Bengaluru1 month ago
-
We're looking for a manager to drive the Data Engineering Solutions Team in solving high-impact,cutting-edge data problems. · Deliver cutting-edge data pipelines that scale to users' needs,focusing on reliability and efficiency. · ...
Bengaluru Full time1 month ago
-
Requirements · Job Title: Data Engineer – II / Senior Data Engineer · Job Location: Bengaluru, India · Job Summary: We are a leading Software as a Service (SaaS) company that specializes in the transformation of data in the US healthcare industry through cutting-edge Artificial I ...
Bengaluru5 days ago
-
Design/implement/maintain secure/scalable data ingestion pipelines. · Design/implement/maintain secure/scalable data ingestion pipelines. · ...
Bengaluru, Karnataka1 month ago
-
We are looking for Data Engineer 8 + year of exp to build enterprise grade data product drive root cause insights understand data translate business needs into production ready solution for finance data office. · Profile data identify pattern build curated datasets drive root cau ...
Bengaluru, Hyderabad ₹900,000 - ₹2,500,000 (INR) per year5 days ago
-
Education: Bachelors Degree in Computer Science, Information Technology, or a related engineering field · Certification: Microsoft Certified Data Engineer Associate or Fabric Certified Associate · Job Summary: · We are looking for a highly motivated and technically proficient Dat ...
Bengaluru / Bangalore $1,000,000 - $1,200,000 (USD) per year Full time4 days ago
-
We are looking for a Data Engineer to design and implement the analytics platform. · ...
Bengaluru, Chennai, Mumbai1 month ago
-
We are looking for a skilled Data Analyst / Data Engineer with strong experience in SQL, · Google BigQuery and Python to support data-driven decision-making and scalable analytics solutions.Strong expertise in SQL (joins, window functions) · Hands-on experience with Google BigQue ...
Bengaluru, Karnataka1 month ago
-
Data Engineer · We are seeking a skilled and experienced Data Engineer with strong Python expertise, API development experience, and a deep understanding of containerized, CI/CD-driven workflows. · Design robust data pipelines using modern tools like pandas or Dask. · Build produ ...
Bengaluru ₹900,000 - ₹2,500,000 (INR) per year4 days ago
Azure Data Engineer - Bengaluru - Coffeee
Description
As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and processing systems. You will work closely with data scientists, analysts, and other stakeholders to ensure our data solutions are efficient, reliable, and scalable.
Responsibilities:
• Design, develop, and optimize ETL pipelines using PySpark and Databricks to process large-scale data on the Azure cloud platform.
• Implement data ingestion processes from various data sources into Azure Data Lake and Azure SQL Data Warehouse.
• Develop and maintain data models, data schemas, and data transformation logic tailored for Azure.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
• Ensure data quality and integrity through robust testing, validation, and monitoring procedures.
• Optimize and tune PySpark jobs for performance and scalability within the Azure and Databricks environments.
• Implement data governance and security best practices in Azure.
• Monitor and troubleshoot data pipelines to ensure timely and reliable data delivery.
• Document data engineering processes, workflows, and best practices specific to Azure and Databricks.
Requirements:
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer with a strong focus on PySpark and Databricks.
• Proficiency in Python and PySpark for data processing and analysis.
• Strong experience with Azure data services, including Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, and Azure Databricks.
• Strong SQL skills and experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Experience with big data technologies such as Hadoop, Spark, Hive, and Kafka.
• Strong understanding of data architecture, data modeling, and data integration techniques.
• Familiarity with Azure DevOps, version control systems (e.g., Git), and CI/CD pipelines.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
Preferred Qualifications:
• Experience with Delta Lake on Azure Databricks.
• Knowledge of data visualization tools (e.g., Power BI, Tableau).
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Understanding of machine learning concepts and experience working with data scientists.
-
Data Engineer
Only for registered members Bengaluru
-
Data Engineer
Only for registered members Bengaluru, Karnataka
-
Data Engineer
Only for registered members Bengaluru, Chennai, Hyderabad
-
Data Engineer, IN Data Engineering
Full time Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru, Karnataka
-
Data Engineer Data Engineer
Full time Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru
-
Data Engineer, IN Data Engineering
Only for registered members Bengaluru, Karnataka
-
Data Engineer for Data
Full time Only for registered members Bengaluru
-
Data Engineer, senior data engineer
Only for registered members Bengaluru, Hyderabad
-
Data Engineer, Data Engineering Solutions
Only for registered members Bengaluru, Karnataka
-
Data Engineer, Data Engineering Solutions
Only for registered members Bengaluru
-
Data Engineer, Data Engineering Solutions
Full time Only for registered members Bengaluru
-
Data Engineer/Senior Data Engineer
Only for registered members Bengaluru
-
IT engineer Data Engineering
Only for registered members Bengaluru, Karnataka
-
Data Engineer
Only for registered members Bengaluru, Hyderabad
-
Data Engineer
Full time confidential- Bengaluru / Bangalore
-
Data Engineer
Only for registered members Bengaluru, Chennai, Mumbai
-
Data Engineer
Only for registered members Bengaluru, Karnataka
-
Data Engineer
Only for registered members Bengaluru
