Azure Data Engineer - Bengaluru - Coffeee

    Coffeee
    Coffeee Bengaluru

    2 days ago

    ₹900,000 - ₹2,800,000 (INR) per year * Technology / Internet
    Description

    As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and processing systems. You will work closely with data scientists, analysts, and other stakeholders to ensure our data solutions are efficient, reliable, and scalable.

    Responsibilities:


    • Design, develop, and optimize ETL pipelines using PySpark and Databricks to process large-scale data on the Azure cloud platform.


    • Implement data ingestion processes from various data sources into Azure Data Lake and Azure SQL Data Warehouse.


    • Develop and maintain data models, data schemas, and data transformation logic tailored for Azure.


    • Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.


    • Ensure data quality and integrity through robust testing, validation, and monitoring procedures.


    • Optimize and tune PySpark jobs for performance and scalability within the Azure and Databricks environments.


    • Implement data governance and security best practices in Azure.


    • Monitor and troubleshoot data pipelines to ensure timely and reliable data delivery.


    • Document data engineering processes, workflows, and best practices specific to Azure and Databricks.

    Requirements:


    • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.


    • Proven experience as a Data Engineer with a strong focus on PySpark and Databricks.


    • Proficiency in Python and PySpark for data processing and analysis.


    • Strong experience with Azure data services, including Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, and Azure Databricks.


    • Strong SQL skills and experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).


    • Experience with big data technologies such as Hadoop, Spark, Hive, and Kafka.


    • Strong understanding of data architecture, data modeling, and data integration techniques.


    • Familiarity with Azure DevOps, version control systems (e.g., Git), and CI/CD pipelines.


    • Excellent problem-solving skills and attention to detail.


    • Strong communication and collaboration skills.

    Preferred Qualifications:


    • Experience with Delta Lake on Azure Databricks.


    • Knowledge of data visualization tools (e.g., Power BI, Tableau).


    • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).


    • Understanding of machine learning concepts and experience working with data scientists.

    * This salary range is an estimation made by beBee
  • Work in company

    Data Engineer

    Only for registered members

    Weiterhin suchen wir einen DevOps-Experten mit 7 bis 12 Jahren Erfahrung in relevanten Technologien, Konfiguration und Wartung von Kubernetes-Umgebungen einschließlich GitOps (ArgoCD), Ressourcen-Templating mit Helmcharts und Kustomize · ...

    Bengaluru

    3 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    Wir suchen einen DevOps-und Data Engineering Experten mit 7-12 Jahren Erfahrung. · Kubeflow Thingsboard Apache Superset Dremio usw. · ...

    Bengaluru, Karnataka

    3 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    Sviluppare pipeline dati utilizzando Python e SQL. · ...

    Bengaluru, Chennai, Hyderabad

    2 weeks ago

  • Work in company

    Data Engineer, IN Data Engineering

    Only for registered members

    +Job summary · A rock star Data/BI Engineer to build for pan Amazon India businesses. · +Responsibilities · Design, implement and support an data infrastructure for analytics needs of large organization,Interface with other technology teams to extract, transform, and load data fr ...

    Bengaluru Full time

    2 weeks ago

  • Work in company

    Data Engineer, IN Data Engineering

    Only for registered members

    The Amazon IN Platform Development team is looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · ...

    Bengaluru, Karnataka

    1 week ago

  • Work in company

    Data Engineer Data Engineer

    Only for registered members

    · At ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wellbeing and sustainability of our millions of customers. · ...

    Bengaluru Full time

    1 week ago

  • Work in company

    Data Engineer, IN Data Engineering

    Only for registered members

    Design and implement data infrastructure for analytics needs. · Interface with other teams to extract and load data from various sources using SQL and AWS technologies. · ...

    Bengaluru

    1 week ago

  • Work in company

    Data Engineer, IN Data Engineering

    Only for registered members

    Amazon IN Platform Development team is looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · ...

    Bengaluru

    2 weeks ago

  • Work in company

    Data Engineer, IN Data Engineering

    Only for registered members

    We are looking to hire a rock star Data/BI Engineer to build for pan Amazon India businesses. · The BI Engineer will play a key role in contributing to the success of each focus area by partnering with respective business owners and leveraging data to identify areas of improvemen ...

    Bengaluru, Karnataka

    1 week ago

  • Work in company

    Data Engineer for Data

    Only for registered members

    We invite you to join our digital transformation journey. In this role, you will have the opportunity to boost your skills and become the heart of an innovative engine that is contributing to global impact and improvement. · ...

    Bengaluru Full time

    1 week ago

  • Work in company

    Data Engineer, senior data engineer

    Only for registered members

    Data Engineer role involves participating in the software development lifecycle for enterprise data projects, designing & maintaining robust ETL processes & data pipelines using modern platforms. · ...

    Bengaluru, Hyderabad

    5 days ago

  • Work in company

    Data Engineer, Data Engineering Solutions

    Only for registered members

    We are experts in data working to make it cost-effective trustworthy and understandable. We build pipelines processing billions of events daily and are stewards of canonical data warehouses and datasets delivering products for Stripe Users while embedding with teams to build thei ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Data Engineer, Data Engineering Solutions

    Only for registered members

    Who we are · About Stripe · Stripe is a financial infrastructure platform for businesses.Millions of companies—at the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. · ...

    Bengaluru

    1 month ago

  • Work in company

    Data Engineer, Data Engineering Solutions

    Only for registered members

    We're looking for a manager to drive the Data Engineering Solutions Team in solving high-impact,cutting-edge data problems. · Deliver cutting-edge data pipelines that scale to users' needs,focusing on reliability and efficiency. · ...

    Bengaluru Full time

    1 month ago

  • Work in company

    Data Engineer/Senior Data Engineer

    Only for registered members

    Requirements · Job Title: Data Engineer – II / Senior Data Engineer · Job Location: Bengaluru, India · Job Summary: We are a leading Software as a Service (SaaS) company that specializes in the transformation of data in the US healthcare industry through cutting-edge Artificial I ...

    Bengaluru

    5 days ago

  • Work in company

    IT engineer Data Engineering

    Only for registered members

    Design/implement/maintain secure/scalable data ingestion pipelines. · Design/implement/maintain secure/scalable data ingestion pipelines. · ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for Data Engineer 8 + year of exp to build enterprise grade data product drive root cause insights understand data translate business needs into production ready solution for finance data office. · Profile data identify pattern build curated datasets drive root cau ...

    Bengaluru, Hyderabad ₹900,000 - ₹2,500,000 (INR) per year

    5 days ago

  • Work in company

    Data Engineer

    confidential

    Education: Bachelors Degree in Computer Science, Information Technology, or a related engineering field · Certification: Microsoft Certified Data Engineer Associate or Fabric Certified Associate · Job Summary: · We are looking for a highly motivated and technically proficient Dat ...

    Bengaluru / Bangalore $1,000,000 - $1,200,000 (USD) per year Full time

    4 days ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a Data Engineer to design and implement the analytics platform. · ...

    Bengaluru, Chennai, Mumbai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a skilled Data Analyst / Data Engineer with strong experience in SQL, · Google BigQuery and Python to support data-driven decision-making and scalable analytics solutions.Strong expertise in SQL (joins, window functions) · Hands-on experience with Google BigQue ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer · We are seeking a skilled and experienced Data Engineer with strong Python expertise, API development experience, and a deep understanding of containerized, CI/CD-driven workflows. · Design robust data pipelines using modern tools like pandas or Dask. · Build produ ...

    Bengaluru ₹900,000 - ₹2,500,000 (INR) per year

    4 days ago

Jobs
>
Azure data engineer
>
Jobs for Azure data engineer in Bengaluru