- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka
- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.
- Able to quickly pick up new programming languages, technologies, and frameworks.
- Strong skills building positive relationships across Product and Engineering.
- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
- Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc.
- Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture
- Experience working with Data platforms, including EMR, Airflow, Data bricks (Data Engineering & Delta Lake components)
- Experience working in Agile and Scrum development process.
- Experience in EMR/ EC2, Data bricks etc.
- Experience working with Data warehousing tools, including SQL database, Presto, and Snowflake
- Experience architecting data product in Streaming, Server less and Microservices Architecture and platform.
-
Data Engineer
1 week ago
Allica Bank Bangalore Urban, IndiaAbout Allica Bank · Allica is the UK's fastest growing company - and the fastest-growing financial technology (fintech) firm ever. Our purpose is to help established SMEs, one of the last major underserved opportunities in fintech. Established SMEs are the backbone of local commu ...
-
Data Engineer
1 day ago
Nutrabay Bangalore/Anywhere in India/Multiple Locations permanentResponsibilities : · - Design and implement data pipelines for extracting, transforming, and loading data from various sources to our data warehouses and data lakes. · - Collaborate with data scientists and analysts to understand data requirements and ensure data quality and inte ...
-
Data Engineer
5 hours ago
Talhive HR Management LLP Bangalore/Anywhere in India/Multiple Locations permanentAbout Loopio : · Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. · Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our missi ...
-
Data Engineer
1 week ago
TransOrg Analytics Bangalore/Delhi NCR/Mumbai, India permanentRoles and Responsibilities : · 1. Design and implement data engineering projects. · 2. Integrate multiple data sources to create data lake/data mart Perform data ingestion and ETL processes using SQL, Scoop, Spark or Hive · 3. Knowledge of new components and various emerging tec ...
-
Data Engineer
1 week ago
Gethyr Bangalore/Pune, India permanentWe are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. · As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream process ...
-
Data Engineer
1 week ago
Cortex Consulting Pvt. Ltd. Bangalore/Chennai/Hyderabad, India permanentResponsibilities : · - Design, construct, install, test, and maintain highly scalable data management systems. · - Develop and implement ETL processes to collect, store, and process data from various sources. · - Build and optimize data pipelines for efficient data ingestion and ...
-
Data Engineer
1 week ago
USET Consulting Private Limited Bangalore, India permanentJob Description : · About the Role : · We are searching for a skilled Data Engineer to join our team and play a key role in managing our data transformation and integration pipelines. This role focuses on ensuring the smooth operation and optimization of our DBT, Airflow, and Pyt ...
-
Data Engineer
1 week ago
Change leaders Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, India permanentPrimary Skill : · GCP + Python + SQL · OR · - GCP + Java + SQL · NP : Immediate to 35 Days max · Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineer ...
-
Data Engineer
1 day ago
Ascendion Bangalore, India permanent: · We are currently seeking an experienced and skilled AWS Data Engineer to join our team. · In this role, you will be responsible for the design, development, and optimization of data solutions on the AWS platform. · The ideal candidate will have a strong background in data eng ...
-
Data Engineer
6 days ago
WIZSTAFFING PRIVATE LIMITED Bangalore, India permanentJob Description : · We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. · Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver ...
-
Data Engineer
1 week ago
Connectio IT Pvt Ltd Bangalore/Anywhere in India/Multiple Locations permanentThis is a full-time on-site role for a GCP Data Engineer. · As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. · Job Description : · - You will work closely with the developme ...
-
Data Engineer
1 week ago
CliqHR Bangalore, India permanentMandatory Skills : · Microsoft Azure, Pyspark, Data Bricks, Hadoop, Spark, Airflow, Kafka · Requirments : · - Experience working with distributed technology tools for developing Batch and Streaming pipelines using. · - SQL, Spark, Python, Airflow, ScalaKafka · Experience in Clou ...
-
Data Engineer
1 day ago
SKEP IT SYSTEMS Bangalore, India permanentRole : Data Engineer · Mobilution IT Systems is a pioneering organization at the forefront of technological innovation, specializing in cutting-edge Tech solutions. With a strong commitment to leveraging advanced technologies for scientific advancements, Mobilution IT Systems is ...
-
Data Engineer
1 week ago
Magna Hire Bangalore, India permanentResponsibilities : · Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards. · Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, an ...
-
Data Engineer
1 week ago
vipsa solutions Bangalore/Pune, India permanentSALARY : 15LPA - Engineer: · Location: Pune, Bangalore · Experience: 6-9 years · NP: Immediate- 15 days · Key accountabilities: · As a Data Engineer you will be accountable for: · - Understanding operational needs by collaborating with specialized teams · - Supporting key, involv ...
-
Data Engineer
6 days ago
Indium Software Bangalore/Hyderabad, India permanentJob Description: · We are seeking a talented and motivated Data Engineer to join our team. · The ideal candidate should have a strong background in SQL, Python, ETL, and data visualization, with experience working closely with stakeholders and providing data support to Data Analy ...
-
Data Engineer
1 day ago
Intelli Swift Bangalore, India permanentData Engineer - Bangalore (Hybrid) · Position : Data Engineer · Experience : 7-12 Years · Notice Period : less than 15-20 days · Mode of Hiring : Permanent · Work Location : Bangalore (Hybrid · Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. · Job ...
-
Data Engineer
4 days ago
Intuitive Apps Bangalore/Gurgaon/Gurugram, India permanentKey Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, Databricks · Job Description : · Create and maintain optimal data pipeline architecture · Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required. · - Design and devel ...
-
Data Engineer
1 week ago
CLOUD RAPTOR INDIA DIGITAL SERVICES Bangalore, India permanentAbout the job: · About us : · - At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries. · - Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital ...
-
Data Engineer
1 week ago
SKYGATE CONSULTING Bangalore/Gurgaon/Gurugram/Delhi NCR, India permanentData Engineer (Snowflake) · Job Description : · As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitc ...
Senior Data Engineer - Bangalore, India - CliqHR
Description
Job Description :
Mandatory Skills :
Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py spark
Requirements :