- GCP ETL
- Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python
- Knowledge of Big Data Architecture patterns and experience in delivery of BigData and Hadoop ecosystems.
- Strong experience in GCP with multiple large projects involving GCP Big Query and ETL.
- Experience in GCPbased Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, Airflow, Google Cloud Storage, Data Fusion, Data Flow, Dataproc, etc.
- Experience in SQL/Data Warehouse.
- Expertise in programming languages such as Java, Hadoop, Scala, Python, PySpark.
- Expertise in at least one distributed data processing framework like Spark (Core, streaming, SQL), Storm, or Flink, etc.
- Worked on any of Orchestration tools like Airflow, Oozie.
- Experience in performance tuning, optimization, and data security.
- Excellent understanding of the data technologies landscape/ecosystem.
- Exposure to development with CI/CD pipeline, knowledge of containerization orchestration, and KE engine would be an added advantage.
- Familiarity with the pros and cons of various database technologies like relational, BigQuery, columnar databases, NoSQL.
- Exposure to Data governance, catalog, lineage, and associated tools would be an added advantage.
- GCP PDE certification is a plus point.
-
Data Engineer
1 day ago
Rakuten India Bangalore Urban, IndiaAbout Rakuten: · Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engin ...
-
Data Engineer
1 week ago
Allica Bank Bangalore Urban, IndiaAbout Allica Bank · Allica is the UK's fastest growing company - and the fastest-growing financial technology (fintech) firm ever. Our purpose is to help established SMEs, one of the last major underserved opportunities in fintech. Established SMEs are the backbone of local commu ...
-
Data Engineer
1 week ago
Indium Software Bangalore/Hyderabad, India permanentJob Description: · We are seeking a talented and motivated Data Engineer to join our team. · The ideal candidate should have a strong background in SQL, Python, ETL, and data visualization, with experience working closely with stakeholders and providing data support to Data Analy ...
-
Data Engineer
1 day ago
Decathlon Sports India Bengaluru North, IndiaAbout Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthusiastic beginners as well as passionate professionals at extr ...
-
Data Engineer
3 days ago
SKEP IT SYSTEMS Bangalore, India permanentRole : Data Engineer · Mobilution IT Systems is a pioneering organization at the forefront of technological innovation, specializing in cutting-edge Tech solutions. With a strong commitment to leveraging advanced technologies for scientific advancements, Mobilution IT Systems is ...
-
Data Engineer
3 days ago
Mobile Programming Bangalore, India permanentSalary LPA · Python Data Engineer · Job Description : · - Design, develop, and maintain database scripts and procedures to support application requirements. · - Collaborate with software developers to integrate database scripts with application code. · - Troubleshoot and resolve ...
-
Data Engineer
3 days ago
Top Talent Technologies Private Limited Bangalore, India permanentRequirements : · Will likely have a degree in Computer Science, Statistics, Informatics, Information Technology, or quantitative field. · Microsoft Azure Synapse Analytics experience is essential. (Dedicated SQL Pool, Azure Data Factory, Azure Storage) · Excellent communication ...
-
Data Engineer
3 days ago
Ascendion Bangalore, India permanent: · We are currently seeking an experienced and skilled AWS Data Engineer to join our team. · In this role, you will be responsible for the design, development, and optimization of data solutions on the AWS platform. · The ideal candidate will have a strong background in data eng ...
-
Data Engineer
1 week ago
WIZSTAFFING PRIVATE LIMITED Bangalore, India permanentJob Description : · We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. · Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver ...
-
Data Engineer
2 days ago
Talhive HR Management LLP Bangalore/Anywhere in India/Multiple Locations permanentAbout Loopio : · Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. · Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our missi ...
-
Data Engineer
3 days ago
Nutrabay Bangalore/Anywhere in India/Multiple Locations permanentResponsibilities : · - Design and implement data pipelines for extracting, transforming, and loading data from various sources to our data warehouses and data lakes. · - Collaborate with data scientists and analysts to understand data requirements and ensure data quality and inte ...
-
Data Engineer
6 days ago
Intuitive Apps Bangalore/Gurgaon/Gurugram, India permanentKey Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, Databricks · Job Description : · Create and maintain optimal data pipeline architecture · Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required. · - Design and devel ...
-
Data Engineer
3 days ago
Winning Edge Bangalore, India permanentJob Description : · Required skillset : · - 5+ year's hands-on experience with AWS services, AWS Cloudformation(CFT), CI/CD, AWS CodePipeline, CodeBuild, databases and related technologies. · - Understands business requirements and effectively translates business needs and proce ...
-
Data Engineer
1 week ago
CLOUD RAPTOR INDIA DIGITAL SERVICES Bangalore, India permanentAbout the job: · About us : · - At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries. · - Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital ...
-
Data Engineer
1 week ago
promaynov Advisory Services Bangalore, India permanentLocation : Bangalore · Notice Period : Immediate to 30 Days · Experience : 5 to 8 Years · Duties : · Strong analytical and problem-solving skills paired with the ability to develop creative and efficient solutions; tolerance in dealing with bad quality data. · Distinct customer ...
-
Data Engineer
3 days ago
Intelli Swift Bangalore, India permanentData Engineer - Bangalore (Hybrid) · Position : Data Engineer · Experience : 7-12 Years · Notice Period : less than 15-20 days · Mode of Hiring : Permanent · Work Location : Bangalore (Hybrid · Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. · Job ...
-
Data Engineer
1 week ago
CliqHR Bangalore, India permanentMandatory Skills : · Microsoft Azure, Pyspark, Data Bricks, Hadoop, Spark, Airflow, Kafka · Requirments : · - Experience working with distributed technology tools for developing Batch and Streaming pipelines using. · - SQL, Spark, Python, Airflow, ScalaKafka · Experience in Clou ...
-
Data Engineer
3 days ago
Zyoin group Bangalore, India permanentResponsibilities : · - Account for the overall management of Data and Analytics projects; including timeliness, quality, and client value. · - QA/QC data and report output to ensure accuracy. · - Assist with the development of innovative plans for addressing key areas of data man ...
-
Data Engineer
3 days ago
Talent500 Bangalore, India permanentResponsibilities for Data Engineer: · - Create and maintain optimal data pipeline architecture,. · - Assemble large, complex data sets that meet functional / non-functional business requirements. · - Identify, design, and implement internal process improvements: automating manual ...
-
Data Engineer
2 days ago
Nilasu consulting Bangalore/Hyderabad/Chennai/Pune, India permanentResponsibilities: · - Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake. · - Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API ...
Senior GCP Big Data Engineer - Bangalore, India - Notus
Description
Job Title :
GCP (Google Cloud Platform) Specialist
Number of Positions : 6 (1 Senior Role, 5 Lead Roles)
Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PM
Location :
TechM India locations
Notice Period :
Early/Immediate/30 days (Positions need to be filled by May)
Budget :
Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.
Lead Role : 6+ years of experience - Depending upon hike % and candidate sharing offer in hand proof during approval stage.
Skillset :
Mandatory Requirements :
Preferred Experience and Knowledge :