- Automate data tasks on GCP.
- Work with data domain owners, data scientists and other stakeholders to that data is consumed effectively on GCP.
- Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP.
- Measure and monitor the quality of data on GCP data platforms.
- Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to incidents promptly to minimize downtime and data loss.
- Develop automation scripts and tools to streamline data operations and make them scalable to ensure accommodate growing data volumes and user traffic.
- Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance.
- Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements.
- Ensure data security and compliance with data protection regulations. Implement best practices for data access controls and encryption.
- Collaborate with data engineers, data scientists, and software engineers to understand data requirements, troubleshoot issues, and support data-driven initiatives.
- Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance.
- Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures.
- Bachelor's or master's degree in computer science, Software Engineering, Data Science or related field, or equivalent practical experience
- Proficiency in data technologies, such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).
- Strong programming skills in languages like Python (numpy, pandas, pyspark), Java (Core Java, Spark with Java, functional interface, lambda, java collections), or Scala, with experience in automation and scripting.
- Experience with containerization and orchestration tools like Docker and Kubernetes is a plus.
- Experience with data governance(data plex), data security, and compliance best practices on GCP.
- Solid understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines.
- Strong background in cloud computing and data-Intensive applications and services, with a focus on Google Cloud Platform.
- Experience with data quality assurance and testing on GCP.
- Proficiency with GCP data services (BigQuery; Dataflow; Data Fusion; Dataproc; Cloud Composer; Pub/Sub; Google Cloud Storage).
- Strong understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc.
- Knowledge of AI and ML tools is a plus.
- Google Associate Cloud Engineer or Data Engineer certification is a plus.
- Experience in data engineering or data science on GCP.
-
HD Map Data Collector Dev Engineer
3 weeks ago
Mercedes-Benz bangalore, IndiaTätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:InfotainmentGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:sofortVeröffentlichungsdatum:..4Stellennummer:MERV J ...
-
Data Engineer-1
4 weeks ago
Kyndryl Bengaluru, Karnataka, IndiaWho We Are · At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inc ...
-
Data Engineering
2 weeks ago
NR Consulting - India Bengaluru, India Full timeRole: Data Engineer · Location: Bangalore · Exp: 5+ years · JD · Mandatory Skills: Data Engineer, Scala, Spark, Hadoop " Senior Data Engineer JD: " Proven experience as a data engineer, with at least 5 years of experience in a similar role. " Good hands-on experience in ...
-
Data Engineer
2 weeks ago
Ericsson Bengaluru, IndiaDescription · Join our Team · About this opportunity: · We are seeking a talented and dedicated Data Engineer to join our team at Ericsson. The successful candidate will be responsible for developing and delivering data solutions to fulfill our business needs and specification ...
-
Data Engineer
3 weeks ago
Novo Nordisk bangalore, IndiaJob Description: · As Data engineer, you will have the opportunity: - · Applying strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You will have to work in a fast-paced environment. · You are responsi ...
-
Data Engineer
3 weeks ago
ADCI - Karnataka bangalore, IndiaAmazon Prime team is building an evergreen platform that will provide real time insights of traffic, sales, deals, prime engagement and is looking for rock start data engineer to build this. At Amazon Prime, understanding customer data is paramount to our success in providing cus ...
-
Data Engineer
1 week ago
Australia and New Zealand Banking Group Limited (ANZ) Bengaluru, IndiaData Engineer · Data Engineer · Req ID: Department: AR Strategic Delivery Australia Data Division: Australia Retail Location: Bangalore About Us · At ANZ, we're applying new ways technology and data can be harnessed as we work towards a common goal: to improve the financial wel ...
-
Data Engineer
2 weeks ago
Virtusa Bengaluru, IndiaData Engineer - CREQ190565 Description Job Description · Skill: Data Engineer · Role: T2, T1 · Key responsibility: · Data Engineer · Solid understanding and working with big data and associated concerns (data governance, scalability, security, observability, reliability, et ...
-
Data Engineer
3 weeks ago
Joveo bangalore, IndiaRole: Data Engineer · Location: Hybrid (Bangalore/Hyderabad) · About Joveo · Joveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus ...
-
Data Engineer
2 weeks ago
Huquo Bengaluru, India Full timeRole and Responsibilities : · - Liaise with different client stakeholders on ad-hoc analyses related to monitoring the entire data lake · - Build ETL & data pipelines to help feed the data into different business facing data products/dashboards · - Explore options to automate pro ...
-
Data Engineer
3 weeks ago
Ericsson Bengaluru, IndiaDescription · Join our Team · About this opportunity: · We are seeking a talented and dedicated Data Engineer to join our team at Ericsson. The successful candidate will be responsible for developing and delivering data solutions to fulfill our business needs and specification ...
-
Data Engineer
2 weeks ago
G2 Bengaluru, India· About The Role · G2 is looking for a Data Engineer - II, you will lead the design, development and maintenance of complex data engineering projects and pipelines for the G2 data platform. You'll lead and contribute significantly to complex data engineering projects and the imp ...
-
Data Engineer
1 week ago
The Nielsen Company Bengaluru, India Full timeAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embar ...
-
Data Engineer
3 weeks ago
WIZSTAFFING PRIVATE LIMITED bangalore, India permanentJob Description : · We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer. · Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to delive ...
-
Data Engineer
3 weeks ago
Evnek Technologies Pvt Ltd bangalore, IndiaJob Description · This is a remote position. · Role: Data Engineer · Experience: 2+Years · Notice period: Immediate · Location: Anywhere from India · Job Type: Full Time · Responsibilities: · Designing & building data architectures including the design & set-up of scalabl ...
-
Data Engineer
3 weeks ago
vipsa solutions bangalore, IndiaSALARY : 15LPA - Engineer: · Location: Pune, Bangalore · Experience: 6-9 years · NP: Immediate- 15 days · Key accountabilities: · As a Data Engineer you will be accountable for: · - Understanding operational needs by collaborating with specialized teams · - Supporting key, inv ...
-
Data Engineer
3 weeks ago
Alstom bangalore, India Req ID:418339 · Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated syst ...
-
Data Engineer
3 weeks ago
Datafoundry Bengaluru, IndiaPosition: Data Engineer · Experience: 4-10 years · Location – Bangalore / Hyderabad / Visakhapatnam · Work Mode – On-site / Work from office (5 working days) · About Datafoundry AI: · At Datafoundry AI, we're a passionate group of data scientists, product and ML engineers, and do ...
-
Data Engineer
3 weeks ago
Indium Software bangalore, India permanentJob Description: · We are seeking a talented and motivated Data Engineer to join our team. · The ideal candidate should have a strong background in SQL, Python, ETL, and data visualization, with experience working closely with stakeholders and providing data support to Data Analy ...
-
Data Engineer
3 weeks ago
Snaphunt bangalore, IndiaThe Offer · Flexible working options · Work in a company with a solid track record of performance · Leadership Role · The Job · You will be responsible for : · Leading a team of engineers to deliver winning products. · Ensuring the development of well-designed and testa ...
Data Engineer - bangalore, India - Genpact
Description
Inviting applications for the role of Principal Consultant-Senior Data Engineer
Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitoring for data pipelines, and automating repetitive data-oriented tasks.
Responsibilities
Qualifications we seek in you
Minimum Qualifications / Skills
Preferred Qualifications/ Skills