- Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Storage Transfer Service, Cloud Data Fusion, Pub/Sub, Data flow, Cloud compression, Cloud scheduler, Gutil, FTP/SFTP, Dataproc, BigTable etc.
- Build ETL pipelines to ingest the data from heterogeneous sources into our system
- Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data
- Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets
- Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements
- Collaborate with cross-functional teams to understand data requirements and design scalable solutions that meet business needs.
- Implement security measures and data governance policies to ensure the integrity and confidentiality of data.
- Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure.
- Work with data scientists and analysts to integrate machine learning models into data pipelines for predictive analytics.
- Troubleshoot and resolve issues related to data processing, storage, and retrieval.
- Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Storage Transfer Service, Cloud Data Fusion, Pub/Sub, Data flow, Cloud compression, Cloud scheduler, Gutil, FTP/SFTP, Dataproc, BigTable etc.
- Build ETL pipelines to ingest the data from heterogeneous sources into our system
- Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data
- Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets
- Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements
- Collaborate with cross-functional teams to understand data requirements and design scalable solutions that meet business needs.
- Implement security measures and data governance policies to ensure the integrity and confidentiality of data.
- Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure.
- Work with data scientists and analysts to integrate machine learning models into data pipelines for predictive analytics.
- Troubleshoot and resolve issues related to data processing, storage, and retrieval.
- Stay updated on industry best practices and emerging technologies within the GCP ecosystem for continuous improvement of data engineering processes.
- Collaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives.
- Design and implement scalable, fault-tolerant solutions for data ingestion, processing, and storage.
- Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance.
- Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments.
- Collaborate with DevOps teams to automate infrastructure provisioning and management tasks.
- Optimize and tune database queries and indexing strategies for improved query performance.
- Stay abreast of advancements in GCP services and incorporate relevant technologies into data engineering solutions.
- Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment.
- Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems.
-
Data Architect
3 weeks ago
Virtusa Chennai, India**Job Title-** · **Data Architect** · **Tier-T1** · Role Summary: · Key Responsibilities: · Design, create, and maintain optimal data pipeline architecture. · Assemble large, complex data sets that meet functional and non-functional business requirements. · Identify, design, and ...
-
Data Architect
2 weeks ago
iXceed Solutions Chennai, India**Job Title**:Data Architect · **Job Location**:WFH from India · **Job Mode**: Remote (need to follow Europe Time zone) · Primarily experts of **Spark 3.X, SCALA,** Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise. Any exper ...
-
Data Architect
2 weeks ago
Virtusa Chennai, India**Role - Data Architect / Tier 1** · **Skill: SSIS, SSRS, Power BI, Azure Devops** · **Exp - 12+ years** · Relevant experience in SSIS and SSRS and SQL Server. · Strong in writing SQL query, stored procedure and functions with hands-on in Power BI · Experience in creating SQL Ser ...
-
Data Architect
3 weeks ago
TransUnion Chennai, IndiaTransUnion's Job Applicant Privacy Notice · **What We'll Bring**: · - What We'll Bring: Provide guidance, leadership and expertise for SHAPE data architecture, migration strategy and compliance in partnership with the Analytics architecture team. What You'll Bring: This role is f ...
-
Data Architect
2 weeks ago
Guardian Life Insurance Company Chennai, Tamil Nadu, IndiaJob Description: · Requirements Elicitation, Understanding, Analysis, & Management · - Understand the project's Vision and requirements, and contribute to the creation of the supplemental requirements, building the low-level technical specifications for a particular platform and/ ...
-
Data Architect
1 week ago
Orion Innovation Chennai, Tamil Nadu, IndiaOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, an ...
-
Data Architect
1 week ago
Orion Innovation Chennai, Tamil Nadu, IndiaOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, an ...
-
Data Architect
3 weeks ago
Orion Innovation Chennai, Tamil Nadu, IndiaOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, an ...
-
Data Architect
6 days ago
Versatile Consultancy Chennai, Tamil Nadu, India10 plus years of experience in Data Engineering with solid experience in design, development and implementation of end-to-end data ingestion and data processing system in AWS platform. · 7 to 9 years of experience in AWS Glue, Lambda, Appflow, EventBridge, Python, PySpark, Lake H ...
-
Data Architect
6 days ago
Virtusa Chennai, Tamil Nadu, India**JOB DESCRIPTION** · **Skill: Data Architect** · **Role / Tier: - Data with Spark / Scala Python Tier 1 / Tier 0** · **Required Qualifications**: · 10 years' Experience in software development using programming languages & tools/services Java or Python or Scala and SQL. · - Expe ...
-
Data Architect
18 hours ago
Orion Innovation Chennai, IndiaOrion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, an ...
-
Data Architect/ Information Architect
2 weeks ago
AstraZeneca Chennai, India**Job Title - Information Architect** · **Career Level - E** · **Leverage technology to impact patients and ultimately save lives**: · **ABOUT ASTRAZENECA**: · AstraZeneca is a global, science-led, patient-focused biopharmaceutical company that focuses on the discovery, developme ...
-
Data Architect
1 day ago
Ford Motor Company Chennai, India**Required Skills and Selection Criteria**: · - Google Professional Cloud Data Architect certification. · - 5+ years' experience in Data and Information architecture in analytics space. Solid knowledge of cloud data architecture, data modelling principles, and expertise in Data M ...
-
Data Architect
2 days ago
Smartek21 Chennai, IndiaCompany Description · SmarTek21 is a global leader in Intelligent Technology Transformation as a Service. We accelerate digital business for Fortune 500 clients and industry-leading enterprises across the world. Our technology services have accelerated billions in revenue for our ...
-
Data Architect
4 days ago
Ignitho Chennai, India**Location**: · - Chennai, Tamil Nadu**Openings**: · - 1**Salary Range**: · **Description**: · - Develop and implement an overall organizational data strategy that is in line with business processes. The strategy includes data model designs, database development standards, implem ...
-
Mindtree - Data Architect
3 weeks ago
Diamondpick Chennai, India**Data Architect / Sr. Data Architect** · **Responsibilities** · - Define the technical architecture, data model, and performance of data solutions; influence change and enforce data best practices, standards, and governance; assess scope and define timelines, plans, and roadmap. ...
-
Enterprise Data Architect
1 week ago
Ciklum Chennai, Tamil Nadu, India· **Ciklum **is looking for an **Enterprise Data Architect **to join our team full-time in India. · We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team ...
-
Architect- Azure Data
2 weeks ago
ZF Chennai, India**What's Next? Join ZF**: · ZF is a global technology company supplying systems for passenger cars, commercial vehicles and industrial technology, enabling the next generation of mobility. · ZF allows vehicles to see, think and act. In the four technology domains of Vehicle Motio ...
-
Data Warehouse Architect
3 weeks ago
Anthology, Inc. Chennai, IndiaData Warehouse Architect · Chennai, India · The Opportunity: · Anthology offers the largest EdTech ecosystem on a global scale, supporting over 150 million users in 80 countries. Our mission is to provide dynamic, data-informed experiences to the global education community so tha ...
-
Big Data Architect
2 weeks ago
Cynosure Chennai, IndiaJob Information · Industry · - TelecommunicationsWork Experience · - 7-10 yearsCity · - ChennaiState/Province · - Tamil NaduCountry · - IndiaZip/Postal Code · **Responsibilities**: · - Articulate business and data requirements from business analysts across the various functional ...
Cloud Data Architect - chennai, India - Ford Motor Company
Description
Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failures.
Bachelor's Degree
At least 12 years of progressive experience