- This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams.
- Data engineers will work in small, cross-functional teams. They will collaborate directly and continuously with product managers, designers, and product owners to release early and often.
- Work with data scientists and software engineers to support data acquisition activities, data solution ideation, and implementation
- Work with technical and business leads to transfer global business requirements into sound solutions and implementation
- Share support responsibilities for implemented components
- Minimum of 8+ years' experience working in Data Engineering, primarily on GCP skill sets.
- Hands on experience developing Data engineering pipelines using Workflows
- Experience in troubleshooting performance issues
- Minimum of 3+ years of experience working in Data engineering, Big data platform and technologies including Hadoop, Hive, Sqoop, Spark, Kafka, Big Query, Terraform, Tekton, Astro, Astonomer, Data Flow, Data Proc, Data Fusion, etc.,
- Design data pipelines and data robots, take a vision and bring it to life
- Master data engineer; teaches others; works closely with IT architects
- Experience programming in Java and Python is a plus
- Experience using Alteryx and data visualization tools especially Qlikview is a plus
- Experience working in Agile/XP
- Strong analytical and problem-solving skills
- Strong oral and written communication skills
- Data Manipulation - GCP (Big Query, Cloud Storage, Data Proc, etc.), Terraform, Airflow
- REQUIREMENTS MANAGEMENT: Identify, document, communicate and design per requirements.
- DESIGN: Work with Data Product Owners to design data stores.
- IMPLEMENT DATA STORES: Implement data stores on GCP, using DBT for transformations, BigQuery for data store and Astronomer for overall orchestration.
- TEST: Participate in testing and adopt test driven development.
- TUNE: Tune data stores (indexes, SQL queries) to improve performance.
- L2
- COLLABORATE: Work within/across teams.
-
Jobs For Data Engineer
1 day ago
Seven Consultancy chennai, IndiaSALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...
-
Data Engineer
22 hours ago
BU Soft Tech Chennai, IndiaExperience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...
-
Data Engineer
22 hours ago
OptiSol Business Solutions Chennai, IndiaPosition: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible ...
-
Data Engineering
22 hours ago
InfoCepts Chennai, IndiaPosition: · Data Engineering - Project Manager · Location: · Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, ...
-
Data Engineer
22 hours ago
Aspire Systems Chennai, IndiaData Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...
-
Data Engineer
3 days ago
Mindsprint Chennai, IndiaJob Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...
-
Data Engineer
1 week ago
Movate Chennai, IndiaRole: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...
-
Data Engineer
22 hours ago
System Soft Technologies Chennai, India· Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, ...
-
Data Engineer
22 hours ago
Blackstraw Chennai, IndiaData Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: · We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exam ...
-
Data Engineer
1 week ago
Ashley Global Capability Center Chennai, IndiaPrimary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...
-
Data Engineer
1 day ago
ResourceTree Global Services chennai, IndiaResourceTree Global Services is hiring Senior Data Engineer(Snowflake & DBT) for one of its Data Analytics Client. Below are the details. · Role: Senior Data Engineer(Snowflake & DBT) · Primary Skills: DBT,Snowflake · Secondary Skills: 4 to 6 Years · Location: Chennai · Role f ...
-
Data Engineer
1 day ago
Randstad chennai, IndiaRole : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...
-
Data Engineer
22 hours ago
Cynosure Corporate Solutions Chennai, IndiaLead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data wareh ...
-
Data Engineer
1 week ago
HTC Global Services Chennai, IndiaData Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...
-
Data Engineer
1 day ago
hubwork Chennai, India permanentSummary : · We are looking for a data engineer who has experience in building data pipelines for large data · platforms. This role will be working with a team building a large data platform catering to the needs of a wealth manager for their application and analytics needs. This ...
-
Data Engineer
1 day ago
iTechMinds Consulting LLP Chennai, IndiaPosition : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...
-
Data Engineer
1 day ago
Notus chennai, IndiaAWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintai ...
-
Data Engineer
22 hours ago
Makonis Chennai, IndiaWork Location: Chennai & Coimbatore Required Exp: 3 to 6yrs (Fulltime Position) Client: Leading Investment Bank Mandatory skills: We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. If that matches your profile, please share a copy of your res ...
-
Data Engineer
1 day ago
Cortex Consulting Pvt. Ltd. chennai, IndiaResponsibilities : · - Design, construct, install, test, and maintain highly scalable data management systems. · - Develop and implement ETL processes to collect, store, and process data from various sources. · - Build and optimize data pipelines for efficient data ingestion and ...
-
Data Engineer
1 day ago
U-SET Chennai, India permanentData Engineer - ETL with Python, Spark & Hadoop · Women's Drive - 2nd March -Chennai - Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions · - Craft and implement data pipelines ...
Data Engineer - Chennai, India - HTC Global Services
Description
Position Description:
Skills Required:
Skills Preferred:
Experience Required:
SUPPORT:
Assist with customer inquiries and incidents/problems.