- AWS Expertise: Strong hands-on experience with AWS data services including Glue, Redshift, Athena, S3, Lake Formation, Kinesis, Lambda, Step Functions, EMR, and CloudWatch.
- ETL/ELT Engineering: Deep proficiency in designing robust ETL/ELT pipelines with AWS Glue (PySpark/Scala), Python, dbt, or other automation frameworks.
- Data Modeling: Advanced knowledge of dimensional (Star/Snowflake) and normalised data modeling, optimised for Redshift and S3-based lakehouses.
- Programming Skills: Proficient in Python, SQL, and PySpark, with automation and scripting skills for data workflows.
- Architecture Leadership: Demonstrated experience leading large-scale AWS data engineering projects across teams and domains.
- Pre-sales & Consulting: Proven experience working with clients, responding to technical RFPs, and designing cloud-native data solutions.
- Advanced PySpark Expertise: Deep hands-on experience in writing optimized PySpark code for distributed data processing, including transformation pipelines using DataFrames, RDDs, and Spark SQL, with a strong grasp of lazy evaluation, catalyst optimizer, and Tungsten execution engine.
- Performance Tuning & Partitioning: Proven ability to debug and optimize Spark jobs through custom partitioning strategies, broadcast joins, caching, and checkpointing, with proficiency in tuning executor memory, shuffle configurations, and leveraging Spark UI for performance diagnostics in large-scale data workloads (>TB scale).
-
Key Responsibilities: · Design, build, and maintain scalable data pipelines using GCP services like BigQuery and Dataflow · Model and integrate structured and unstructured data for analytics and reporting · Implement Infrastructure as Code (IaC) using Terraform for reproducible a ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore ₹900,000 - ₹2,800,000 (INR) per year Full time2 days ago
-
Role & responsibilities · Must have : · Python(4), PySpark(4), Hive(4) · 6 to 8 years of experience Exclusively in the below areas · People with Strong DE experience along with Python , Pyspark, Hive as primary skills. · Must to Have: · Hands-on with Pyspark & python · Hive, Had ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore ₹900,000 - ₹2,800,000 (INR) per year Full time6 days ago
-
Job Summary · We're on the hunt for passionate individuals to join our dynamic team as Data Engineer · Job Profile : Data Engineers · Experience : Minimum 3 to Maximum 8 Yrs of exp · Location : Chennai / Hyderabad / Bangalore / Gurgaon / Pune · Mandatory Skills : Big Data | Hado ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore ₹600,000 - ₹2,200,000 (INR) per year Full time2 days ago
-
7+ years of experience in SQL development and database management · Own and drive the end-to-end data migration process from Mainframe DB2 to GCP · Analyze existing DB2 data structures, stored procedures, and ETL processes · Design and implement scalable, secure, and efficient da ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore ₹800,000 - ₹1,600,000 (INR) per year Full time6 days ago
- Work in company
Full Stack Java Developer
CGI Information Systems and Management Consultants Private Limited
Job Title: Full Stack Java Developer · Position: Senior Engineer/Senior Software Engineer (SE/SSE) · Experience: 6 years to 10 relevant years' experience · Category: Software Development/ Engineering · Main location: Any CGI [Bengaluru, Chennai, Hyderabad, Pune, Mumbai] · Positi ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore Full time2 days ago
-
Key Responsibilities: · Design and manage Real-Time Customer Profiles (RTCP) and identity stitching · Develop and maintain XDM schemas and Experience Events · Integrate AEP with external data sources and APIs · Enable audience segmentation and cross-channel activation · Orchestra ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore Full time6 days ago
-
:Title: AWS Cloud Engineer · Bangalore/Hyderabad/Pune/Chennai/Noida/Gurugram/Delhi · Work Mode: Hybrid based on HR rule (currently 1 day per month) · Shift Timings 24 x 7 -Work in shifts on rotational basis · Total Experience in Years- 8+ yrs, 5 yrs of relevant exp is required. · ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore Full time6 days ago
-
Responsibilities · Design, develop, and maintain responsive, user-friendly web applications using modern frontend frameworks (Angular, React, ). · Translate application storyboards, wireframes, and use cases into functional, interactive UIs. · Write clean, scalable, and efficient ...
Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore Full time6 days ago
Senior AWS Data Engineer - Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore - Sightspectrum
Description
Must-Have Qualifications:
-
Big Data Engineer
Full time Siro Clinpharm- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
Big Data Engineer
Full time confidential- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
Bigdata And Hadoop Developer
Full time Sightspectrum- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
SQL Developer
Full time confidential- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
Full Stack Java Developer
Full time CGI Information Systems and Management Consultants Private Limited- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
AJO AEP Developer
Full time confidential- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
Aws Cloud Engineer
Full time confidential- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore
-
Dotnet Developer Fullstack
Full time confidential- Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore