
Pallavi A M
Engineering / Architecture
About Pallavi A M:
Big Data Engineer with 3 years of relevant experience, Proficient in Python,
SQL, and Spark, with expertise in designing and implementing data migration
projects. Successfully migrated complex HQL scripts into Pyspark on Palantir
Foundary, ensuring seamless data transfer and ETL processes.
Experience
Led end-to-end implementation of Mcloud Migration into Palantir Platform, including design,
requirement gathering, and build, resulting in improved data processing efficiency.
Successfully migrated complex HQL scripts into Pyspark on Palantir Foundary, enabling
seamless data transfer from SQL and Hive to PySpark and reducing processing time.
implemented robust code repository, code workbook, and data lineage, ensuring efficient
team collaboration and easy maintenance of codebase.
Developed monitoring and health check systems for datasets, reducing data-related errors
and enhancing data reliability.
Education
2015 - 2019| Maharaja institute of technology, Mysore
Computer Science and Engineering
Professionals in the same Engineering / Architecture sector as Pallavi A M
Professionals from different sectors near Bengaluru, Bengaluru Urban
Other users who are called Pallavi
Jobs near Bengaluru, Bengaluru Urban
-
We are looking for a Data Engineer to design, build and operate scalable fault-tolerant data pipelines on Google Cloud Platform (GCP). You will work across batch and streaming data curate analytics-ready datasets in BigQuery and enable business insights through a governed Looker ...
Bengaluru, Chennai, Pune1 month ago
-
+ Design build and manage scalable data solutions · + 3–7 years hands-on experience Data Engineer similar role · + Strong command SQL data engineering best practices · + Experience cloud databases Snowflake PostgreSQL ...
Bengaluru4 weeks ago
-
We are looking for a Data Engineer to design and build scalable logging and telemetry pipelines. This role is critical to ensuring high-quality monitoring signals and enabling fast forensic analysis across production systems. · ...
Bengaluru, Karnataka2 weeks ago