Girish Bajaj

Experienced professional with 6+ years of experience in IT including 3 years of experience in big data. Proficient in programming languages like Python and SQL and big data technologies like PySpark, Hive, Sqoop, YARN, MapReduce

Proficiently utilized big data tools including Hive, Spark, SQL, Sqoop and more to engineer high-quality data solutions by employing advanced optimization techniques like partitioning and bucketing in Hive.

Managed the ingestion and processing of vast datasets from a wide array of structured and unstructured sources into HDFS, concurrently designing internal and external tables in Hive.

Reviewed and managed Hadoop log files, coupled with a comprehensive command of data frames and Spark transformations along with a strong foundation in Python programming.

Accomplished the collection and aggregation of big data by utilizing Apache Sqoop and Hive, enabling the development of robust ETL pipelines and seamless data integration solutions.

Knowledge of Agile Methodology, demonstrating adaptability in a dynamic development process, and showcasing strong problem-solving skills and a keen aptitude for decisive decision-making.

Skilled at constructing and optimizing data processing pipelines, translating complex business requirements into efficient and scalable big data solutions.

Demonstrated ability to collaborate effectively in cross-functional teams and come up with innovative solutions that enhance overall data-driven decision-making capabilities.

Involved in data cleaning and optimization efforts by importing data into HDFS and enhancing performance through PySpark, Hive and SQL. Worked in the design and execution of efficient data processing pipelines, including PySpark jobs for transformation and aggregation. Formulated and established Hive external tables with partitioning for efficient data organization and access.