
Girish Bajaj
Technology / Internet
About Girish Bajaj:
Experienced professional with 6+ years of experience in IT including 3 years of experience in big data. Proficient in programming languages like Python and SQL and big data technologies like PySpark, Hive, Sqoop, YARN, MapReduce
Experience
Proficiently utilized big data tools including Hive, Spark, SQL, Sqoop and more to engineer high-quality data solutions by employing advanced optimization techniques like partitioning and bucketing in Hive.
Managed the ingestion and processing of vast datasets from a wide array of structured and unstructured sources into HDFS, concurrently designing internal and external tables in Hive.
Reviewed and managed Hadoop log files, coupled with a comprehensive command of data frames and Spark transformations along with a strong foundation in Python programming.
Accomplished the collection and aggregation of big data by utilizing Apache Sqoop and Hive, enabling the development of robust ETL pipelines and seamless data integration solutions.
Knowledge of Agile Methodology, demonstrating adaptability in a dynamic development process, and showcasing strong problem-solving skills and a keen aptitude for decisive decision-making.
Skilled at constructing and optimizing data processing pipelines, translating complex business requirements into efficient and scalable big data solutions.
Demonstrated ability to collaborate effectively in cross-functional teams and come up with innovative solutions that enhance overall data-driven decision-making capabilities.
Education
Involved in data cleaning and optimization efforts by importing data into HDFS and enhancing performance through PySpark, Hive and SQL. Worked in the design and execution of efficient data processing pipelines, including PySpark jobs for transformation and aggregation. Formulated and established Hive external tables with partitioning for efficient data organization and access.
Professionals in the same Technology / Internet sector as Girish Bajaj
Professionals from different sectors near Aurangabad, Aurangabad
Other users who are called Girish
Jobs near Aurangabad, Aurangabad
-
· Job Description: · A Trainee Quality Engineer in the railway wheel industry is an entry-level position focused on ensuring that forged/cast railway wheels meet stringent safety, metallurgical, and dimensional standards. They assist senior engineers in inspection, testing, and ...
Aurangabad1 day ago
-
This job is with Jabil. To coordinate tasks with other Manufacturing staff to fulfill customer requirements. · Works under direct supervision. · Follws mostly routine procedures. · ...
Ranjangaon1 month ago
-
· Job Description: · Job Description: · We at Y JOBS is having an exciting opportunity for one of our client in Power Electronic Manufacturing Industry at Aurangabad. · Designation : Embedded Engineer · Qualification : BE / B.Tech /Diploma - E &TC / Electrical · Salary CTC : Neg ...
Aurangabad6 days ago