Big Data and Gcp - Bengaluru, Karnataka, India - Manage Captive Solutions
1 week ago
Description
Who We Are
Manage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances.
We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable businesses to focus on expanding their horizons.Our holistic service oversees the entire onboarding process, managing everything from local regulations to payroll intricacies and compliance matters. Additionally, our commitment to cutting-edge technology delivery further enhances their business operations.
Job Title:
Big Data and GCP
Experience Level: 4-8 years
Location:
Bangalore (On-site)
Availability:
Immediate
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as Dataflow, Dataprep, and Composer.
- Implement data ingestion, transformation, and storage solutions using technologies like Hive, Spark, PySpark, and Python.
- Work closely with crossfunctional teams to understand data requirements and translate them into technical solutions.
- Optimize and tune data pipelines for performance, reliability, and efficiency.
- Collaborate with data scientists and analysts to provide access to highquality data and ensure data integrity.
- Monitor, troubleshoot, and resolve issues related to data processing and performance.
- Stay updated with emerging technologies and industry trends in big data and cloud computing.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 4 to 8 years of experience in big data engineering and cloud technologies, with a focus on GCP.
- Strong proficiency in programming languages such as Python and SQL.
- Handson experience with big data processing frameworks like Spark and Hive.
- Experience with GCP services including BigQuery, Pub/Sub, Dataflow, and Composer.
- Knowledge of CI/CD practices and tools for automating deployment and testing.
- Familiarity with database systems such as MySQL, NoSQL, and Google Cloud SQL.
- Experience with realtime data streaming technologies like Kafka is a plus.
- Excellent communication skills and ability to work effectively in a collaborative team environment.
How to Apply:
Manage Captive Solutions is an equal opportunity employer and encourages individuals from diverse backgrounds to apply.
Job Types:
Full-time, Permanent
Benefits:
- Health insurance
- Provident Fund
Schedule:
- Day shift
- Monday to Friday
Experience:
- total work: 5 years (preferred)
Ability to Commute:
- Bangalore, Karnataka (required)
Ability to Relocate:
- Bangalore, Karnataka: Relocate before starting work (required)
Work Location:
In person
Speak with the employer
More jobs from Manage Captive Solutions
-
Computer Vision Expert
Noida, India - 5 days ago
-
Data Analytics
Chennai, Tamil Nadu, India - 1 week ago