- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python scripting.
- Utilize cloud services like AWS to orchestrate and manage data pipelines efficiently.
- Possess strong database engineering skills to design and optimize data models for Snowflake.
- Leverage frameworks like Airflow or Luigi to schedule and automate data pipeline executions.
- Identify performance bottlenecks and bugs within data pipelines, then develop scalable solutions for improvement.
- Implement unit testing practices to ensure the quality and reliability of data pipelines.
- Document data pipelines thoroughly for clear understanding and future maintenance.
- Work independently and manage a pipeline of tasks with minimal supervision.
- 3+ years of experience as a Data Engineer with a strong focus on Python programming.
- Expertise in working with distributed data warehouses (DW) like Snowflake and cloud services like AWS.
- Solid understanding of database concepts, data modeling principles, and data normalization techniques.
- Experience building and maintaining ETL pipelines using Python scripting and relevant frameworks.
- Proven ability to troubleshoot and debug data pipelines effectively.
- Strong analytical and problemsolving skills.
- Excellent communication and collaboration skills.
- Experience with DBT (Data Build Tool) for data transformation within Snowflake.
- Familiarity with other cloud platforms like Azure or Google Cloud Platform (GCP) is a plus.
-
Data Enginer
6 days ago
NatWest Group Bengaluru, Karnataka, IndiaOur people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...
-
Data Engine
1 week ago
Decathlon Bengaluru, IndiaPermanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...
-
Data Engine
1 week ago
Decathlon India Bengaluru, India**Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...
-
Data Engineer t9
3 days ago
Mercedes-Benz Research and Development India Private Limited Bengaluru, India**Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...
-
Data Engineer-2
11 hours ago
Deutsche Bank Bengaluru, Karnataka, India**Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...
-
Data Engineer-1
1 week ago
Commonwealth Bank Bengaluru, India**Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...
-
Data Engineer 169368 Full-time
1 week ago
HyreFox Consultants Bengaluru, India Full timeBuild and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...
-
Azure Data Engineer-3-10years-hyderabad
1 week ago
Black & White Business Solutions Bengaluru, India**Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...
-
Data Engineer
19 hours ago
Genpact Bengaluru, IndiaInviting applications for the role of · Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...
-
Engineer, Data
1 week ago
Giant Eagle GCC , Karnataka, IndiaJob Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...
-
Data Engineer
19 hours ago
Recro Bengaluru, IndiaExperience:3+ years · Work location: Bangalore · primary_skills(Must_have) · - Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · - Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · - Orchestratio ...
-
Data Engineers
1 week ago
Multplyr Bengaluru, IndiaPayroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...
-
Data Engineer
19 hours ago
Joveo Bengaluru, IndiaWe are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...
-
Data Engineer
5 days ago
SP Software Solutions Bengaluru, IndiaAzure Date Engineer · Multiple Locations in India · (Bengaluru, Chennai, Hyderabad, Kochi, Kolkata, Lucknow, Mumbai, Noida, Pune) · Strong experience in SQL, Azure, Azure Data Factory, Databricks, Python, Spark, PySpark · Moderate experience in CI/CD · Requirements: · Strong pr ...
-
Data Engineer
1 day ago
Mobile Programming LLC Bangalore, IndiaJob Description : · Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. · As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring t ...
-
Data Engineer
19 hours ago
Ascendion Bengaluru, India· Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...
-
Data Engineer
1 week ago
Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Bengaluru, IndiaGreetings from @Teamware Solutions. . · Hope you doing well Join our family Here we are hiring Data Engineer · Job Position: Data Engineer · Job Type: Full-Time · Job Location: Pan India · Job Description: · The right candidate has (Responsibilities); · Provide Wealth Management ...
-
Data Engineer
19 hours ago
JRD Systems Bengaluru, IndiaRole · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...
-
Sr Data Engineer/Data Engineer
1 week ago
Trigent Software - Professional Services Bengaluru, IndiaSenior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...
-
Data Engineer
19 hours ago
C5i Bengaluru, IndiaThe Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...
Python Data Engineer - bangalore, India - Swift Strategic Staff Solutions INC
Description
Job Description :
We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.
Responsibilities :
Qualifications :
Good to Have :