Data Engineer - pune
4 days ago
Job description
Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people.
Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.
We believe in continuous learning and evolving together. And we let the data speak
What will you be doing?
You will be discovering trends in the data sets and developing algorithms to transform raw data for further analytics
Create Data Pipelines to bring in data from various sources, with different formats, transforming it, and finally loading it to the target database.
Implement ETL/ ELT processes in the cloud using tools like AirFlow, Glue, Stitch, Cloud Data Fusion, DataFlow.Design and implement Data Lake, Data Warehouse, and Data Marts in AWS, GCP, or Azure using Redshift, BigQuery, PostgreSQL, etc.
Creating efficient SQL queries and understanding query execution plans for tuning queries on engines like PostgreSQL.Performance tuning of OLAP/ OLTP databases by creating indices, tables, and views.
Write Python scripts for orchestration of data pipelines
Have thoughtful discussions with customers to understand their data engineering requirements. Break complex requirements into smaller tasks for execution.
What do we need from you?
Strong Python coding skills with basic knowledge of algorithms/data structures and their application.
Strong understanding of Data Engineering concepts including ETL, ELT, Data Lake, Data Warehousing, and Data Pipelines.
Experience designing and implementing Data Lakes, Data Warehouses, and Data Marts that support terabytes scale data.
A track record of implementing Data Pipelines on public cloud environments (AWS/GCP/Azure) is highly desirable
A clear understanding of Database concepts like indexing, query performance optimization, views, and various types of schemas.
Hands-on SQL programming experience with knowledge of windowing functions, subqueries, and various types of joins.
Experience working with Big Data technologies like PySpark/ Hadoop
A good team player with an ability to communicate with clarity
Show us your git repo/ blog
Qualification
1-2 years of experience working on Data Engineering projects for Data Engineer I
2-5 years of experience working on Data Engineering projects for Data Engineer II
1-5 years of Hands-on Python programming experience
Bachelors/Master's degree in Computer Science is good to have
Courses or Certifications in the area of Data Engineering will be given a higher preference.
Candidates who have demonstrated a drive for learning and keeping up to date with technology by continuing to do various courses/self-learning will be given high preference.
Similar jobs
+Job summary · We are seeking an experienced GCP Data Engineer with strong expertise in designing, · building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP).++Design develop maintain · data pipelines ETL processes on GCP using servic ...
3 weeks ago
We are seeking an experienced GCP Data Engineer with strong expertise in designing building and managing scalable data pipelines analytical solutions on Google Cloud Platform (GCP). · Design develop maintain data pipelines ETL processes on GCP using services like Dataflow Datapr ...
1 week ago
Associate - Data Engineer-Data Engineering-Big Data Engineering
Only for registered members
Associate - Data Engineer-Data Engineering-Big Data Engineering job is available in Pune, Maharashtra. · Required skills and experience include Databricks hands-on experience, strong expertise in Apache Spark and distributed data processing, solid experience with Delta Lake and L ...
1 week ago
We are hiring an experienced Senior Data Engineer with a strong foundation in Python, big data platforms, and an understanding of AI/ML workflows within data engineering. The ideal candidate will work on building scalable and efficient data pipelines, supporting advanced analytic ...
2 days ago
The role involves developing and maintaining scalable ETL pipelines using PySpark, Databricks, and other big data technologies. It also includes working with various structured and unstructured data sources to build efficient data workflows and integrate them into a central data ...
3 weeks ago
We are setting up a brand-new Data Engineering program with an aim to make the data assets high quality & available for scientific study leading higher monetization in terms of increased revenue, improved operational efficiency and high-quality service. · ...
1 month ago
Data engineer responsibilities include contributing to the evolution of our data infrastructure and artificial intelligence initiatives. · ...
1 month ago
Data Engineer position in Ahmedabad/Indore/Pune. · ...
1 month ago
Data Engineer at PharmLogic Brands India Pvt Ltd · Strong experience in Python & SQL · Minimum 2–3 years in Data Modeling · Hands-on with ETL / Data Pipelines · ...
1 week ago
Senior Data Engineer · The Senior Data Engineer will design and build large-scale data pipelines and platforms. · Create scalable batch and streaming data pipelines. · Optimize Spark jobs for performance. · ...
1 week ago
Implement MLOps frameworks for machine learning model lifecycle management and provide improvement in AI/ML implementation. · ...
1 week ago
We are Cognyte, the global leader in security analytics software, and we are looking for an exceptional and passionate Data Engineer to join our Research business unit in India. · If you want to be part of a powerful team,,,we are looking for a talented Data Engineer to join our ...
4 days ago
We are seeking a skilled and motivated Data Engineer to join our BI & Analytics team at our Pune office. In this role, you will lead the design and implementation of scalable, reusable, and optimized end-to-end data pipelines. · ...
1 week ago
Responsibilities: · * Design, develop & maintain data pipelines using Python, SQL & Tableau. · * Optimize database performance with MySQL & Oracle expertise.. · Data Engineering, SQL, Python, Tableau, MySQL, Oracle, Power BI · Perks and benefits · Annual bonus · ...
7 hours ago
We are seeking a Scala and Spark–focused Data Engineer with around 6 years of experience to join our data platform team. · ...
1 month ago
We couldn't solve mobility's toughest challenges without our Corporate team. They ensure operations run smoothly by supporting more than 200,000 Aptiv employees and providing the direction and guidance needed as we strive to make the world safer, greener and more connected. · IT ...
1 month ago
+We are looking for a Data Engineer with hands-on experience in building, maintaining and optimizing data pipelines and infrastructure. · ++Data Pipeline Development · Design and build scalable ETL/ELT pipelines. · Ingest data from multiple sources such as databases APIs logs and ...
1 month ago
We are looking for passionate · Databricks Data Engineers · to manage and enhance our cloud-based data platforms. · This role is responsible for · end-to-end data pipeline development, optimization, · and operational stability on Azure/AWS Databricks, · ensuring high data quality ...
1 month ago
Key Responsibilities · Design, build, and operate robust ingestion pipelines for batch and near-real-time data using AWS-native services · Implement CDC-based ingestion patterns for databases, SaaS platforms, and external partners · Standardize ingestion frameworks for files, API ...
3 days ago
We are setting up a brand-new Data Engineering program with an aim to make the data assets high quality & available for scientific study leading higher monetization in terms of increased revenue, improved operational efficiency and high-quality service. · The successful candidate ...
1 month ago
We invite you to step into the next exciting chapter of your career journey. · ...
1 month ago