- Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.
- Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.
- Works with stakeholders to gather requirements on merging, de-duplicating, standardizing data.
- Develop, support, and refine new data pipelines, data models, business logic, data schemas as code, and analytics to product specifications.
- Prototype and optimize data type checks to ensure data uniformity prior to load.
- Develop, and refine batch processing data pipeline frameworks.
- Maintain, improve, and develop expertise in existing production data models, and algorithms.
- Learn and utilize business data domain knowledge and its correlation to underlying data sources.
- Define, document, and maintain a data dictionary including data definitions, data sources, business meaning and usage of information.
- Identify and validate opportunities to reuse existing data and algorithms.
- Collaborate on design and implementation of data standardization procedures.
- Share team responsibilities, such as contributing to development of data warehouses and productizing algorithms created by Data Science team members.
- Participate in on-call and weekly shift rotation.
- 4 - 6 years of experience building data pipelines and using ETL tools(Must-have).
- 2+ years of experience in ETL tools like Talend /Jaspersoft ETL tools(Must-have) .
2+ years of experience in SQL programming language (Must-have) . - Strong in writing stored procedures and sql queries(Must-have).
- 2+ years of experience in python programming (Must-have) .
- Sound knowledge of distributed systems and data processing with spark.
- Knowledge of any tool for scheduling and orchestration of data pipelines or workflows (preferred Airflow)(must to have)
- 1+ years experience developing modern, industry standard big data frameworks with AWS or other cloud with common GitHub developer practices and paradigms.
- Experience working with agile methodologies and cross-functional teams.
- Knowledge in building AWS data pipelines using python, S3 data lake(nice to have).
- Knowledge of redshift or any other columnar database is preferred.
- Experience with AWS services including S3, Redshift, EMR (nice to have)
- Knowledge of distributed systems as it pertains to data storage and computing
- Knowledge of specialty pharmaceutical and retail pharmacy is a plus.
- Good to have knowledge of the Data integration process.
- Ability to effectively communicate with both business and technical teams
- Excellent verbal, written communication.
- Flexible with the working timing.
-
Data / Ml Engineer-1
1 week ago
Mastercard Pune, IndiaOur Purpose · We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financi ...
-
Data Engineer
2 days ago
Synechron Pune, IndiaGood day, · We have immediate opportunity for Data Analytics Engineer. · Job Role: Data Analytics Engineer · Job Location: Kharadi, Pune · Experience- 8 Years to 12 Years. · Notice Period: upto 30 days. · About Company: · At Synechron, we believe in the power of digital to tran ...
-
Data Engineer
1 day ago
Synechron Pune, IndiaGood day, · We have immediate opportunity for Data Analytics Engineer. · Job Role: Data Analytics Engineer · Job Location: Kharadi, Pune · Experience- 8 Years to 12 Years. · Notice Period: upto 30 days. · About Company: · At Synechron, we believe in the power of digital to tran ...
-
Data Engineer
21 hours ago
ACS International India Pvt. Ltd. (ACSII) Pune, IndiaACS-I India is looking for an 8+ years experienced Data Engineer with data modeling experience who will support a rapidly growing Business Data & Analytic Platform focused on providing data product solutions that empower our core business users to turn data into actionable insigh ...
-
Data Engineer
1 week ago
Sigmaways Inc Pune, IndiaThis position is a Hybrid Role candidate should be 2 days onsite in Pune Office ( Prefer Local candidates). · Position : Data Engineer · Type : Long Term Contract Role · Location : Pune / Hybrid · Job Description: · This position is for Data warehouse group . · This position is a ...
-
Data Engineer
5 days ago
Synechron Pune, IndiaGoodday, · We have immediate opportunity for Data Engineer. · Job Role: Data Engineer · Job Location: Pune Hinjewadi · Experience 5 to 8 Years. · Notice Perod : Upto 15 days preferred. · About Company: · At Synechron, we believe in the power of digital to transform businesses for ...
-
Data Engineer
5 days ago
Tata Technologies Pune, IndiaPosition :- Data Engineer (Snowflake) · Location :- Pune · Exp. Rane :- 4-6 years · Must Have: · 4-6 Years Overall experience · 4+ years of experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc. · 3+ years of p ...
-
Data Engineer
5 days ago
ACS International India Pvt. Ltd. (ACSII) Pune, IndiaACS-I India is looking for a 5+ years experienced Data Engineer who will support a rapidly growing Business Data & Analytic Platform focused on providing data product solutions that empower our core business users to turn data into actionable insights. The data engineer will work ...
-
Data Engineer
1 week ago
Perficient Pune, IndiaJob Description: Data Engineer · Experience Total: 4- 7 · Location: Pune · Qualification: · Advanced working SQL knowledge and performance tuning · Good knowledge of Relational Model, Dimensional Data Modelling, Data Warehouse · Experience working with relational databases, fo ...
-
Data Engineer
6 days ago
YASH Technologies Pune, IndiaWe are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. · Build and operationalize large scale enterprise da ...
-
Data Engineer
4 days ago
Tech Mahindra Pune, IndiaTitle: Reltio GCP Data Engineer · Location: Pune · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable ...
-
Data Engineer
5 days ago
Calsoft Pune, IndiaJD: data engineer with Python, SQL, PySpark, spark, Airflow, and any cloud good to have Hadoop · for Pune and Bangalore locations, · Experience 5 to 7yrs, · Notice Period: Immediate to 15 days · ...
-
Data Engineer
4 days ago
Tech Mahindra Pune, IndiaGCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage, · Strong python programming experience in using Google Cloud python client libraries, · Strong SQL and data analysis skills, · Proficient ETL/ELT experience in workflows, data modelling and data pipeli ...
-
Data Engineer
1 day ago
TMF Group Pune, IndiaAbout TMF Group · TMF Group is a leading provider of critical administrative services, helping clients invest and operate safely around the world. Our 10,000 experts and 120 offices in 85 jurisdictions worldwide serve corporates, financial institutions, asset managers, private cl ...
-
Data Engineer
21 hours ago
SGS Technical Services Pvt. Ltd Pune, IndiaExperience : Total 4+ Years of experience · Notice Period : Immediate to 15 days · Location : Pune · Job Title : Data Engineer (Snowflake and Matillion) · Job Description : · Overview : · Design, implement, and optimize data pipelines and workflows using Snowflake and Matillio ...
-
Data Engineer
1 day ago
Rocket Consulting Anywhere in India/Multiple Locations/Pune permanentA Data Engineer/developer having good experience working with · Primary skills : Python, AirFlow - ETL skills - GCP · Secondary skills : Google Cloud Composer - Google Big Query - Google Cloud · - Storage - SQL - MS SQL Serve · - Proven experience as a Data Engineer/Developer wit ...
-
Data Engineer
6 days ago
Oneture Technologies Pune, IndiaRole : Data Engineer (AWS) · Location : Mumbai, Pune · Experience : 1 to 3 yrs · Technologies / Skills : Advanced SQL, AWS, ETL pipelines development and optimization, Data Modelling, Spark - Scala/Python, Airflow, Kafka · Job Overview : · We are looking for a Data Engineer to jo ...
-
Data Engineer
5 days ago
Cybage Software Pune, IndiaAbout Cybage · Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world's largest Independent So ...
-
Data Engineer
1 day ago
OptOut Pune, IndiaRole Description : · - Data modeling and architecture : You would be responsible for designing and implementing data models that are optimized for Azure services, including Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage. · - ETL and data integration: You would b ...
-
Data Engineer
2 days ago
RapidBraiins Pune, India permanentPosition Overview : · As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and impl ...
Data Engineer - Pune, India - HyrEzy Talent Solutions
Description
Job Description and Responsibilities :