- AWS Data &
- Databricks Lakehouse Platform
- PySpark, Spark SQL, Spark Streaming
- Experience with any NoSQL Database
- 2+ year of coding experience with modern programming or scripting language (Python).
- Expert-level skills in writing and optimizing SQL.
- Experience operating very large data warehouses or data lakes/ data platform.
- Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
- Data Modelling, star schema, derivative, measures
- Experience of working in Agile delivery
- Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, and testing.
- Excellent business and communication skills to work with business owners to understand data requirements.
- You will be responsible for identifying and creating reusable data solutions (accelerators, MVP)
- You will be responsible for creating reusable components for rapid development of data platform
- Work closely with the Product Owners and stake holders to design the Technical Architecture for data platform to meet the requirements of the proposed solution.
- Work with the leadership to set the standards for software engineering practices within the Data engineering team and support across other disciplines
- Play an active role in leading team meetings and workshops with clients.
- Delivering and presenting proofs of concept to of key technology components to project stakeholders.
- Educate clients on Cloud technologies and influence direction of the solution.
- Choose and use the right analytical libraries, programming languages, and frameworks for each task.
- Help us to shape the next generation of our products.
- Explore and learn the latest AWS Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.
- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Databricks, Spark, DynamoDB, RedShift, Kinesis, Lambda, Glue, Athena.
- Analyze, re-architect and re-platform, migrate on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python, PySpark, Databricks.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud & Databricks.
- Build and deliver high quality data architecture to support business analyst, data scientists, and customer reporting needs.
-
Data Engineer
2 weeks ago
Xcelyst Pune, IndiaRole : Data Engineer - Nifi · Experience : 5 Years - 8 Years · Notice period : Immediate - 30 days · Skills : Experience in Nifi and Data Engineering (Pyspark, SQL, ETL). · Secondary : Big Data/Hadoop, Hive, Spark · 4+ Years in Data Engineer/1-2 yrs exp in Nifi · We are seekin ...
-
Data Engineer
3 weeks ago
Persistent Systems pune, IndiaAbout Position · As a Data Engineer, you will be responsible for design and implementation of data pipelines, deploy models, build applications and integrations to Healthcare Domain & Data Standards. Good knowledge of public cloud such as AWS, System Engineering and Azure is pr ...
-
Data Engineer
3 weeks ago
Worldline Pune, IndiaData Engineer M2C · Pune · This is Worldline · We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop ...
-
Data Engineer
5 days ago
PURVIEW Pune, IndiaPurview is hiring Data Engineer with one of our valued clients. If you're interested, please reply for more details. · Job Details: · Role: Data Engineer · Location: Pune/Hyderabad · Duration: Permanent with Purview · We are looking for 5+ years with Python/PySpark · Job Descript ...
-
Data Engineer
5 days ago
Volante Technologies Pune, India****Immediate joiners only*** · Company Description: Volante is on the Leading Edge of Financial Services technology, if you are interested to be on an Innovative fast-moving team that leverages the very best in Cloud technology our team may be right for you. · By joining the pro ...
-
Data Engineer
2 days ago
Capleo Global Pune, IndiaData Engineer - AWS · Experience: 6+ Years · Location: Pune · We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experience with AWS servic ...
-
Data Engineer
3 weeks ago
Tech Mahindra Pune, IndiaGCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage, · Strong python programming experience in using Google Cloud python client libraries, · Strong SQL and data analysis skills, · Proficient ETL/ELT experience in workflows, data modelling and data pip ...
-
Data Engineer
3 weeks ago
Huquo pune, IndiaPosition : Snowflake DE · Location : Pune, Gurgaon · Experience : 6-9 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of ...
-
Data engineer
3 weeks ago
G.A. Design & Business (DBS) Pune, IndiaWork with data engineering tasks in the scope of industrial processes ( data standardization, cloud storage and integration within Antolin Big Data platform) · Work with several sources of data and create advanced monitoring views for different kind of users. · Grafana Programm ...
-
Data Engineer
3 weeks ago
Hiringhood Pune, IndiaPrimary Skills : DynamoDB, Java, Kafka, Spark, Amazon Redshift, AWS Lake Formation, AWS Glue, Python · Job Description : · - Good work experience showing growth as a Data Engineer. · - Hands On programming experience · - Implementation Experience on Kafka, Kinesis, Spark, AWS Glu ...
-
Data Engineer
3 weeks ago
HyrEzy Talent Solutions Pune, IndiaJob Description and Responsibilities : · Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process. · Analyze and document above requirements and data definitions, perform data analysis, assist in change mana ...
-
Data Engineer
3 weeks ago
YASH Technologies pune, IndiaYASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. · At YASH, we're a cluster of the brightest st ...
-
Data Engineer
5 hours ago
hushh Pune, IndiaJob Title: Data Engineer & Web Crawler - Revolutionizing Data Accessibility with AI · Company: Hushh Intelligence Inc. · Job Type: Full-Time · Location: Remote First - Global (Remote/On-site Options Available - Pune & Chennai for Engineering, Product in India, Mumbai for Sales, M ...
-
Data Engineer
3 days ago
Provision People Pune, IndiaSummary: · Our award-winning client is seeking a Data Engineer to join their team.We are looking for Data Engineers to join our growing Data Infrastructure team. In this role, you will play a key role in designing, developing, and maintaining the data pipelines that power our org ...
-
Data Engineer
3 weeks ago
Persistent Systems pune, IndiaAbout Position · We are seeking an experienced Data Engineer to join our dynamic Agile/Scrum team. The ideal candidate will be responsible for developing SQL AWS Glue and python. · Role : Data Engineer · Location : All PSL Locations · Experience : 5- 10 years · Job Type : F ...
-
Data Engineer
3 weeks ago
Xplor Pune, India Full timeJob Description · About the opportunity · At Xplor, the Central Technology Team has one main purpose: to enable and complement the business strategies and goals while solving real problems for our customers and users. · We have dozens of applications in our everyday-life vertical ...
-
Data Engineer
3 weeks ago
Russell Tobin pune, IndiaThe Data Engineer is part of a Corporate Analytics SWAT team responsible for supporting data and analytics solutions for MMC Corporate Functions. This individual will collaborate with analytics team to design and implement MMC corporate data strategy, ensuring reliable data infra ...
-
Data Engineer
3 weeks ago
Global Pharma Tek Pune, IndiaMandatory Skills · - AWS Services,Data Engineer Python,SQL,Redshift.Description: We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experie ...
-
Data Engineer
1 week ago
Synechron Pune, IndiaGoodday, · We have immediate opportunity for Data Engineer. · Job Role: · Data Engineer · Job Location: · Pune Hinjewadi · Experience · 5 to 8 Years. · Notice Perod : Upto 15 days preferred. · About Company: · At Synechron, we believe in the power of digital to transform business ...
-
Data Engineer
3 weeks ago
Tata Technologies Pune, IndiaPosition :- Data Engineer (Snowflake) Location :- Pune Exp. Rane :- 4-6 years Must Have: 4-6 Years Overall experience 4+ years of experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc. 3+ years of proven experienc ...
Data Engineer - Pune, India - YASH Technologies
![YASH Technologies background](https://contents.bebee.com/companies/in/yash-technologies/background-MFcq4.png)
Description
Job DescriptionMasters / Bachelors Degree in Computer Science, Information Technology or other relevant fields.
Minimum 2 + Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies:
Analytics Services:
Athena, Glue, DynamoDB, Redshift, Kinesis, Lambda
Responsibilities :
You will be responsible to understand the client requirement and architect robust data platform on AWS cloud technologies and Databricks.
Accountability :
Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team.
Collaboration:
Participates in team activities and reaches out to others in team to achieve common goals.
Agility:
Demonstrates a willingness to accept and embrace differing ideas or perceptions which are beneficial to the organization.
Customer Focus:
Displays awareness of customers stated needs and gives priority to meeting and exceeding customer expectations at or above expected quality within stipulated time.
Communication:
Targets communications for the appropriate audience, clearly articulating and presenting his/her position or decision.
Drives Results:
Sets realistic stretch goals for self & others to achieve and exceed defined goals/targets
At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.
We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.
Our Hyperlearning workplace is grounded upon four principlesFlexible work arrangements, Free spirit, and emotional positivity
Agile self-determination, trust, transparency, and open collaboration
All Support needed for the realization of business goals,
Stable employment with a great atmosphere and ethical corporate culture