Jobs
>
Data Engineer
>
Pune

    Data Engineer - Pune, India - YASH Technologies

    YASH Technologies background
    Description
    Job Description

    Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields.

    Minimum 2 + Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies:


    • AWS Data &

    Analytics Services:
    Athena, Glue, DynamoDB, Redshift, Kinesis, Lambda


    • Databricks Lakehouse Platform
    • PySpark, Spark SQL, Spark Streaming
    • Experience with any NoSQL Database
    • 2+ year of coding experience with modern programming or scripting language (Python).
    • Expert-level skills in writing and optimizing SQL.
    • Experience operating very large data warehouses or data lakes/ data platform.
    • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
    • Data Modelling, star schema, derivative, measures
    • Experience of working in Agile delivery
    • Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, and testing.
    • Excellent business and communication skills to work with business owners to understand data requirements.

    Responsibilities :


    You will be responsible to understand the client requirement and architect robust data platform on AWS cloud technologies and Databricks.


    • You will be responsible for identifying and creating reusable data solutions (accelerators, MVP)
    • You will be responsible for creating reusable components for rapid development of data platform
    • Work closely with the Product Owners and stake holders to design the Technical Architecture for data platform to meet the requirements of the proposed solution.
    • Work with the leadership to set the standards for software engineering practices within the Data engineering team and support across other disciplines
    • Play an active role in leading team meetings and workshops with clients.
    • Delivering and presenting proofs of concept to of key technology components to project stakeholders.
    • Educate clients on Cloud technologies and influence direction of the solution.
    • Choose and use the right analytical libraries, programming languages, and frameworks for each task.
    • Help us to shape the next generation of our products.
    • Explore and learn the latest AWS Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.
    • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Databricks, Spark, DynamoDB, RedShift, Kinesis, Lambda, Glue, Athena.
    • Analyze, re-architect and re-platform, migrate on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
    • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python, PySpark, Databricks.
    • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
    • Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud & Databricks.
    • Build and deliver high quality data architecture to support business analyst, data scientists, and customer reporting needs.
    Required Behavioral Competencies

    Accountability :

    Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team.


    Collaboration:
    Participates in team activities and reaches out to others in team to achieve common goals.

    Agility:
    Demonstrates a willingness to accept and embrace differing ideas or perceptions which are beneficial to the organization.

    Customer Focus:


    Displays awareness of customers stated needs and gives priority to meeting and exceeding customer expectations at or above expected quality within stipulated time.


    Communication:
    Targets communications for the appropriate audience, clearly articulating and presenting his/her position or decision.

    Drives Results:
    Sets realistic stretch goals for self & others to achieve and exceed defined goals/targets

    At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.

    We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

    Our Hyperlearning workplace is grounded upon four principles

    Flexible work arrangements, Free spirit, and emotional positivity
    Agile self-determination, trust, transparency, and open collaboration
    All Support needed for the realization of business goals,
    Stable employment with a great atmosphere and ethical corporate culture

  • Xcelyst

    Data Engineer

    2 weeks ago


    Xcelyst Pune, India

    Role : Data Engineer - Nifi · Experience : 5 Years - 8 Years · Notice period : Immediate - 30 days · Skills : Experience in Nifi and Data Engineering (Pyspark, SQL, ETL). · Secondary : Big Data/Hadoop, Hive, Spark · 4+ Years in Data Engineer/1-2 yrs exp in Nifi · We are seekin ...

  • Persistent Systems

    Data Engineer

    3 weeks ago


    Persistent Systems pune, India

    About Position · As a Data Engineer, you will be responsible for design and implementation of data pipelines, deploy models, build applications and integrations to Healthcare Domain & Data Standards. Good knowledge of public cloud such as AWS, System Engineering and Azure is pr ...

  • Worldline

    Data Engineer

    3 weeks ago


    Worldline Pune, India

    Data Engineer M2C · Pune · This is Worldline · We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop ...

  • PURVIEW

    Data Engineer

    5 days ago


    PURVIEW Pune, India

    Purview is hiring Data Engineer with one of our valued clients. If you're interested, please reply for more details. · Job Details: · Role: Data Engineer · Location: Pune/Hyderabad · Duration: Permanent with Purview · We are looking for 5+ years with Python/PySpark · Job Descript ...

  • Volante Technologies

    Data Engineer

    5 days ago


    Volante Technologies Pune, India

    ****Immediate joiners only*** · Company Description: Volante is on the Leading Edge of Financial Services technology, if you are interested to be on an Innovative fast-moving team that leverages the very best in Cloud technology our team may be right for you. · By joining the pro ...

  • Capleo Global

    Data Engineer

    2 days ago


    Capleo Global Pune, India

    Data Engineer - AWS · Experience: 6+ Years · Location: Pune · We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experience with AWS servic ...

  • Tech Mahindra

    Data Engineer

    3 weeks ago


    Tech Mahindra Pune, India

    GCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage, · Strong python programming experience in using Google Cloud python client libraries, · Strong SQL and data analysis skills, · Proficient ETL/ELT experience in workflows, data modelling and data pip ...

  • Huquo

    Data Engineer

    3 weeks ago


    Huquo pune, India

    Position : Snowflake DE · Location : Pune, Gurgaon · Experience : 6-9 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of ...

  • G.A. Design & Business (DBS)

    Data engineer

    3 weeks ago


    G.A. Design & Business (DBS) Pune, India

    Work with data engineering tasks in the scope of industrial processes ( data standardization, cloud storage and integration within Antolin Big Data platform) · Work with several sources of data and create advanced monitoring views for different kind of users. · Grafana Programm ...

  • Hiringhood

    Data Engineer

    3 weeks ago


    Hiringhood Pune, India

    Primary Skills : DynamoDB, Java, Kafka, Spark, Amazon Redshift, AWS Lake Formation, AWS Glue, Python · Job Description : · - Good work experience showing growth as a Data Engineer. · - Hands On programming experience · - Implementation Experience on Kafka, Kinesis, Spark, AWS Glu ...

  • HyrEzy Talent Solutions

    Data Engineer

    3 weeks ago


    HyrEzy Talent Solutions Pune, India

    Job Description and Responsibilities : · Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process. · Analyze and document above requirements and data definitions, perform data analysis, assist in change mana ...

  • YASH Technologies

    Data Engineer

    3 weeks ago


    YASH Technologies pune, India

    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. · At YASH, we're a cluster of the brightest st ...

  • hushh

    Data Engineer

    5 hours ago


    hushh Pune, India

    Job Title: Data Engineer & Web Crawler - Revolutionizing Data Accessibility with AI · Company: Hushh Intelligence Inc. · Job Type: Full-Time · Location: Remote First - Global (Remote/On-site Options Available - Pune & Chennai for Engineering, Product in India, Mumbai for Sales, M ...

  • Provision People

    Data Engineer

    3 days ago


    Provision People Pune, India

    Summary: · Our award-winning client is seeking a Data Engineer to join their team.We are looking for Data Engineers to join our growing Data Infrastructure team. In this role, you will play a key role in designing, developing, and maintaining the data pipelines that power our org ...

  • Persistent Systems

    Data Engineer

    3 weeks ago


    Persistent Systems pune, India

    About Position · We are seeking an experienced Data Engineer to join our dynamic Agile/Scrum team. The ideal candidate will be responsible for developing SQL AWS Glue and python. · Role : Data Engineer · Location : All PSL Locations · Experience : 5- 10 years · Job Type : F ...

  • Xplor

    Data Engineer

    3 weeks ago


    Xplor Pune, India Full time

    Job Description · About the opportunity · At Xplor, the Central Technology Team has one main purpose: to enable and complement the business strategies and goals while solving real problems for our customers and users. · We have dozens of applications in our everyday-life vertical ...

  • Russell Tobin

    Data Engineer

    3 weeks ago


    Russell Tobin pune, India

    The Data Engineer is part of a Corporate Analytics SWAT team responsible for supporting data and analytics solutions for MMC Corporate Functions. This individual will collaborate with analytics team to design and implement MMC corporate data strategy, ensuring reliable data infra ...

  • Global Pharma Tek

    Data Engineer

    3 weeks ago


    Global Pharma Tek Pune, India

    Mandatory Skills · - AWS Services,Data Engineer Python,SQL,Redshift.Description: We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experie ...

  • Synechron

    Data Engineer

    1 week ago


    Synechron Pune, India

    Goodday, · We have immediate opportunity for Data Engineer. · Job Role: · Data Engineer · Job Location: · Pune Hinjewadi · Experience · 5 to 8 Years. · Notice Perod : Upto 15 days preferred. · About Company: · At Synechron, we believe in the power of digital to transform business ...

  • Tata Technologies

    Data Engineer

    3 weeks ago


    Tata Technologies Pune, India

    Position :- Data Engineer (Snowflake) Location :- Pune Exp. Rane :- 4-6 years Must Have: 4-6 Years Overall experience 4+ years of experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc. 3+ years of proven experienc ...