Senior Data Engineer - Hyderabad, India - Skillsoft

    Skillsoft
    Skillsoft Hyderabad, India

    2 weeks ago

    Default job background
    Description
    At Skillsoft, we propel organizations and people to grow together through transformative learning experiences. We believe every team member has the potential to be AMAZING. Join us in our quest to transform learning and help individuals unleash their edge.


    OVERVIEW
    :

    Reporting to the Sr.

    Director, Enterprise Data Strategy & Execution; the Sr Data Engineer role will support the data organization, structure and processing of the central data warehouse through maintaining and evolving the pipeline of data into the data warehouse.

    The Sr.

    Data Engineer is a key member of the Enterprise Data Strategy & Execution team, accountable for accurate ingestion and the development of data architecture to support enterprise business needs and exploratory, statistical and predictive analytics.


    OPPORTUNITY HIGHLIGHTS:

    ​Lead the identification of business data requirements, create data models and design processes that align to the business logic and regularly communicate with business stakeholders to ensure delivery meets business needs.

    Design ETL processes, develop source-to-target mappings/integration workflows and manage load processes to support regular and ad hoc activities considering the needs of down-stream systems, functions and visualizations.

    Work with the latest open source tools, libraries, platforms and languages to build data products enabling other analysts to explore and interact with large and complex data setsBuild robust systems and reusable code modules to solve problems across the team and organization with an eye on the long term maintenance and support of the applicationPerform routine testing of own and others work to guarantee accurate, complete processes that support business needs.

    Awareness and compliance with all organizational development standards, industry best practices and business, security, privacy, and retention requirements.
    Routinely monitor performance, diagnose and implement tuning/optimization strategies to guarantee a highly efficient data structure.

    Partner with Product Owners and cross functional teams in a collaborative and agile environmentCollaborate with other engineers through active participation in code reviews and challenge the team to deliver with precision, consistency and speed.

    Document data flows and technical designs to ensure compliance with organization, business and security best practices.
    Regularly monitor timelines and workload. Ensure delivery promises are met or exceeded.
    Ability and willingness to support the BI mission through learning new technologies and supporting other projects as needed.

    ​SKILLS & QUALIFICATIONS:

    ​5+ years of experience in Data Engineering/Data Management space and working with enterprise level production data warehouses.2+ years of experience in building cloud data applications (data lake, cloud data warehouse, cloud analytical servers.) & Deep understanding of cloud computing (Azure preferred)3+ years' experience with a data engineering programming language (e.g. Python, R, Spark etc)3+ years of proven SQL Server experience building and supporting Data Warehouse structures and supporting end user reporting tools such as Tableau/Power BI/SSRSAbility to work and potentially lead in an Agile methodology environment.

    Experience and interest in cloud migration/journey to the cloud for data platforms and landscapeStrong business acumen, analytical skills, and technical abilitiesPractical problem-solving skills and ability to move complex projects forward.

    Preferred Qualifications3+ years' experience using data visualization tools (e.g. Tableau, or similar tools)Experience with Cloud computing and/or DevOp