Data Engineer - New Delhi, India - ICF

    ICF
    ICF New Delhi, India

    1 week ago

    Default job background
    Description
    ICF (


    NASDAQ:
    ICFI) is a global consulting services company with over 9,000 full- and part-time employees, but we are not your typical consultants. At ICF, business analysts and policy specialists work together with digital strategists, data scientists and creatives. We combine unmatched industry expertise with cutting-edge engagement capabilities to help organizations solve their most complex challenges. Since 1969, public and private sector clients have worked with ICF to navigate change and shape the future.

    Learn more at are looking for a Data Engineer to assist ICF in contributing to the development of innovative, accurate, timely, and high-quality products and services, typically working on multiple projects with all levels of staff.

    You will have the opportunity to apply academic knowledge, gain exposure to major projects, and interact with experts and clients in the field while building content knowledge and consulting skills.

    Location - New Delhi

    Key Responsibilities:1.

    Data Acquisition and Processing:
    Extract, transform, and load (ETL) data from various sources including ISOs and public regulatory agencies.
    Develop and maintain web scrapers to gather real-time power market analytics.
    Implement RESTful services to fetch data and handle asynchronous tasks efficiently.2.


    Data Warehousing and Optimization:
    Design and manage data warehouse solutions using Azure Data LakeStreamline data processes to ensure fast and reliable access to clean and accurate data

    3 Cloud-Based ETL Development:
    Design, build, and optimize ETL jobs leveraging Azure services.
    Integrate with various Azure services to enhance the data pipeline's scalability and resilience.4.


    Collaboration and Communication:
    Work closely with data SMEs, analysts, and stakeholders to ensure data availability and accuracy.
    Provide documentation and share knowledge on developed pipelines with the team.5.


    Continuous Improvement:
    Keep abreast of the latest developments in Azure services and the power markets domain.
    Proactively identify opportunities for process improvements and introduce best practices.


    Basic Qualifications:


    Bachelor's degree in Computer Science, Data Science, Operations Research, Engineering, or a related field.2+ years of minimum experience in power markets or any other quantitative advisory roleFamiliarity with the Power markets and Energy Policy.

    Proven experience in web scraping, data warehousing, and streamlining data.
    Hands-on experience with RESTful service development and asynchronous functions.
    Prior experience in building and optimizing ETL jobs on cloud platforms.


    Preferred Qualifications:


    Extensive experience with Azure services, including but not limited to AKS, Azure Batch, Azure Data Factory, Azure Data Lake, Azure Functions, and Azure Blob Storage.

    Strong understanding of distributed systems and cloud-based architectures.
    Knowledge and experience with Operations Research techniques such as Linear Programming, Integer Programming, Nonlinear Programming, and other optimization models. Familiarity with tools like CPLEX, Gurobi, or similar optimization solvers is a plus.
    Demonstrated ability to apply OR techniques to real-world problems.
    Excellent problem-solving skills, combined with the ability to work in fast-paced environments.