- Design/Strategy: The Senior Data Engineer designs and supports the business's database and table schemas for new and existing data sources for the ESL. Creates and supports the pipelines in order to facilitate the accommodation of data into the ESL. In this capacity, the Senior Data Engineer designs and develops systems for the maintenance of the business's data warehouse, ETL processes, Data Pipelines and business intelligence.
- Collaboration: The role that the Senior Data Engineer plays is highly collaborative and, as such,works closely with data analysts, data scientists, and other data consumers within the business in an attempt to gather and populate ESL table structure, which is optimized for reporting. The Senior Data Engineer also works closely with other disciplines/departments and teams across the business in coming up with simple, functional, and elegant solutions that balance data needs across the business
- Analytics: The Senior Data Engineer plays an analytical role in quickly and thoroughly analyzing business requirements for reporting and analysis and subsequently translating the emanating results into good technical data designs. In this capacity, the Senior Data Engineer establishes the documentation of reports, develops, and maintains technical specification documentation for all reports and processes.
- Operations: The Senior Data Engineer plays a crucial role in maintaining and supporting Business Operations by ensuring the data pipelines are running on schedule and the data is available. The business requests need to be supported and the engineer will be in roster for the operations.
- 5+ years of related experience with a Bachelor's degree; equivalent work experience.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of NO SQL databases.
- Advanced working experience in Azure environment inclusive of Azure Data factory, Azure Databricks, Azure Datalake, Azure DevOps.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets. In depth knowledge of Model and Design of DB schemas for read and write performance.
- Extensive working knowledge of API or Stream based data extraction processes like Oracle ERP API and Bulk API is must.
- Experience supporting and working with cross-functional teams in a dynamic environment across geographies.
- Experience with building data pipeline from various business applications like Oracle ERP, Salesforce, Workday, Cfin, etc.
- Experience with big data tools: Azure Data factory, Databricks, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
- Knowledge of BI Tools like Tableau, Looker etc
Senior Data Engineer - Bengaluru, India - Giant Eagle GCC
Description
Sr Data Engineer Data Analytics
Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.
About the Company
Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country's largest food retailers and distributors. With more than 37,000 Team Members and $9.7billion in revenue, we are committed to investing in people, technology, and data to elevate our customer's experience across multiple touchpoints. It helps us follow on our commitment to serving others and improving our communities.
About Giant Eagle Bangalore
The Giant Eagle GCC in Bangalore is our global capability centre. Our team of more than 350 members at the GCC enables us to expand internal capabilities in the areas such as data analytics, merchandising and eCommerce, quality engineering, and automation to generate insights for faster decision-making and help us accelerate our business strategy. Our team in India plays a pivotal role in helping the company transition to new ways of working by redefining the food and grocery shopping experience for over 4.6 million customers.
Summary:
You will influence technological decision-making for business teams future data, analysis, and reporting needs. The role supports the business's daily operations inclusive of troubleshooting of Enterprise Semantic Layer (ESL) environment and job monitoring. You will guide the business in identifying data needs and delivering mechanisms for acquiring and reporting such information and addressing the actual needs. You will gather and maintain best practices that can be adopted in big data stacking and sharing across the business. You will provide expertise to the business regarding data analysis, reporting, data warehousing, and business intelligence. You will report to the Director, intelligent Automation Data Analytics.
The impact you will have:
What we look for: