- 5+ years of relevant technical experience working with various data engineering methodologies such as data integration and data pipelines (ETL/ELT) to activate against data at scale.
- 3+ years of experience with search technologies such asAlgolia, ElasticSearch, etc.
- 3+ years of experience of data modeling for analytic projects activities that include design, curation, and management of large datasets.
- 3+ years of experience a developing on big data technologies with Spark and Hive, preferably leveraging such as DataBricks, Juypter notebooks, orGCP, AWS, and Azure equivalent technology.
- 2+ years of experience data solution design for data engineering pipelines
- Strong Experience building event driven systems using cloud technology: storage, Pub/Sub, cloud functions, API's, and DataProc.
- Expertise with databases such asMySQL, Postgres, DynamoDB, BigQuery, Snowflake, and Synapse designing schema and dimensional data modeling.
- Experience with cloud technologies such as AWS Lambda, Kinesis, Azure Functions, EventGrid, etc.
- Experience leveraging RESTful web services to collect and publish data.
- Experience in software engineering development and testing life cycles using Python and other programming languages.
- Bachelor's degree in Computer Science, Mathematics, or other technical field or equivalent work experience. Advanced degree a plus
- Architect, develop and implement end-to-end complex data projects and technical solutions through translating business requirements into technical solutions and data-flow architectures.
- Architect, build and automate data pipelines that clean, transform, and aggregate unorganized data into data sources ready for customer-facing applications to use efficiently and teams to use for analysis.
- Use expertise to apply various analytic methods to discover and interpret information about customer behavior from multiple data sources to implement analytics solutions.
- Use expertise in database design to implement and operate stable and scalable dataflows.
- Provide subject matter expertise for multiple projects concurrently through all phases of the development lifecycle.
- Develop, enhance, govern, and administer for data platform to: collect data, transform, enrich, unify, segment, and integrate data.
- Strong adherence to data ethics rules around PII data sets.
Senior Data Engineer - Bengaluru, India - Giant Eagle, Inc.
Description
Senior Software Data Engineer
Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much
more than an employee. You are part of the Family.
About the Company
Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private
corporations in the U.S. and one of the country's largest food retailers and distributors. With more than 37,000 Team Members and $9.7billion in revenue, we are committed to investing in people, technology, and data to elevate our customer's experience across multiple touchpoints. It helps us follow on our commitment to serving others and improving our communities.
About Giant Eagle Bangalore
The Giant Eagle GCC in Bangalore is our global capability center. Our team of more than 150 members at the GCC enables us to expand internal capabilities in the areas such as data analytics, merchandising and eCommerce, quality engineering, and automation to generate insights for faster decision-making and help us accelerate our business strategy. Our team in India plays a pivotal role in helping the company transition to new ways of working by redefining the food and grocery shopping experience for over 4.6 million customers. We're building a suite of products, across several different retail businesses - eCommerce and logistics-based (mobile & web). We're driven by customer needs and creatively looking to introduce new products and innovate.
Summary tech stack:
As a Senior Software Data Engineer on the Front End Digital team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of customer facing applications as well as analytics for internal teams and business. This leading technical and architecture role will collaborate with product managers, architects, technology teams, analysts, marketing operations specialists, and monetization business partners to understand capabilities and that will be brought to life for Giant Eagle's 4M+ customers.
Responsibilities:
Role Requirements: