Data Engineer - Sany, India - Careernet Technologies Pvt Ltd

Description

Responsibilities:DataStrategy and Alignment Work closely withdata analysts and business / product teams to understandrequirements and providedata ready foranalysis and reporting.

Apply help defineand champion data governance:
data quality testing documentationcoding bestpractices and peerreviews. Continuously discover transformtest deploy and document data sources and datamodels. Work closely with the Infrastructureteam to build and improve our DataInfrastructure. Develop and execute dataroadmap (and sprints) with a keen eye on industry trends anddirection.

DataStores and System DevelopmentDesign and implement highperformance reusable and scalable datamodels for our data warehouse toensure ourendusers get consistent and reliable answers when running their ownanalyses. Focus on test driven design andresults for repeatable and maintainable processes andtools. Create and maintain optimal datapipeline architecture and data flow loggingframework. Build the data products featurestools and frameworks that enable and empower Data andAnalyticsteams acrossPorter.

ProjectManagement Drive projectexecution using effective prioritization and resourceallocation. Resolve blockers throughtechnical expertise negotiation anddelegation. Strive for ontime completesolutions through standups andcoursecorrection.

TeamManagement Manage and elevateteam of 58 members. Do regular oneononeswith teammates to ensure resource welfare.
Periodic assessment and actionable feedback forprogress. Recruit new members with a view tolongterm resource planning through effective collaboration withthehiringteam.

Processdesign Set the bar for thequality of technical and databased solutions the teamships. Enforce code quality standards andestablish good code review practices using this as a nurturingtool. Set up communication channels andfeedback loops for knowledge sharing and stakeholdermanagement. Explore the latest bestpractices and tools for constantupskilling.

DataEngineering Stack: Analytics:Python / R / SQL Excel / PPT Google ColabDatabase: PostgreSQL Amazon Redshift DynamoDB

Aerospike Warehouse:
RedshiftS3


ETL:
Airflow DBT Custommade PythonAmundsen (Discovery)

Business Intelligence /Visualization:
Metabase Google Data StudioFrameworks: Spark Dash StreamLitCollaboration: GitNotion

Requirements:Industry experience of minimum 7 years (5 years in data engineeringrole) Experience managing a team of at least4 developers endtoend Strong handson datamodeling and data warehousing skills Strongtechnical background and ability to contribute to design andreview Strong experience applying softwareengineering best practices to data and analytics scope (e. g.versioncontrol testing andCI/CD) Strong attention to detail tohighlight and address data quality issuesExcellent time management and proactive problemsolving skills tomeet critical deadlines Familiarity(expertise preferred) with our current or a similar analyticsstack
etl,datawarehousing,snowflake,sql,python,cloud,dataengineering