VARUN GOYAL

14+ years of expertise in architecture definition of large distributed systems, technical consulting, project management and technology implementation in Cloud, Big Data, Hadoop, Enterprise Information Management, Data Management, Product Management, People Management and Application integration.

Summary

Worked as a Solution Architect crafting the design and architecture of data

analytics platform based on Big Data ecosystem. The product facilitates users to

reduce the data analysis time cost up to 40%. It also has the capability to

configure customs analysis within a day TAT.

The product framework features Data acquisition, ingestion, storage,

processing, Governance & Data visualization with capability of self-service

analytics.  A scalable cloud Solution which enables “Speed – Precision – Actions”.

Conceptualize, complete prototyping, and finalize the product tech stack and

roadmap from scratch. Leading & architecting the entire lifecycle of the product –

Pricing Strategy, Hiring Strategy, Vendor Management, Stakeholder Management,

ROI identification.

Currently working as a Solution architect for Pharma Major in UK. Designing the

data and Solution architecture for Single view of Patient Golden customer records,

LTV and Churn statistics.

Designed and implemented financial and operational EDW and data marts for the

Smart Cities Dubai Government.

Established data architecture and best practices, Data Governance, Data Quality standards in data lake/data warehouse (Cloud and In-prem).

Designed Cost effective solutions by following recommended standard frameworks.

Extensive experience in Migrating legacy big data ecosystems to Modern Data Platform, Hybrid cloud, DR, CICD Setup, Security & Compliance Setup.

Worked with the Sales team to respond to prospect and partner enquiries including RFI’s and RFP’s.

Designed complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools.

Excellent documentation and communication skills with an ability to clearly articulate complex IaaS/PaaS/SaaS concepts to people new to cloud development engineer team.

Technical Skills

Big data , AWS Big Data & Azure Big Data ,Data Lake, Big Data Analytics, DWH & Visualization 

BIG Data Technologies/Hadoop technologies Spark,PySpark,Hive, Impala,HBASE,OOZIE,Map Reduce,Cloudera and   Horton work distributions

Data Platforms: AWS,HDP ,CDH,DataBricks,SnowFlake

Data Streaming: AWS Kinesis, Azure EventHub

AWS Services: EC2, S3, ATHENA, LAMBDA, Glue, Redshift, Redshift spectrum, RDS, AWS CLI,Step function 

Elastic Search/ELK Stack ELK stack, Kibana

Azure Services: ADLS Gen2, Synapse, DataBricks, Data Factory 

Data Visualization: QuickSight,Power BI

Security: IAM Service, kerberos,SSH

Databases (SQL and NO-SQL): Postgres, Oracle,Sql Server ,Red shift, Aurora , Dynamo DB                      

Monitoring: AWS Cloud Watch, AWS Cloud Trail

Data Governance: Cloudera Navigator, Horton works Atlas

CICD: Jenkins, GITHUB,BIT BUCKET

ETL Tools:  Informatica BDM, Informatica Power Centre, Stream Set, INFORMATICA CLOUD                                

Scripting/Programming: Java, Python,Unix Shell scripting

B.E(Electrical and Electronics) -BMSIT College,Bangalore-2007