- Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one.
- In-depth knowledge with respect to Snowflake and its architecture.
- provide solutioning and drive the implementation of DOPS features which includes - building IAC infra, Git Lab re-structuring, Git lab Upgrades monitoring etc.,
- Should have the vision on data strategy and able to deliver the same.
- Should be able to lead the design and implementation of data management processes, including data sourcing, integration, and transformation.
- Able to manage and lead a team of data professionals, providing guidance, mentoring and fostering a collaborative and innovative team culture focused on continuous improvement.
- To evaluate and recommend data-related technologies, tools, and platforms.
- Collaborate with IT teams to ensure seamless integration of data solutions.
- should have experience in Implementing and enforce data security protocols and ensure compliance with relevant regulations.
- Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.
- strong data warehousing experience using RDBMS and Non-RDBMS databases.
- At least 5 years of recent hands-on professional experience (actively coding) handling support & production issues.
- Professional experience working in an agile, dynamic and customer facing environment is required.
- Understanding of distributed systems and cloud technologies (AWS) is highly preferred.
- Understanding of data streaming and scalable data processing is preferred to have.
- Experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.
- Atleast 2+ years of experience in ETL (AWS Glue), Amazon S3, Amazon RDS, Amazon Kinesis, Amazon Lambda, Apache Airflows, Amazon Step Functions.
- Strong knowledge in scripting languages like Python, UNIX shell and Spark is required.
- Understanding of RDBMS, Data ingestions, Data flows, Data Integrations etc.
- Technical expertise with data models, data mining and segmentation techniques.
- Experience with full SDLC lifecycle and Lean or Agile development methodologies.
- Knowledge of CI/CD and GIT Deployments.
- Ability to work in team in diverse/ multiple stakeholder environment.
- Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams.
- Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.
- Develop tools to improve data flows between internal/external systems and the data lake/warehouse.
- Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.
- Understanding existing data applications and infrastructure architecture
- Build and support new data feeds for various Data Management layers and Data Lakes
- Evaluate business needs and requirements.
- Support migration of existing data transformation jobs in Oracle, and MS-SQL to Snowflake.
- Lead the migration of the existing data transformation jobs in Oracle, Hive, Impala etc. into Spark, Python on Glue etc.
- Able to document the processes and steps.
- Develop and maintain datasets.
- Improve data quality and efficiency.
- Lead Business requirements and deliver accordingly.
- Collaborate with Data Scientists, Architect and Team on several Data Analytics projects.
- Collaborate with DevOps Engineer to improve system deployment and monitoring process.
- Experience in critical production support and how the BAU functions is preferred.
- Ability to work in a collaborative environment and coach other team members on coding practices, design principles, and implementation patterns that lead to high-quality maintainable solutions.
- Excellent communications and stake-holder management is required.
- Ability to handle the senior leadership and report to them if required.
- Ability to work in a dynamic, agile environment within a geographically distributed team.
- Ability to focus on promptly addressing customer needs.
- Ability to work within a diverse and inclusive team.
- Technically curious, self-motivated, versatile and solution oriented.
-
Data Engineer
3 weeks ago
ADP Hyderabad, India***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...
-
Data Engineer
3 weeks ago
PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, IndiaDescription · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...
-
Data Engineer
3 weeks ago
programming Hyderabad, IndiaJob Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...
-
Data Engineer
3 weeks ago
Innova Solutions India hyderabad, IndiaJOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...
-
Data Engineer
2 weeks ago
Akrivia HCM Hyderabad, IndiaWe are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...
-
Data Engineer
3 weeks ago
Microsoft hyderabad, IndiaOverview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...
-
Data Engineer
5 days ago
WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, IndiaRoles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...
-
Data Engineer
3 weeks ago
G5 hyderabad, IndiaWe are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...
-
Data Engineer
3 weeks ago
Highspot hyderabad, IndiaWhat You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...
-
Data Engineer
1 week ago
State Street Hyderabad, India Full timeRole Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...
-
Data Engineer
3 weeks ago
Appen hyderabad, IndiaAbout Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In add ...
-
Data Engineer
1 week ago
Prudent Technologies and Consulting, Inc. Hyderabad, IndiaWe are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...
-
Data Engineer
3 weeks ago
ServCrust hyderabad, IndiaJob Title: Data Engineer · Experience Level: 3-4 years · Location: Hyderabad · Job Type: Full-time · About Us: · ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP and Fintech platform. Its ease of commerce solutions are b ...
-
Data Engineer
3 weeks ago
Aragen Life Sciences hyderabad, IndiaRole: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...
-
Data Engineer
3 weeks ago
Microsoft Hyderabad, IndiaOverview · Come join an evolving team with a growth mindset, explore your passion and do your best work. "Operations Digital Solutions" Organization under "Finance Data & Experiences" is an Org that enables digital transformation for "Microsoft Business Operations". One of the ke ...
-
Data Engineer
3 weeks ago
Nityo Infotech hyderabad, India· •More than 6 years IT experience · •Azure cloud experience is mandatory · •ADF, Databricks, Azure DE/ML cloud work experience is mandatory · •Good experience on Pyspark and Python · •atleast worked 4-5 Data engineering use cases · •should good understanding of DE concepts · •C ...
-
Data Engineer
4 weeks ago
Anblicks Hyderabad, IndiaPosition: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...
-
Data Engineer
3 weeks ago
TechnoGen India Pvt. Ltd. hyderabad, India5+ years served as Data Engineer or Data Operations role · 5+ years of experience working with SQL · Extensive experience with Microsoft Azure Data Lake, Azure Data Bricks, Spark, Spark Architecture , Data Factory, and SQL Database products or equivalent products from other clo ...
-
Data Engineer
4 weeks ago
DAZN Hyderabad, IndiaWe are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. ...
-
Data Engineer
2 weeks ago
Awign Expert Hyderabad, IndiaJob Description · About the Role · Location: Hyderabad · Timings: Full Time (As per company timings) · Notice Period: (Immediate Joiner - Required) · Duration: 6 months · Experience – 5 to 9yrs · Work Mode– WFO · Job Description · We're looking for a Data/Web Engineer who will b ...
Data Engineer - Hyderabad, India - RiskInsight Consulting Pvt Ltd
![Default job background](https://contents.bebee.com/public/img/bg-user-ex-1.jpg)
Description
Key Skills:
Required Qualifications:
Responsibilities:
Soft Skills