- Help design the Data Lake implementation based primarily on Azure services such as Fabric, OneLake, Azure Data Warehouse, ADF, Power Automate, etc..
- Collaborate with IT on location of data lake implementation within overall Azure landscape, leveraging IT services for security architecture, resource tagging, consumption reporting, cost management etc..
- Administer and operate the data lake, overseeing utilization, optimization, administration, cost management and internal operational reporting
- Utilize scripting and development skills in languages such as Python, Java, and other relevant languages to enhance data processing and manipulation.
- Demonstrate expertise in Azure services, ensuring efficient data storage, data ingestion, data transformation, and data analytics.
- Work with Terraform to provision and manage cloud infrastructure in Azure.
- Implement GitHub Actions for automated workflows and integrations.
- Develop and integrate APIs to enable smooth data communication and interaction with external systems.
- Strong knowledge and experience with Azure services, including AKS, Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics.
- Proficiency in continuous integration and continuous deployment (CI/CD) methodologies and tools.
- Solid scripting and development skills, with expertise in Python and Java.
- Experience with Terraform for managing cloud infrastructure.
- Familiarity with GitHub Actions for automated workflows and integrations.
- Understanding of API development and integration.
- Excellent problem-solving abilities and a proactive approach to troubleshooting and optimising data engineering processes.
- Strong communication skills and the ability to work collaboratively in a team environment.
- Previous experience in designing and implementing data engineering solutions in a cloud environment.
-
Senior Platform Engineer
Found in: Talent IN 2A C2 - 4 days ago
PureSearch Anywhere in India/Multiple Locations/Pune permanentAbout Company : · Client is on a mission to change how the US healthcare industry deals with provider data. Our goal is · to reduce the cost of healthcare by streamlining access to provider data and reduce administrative · and regulatory burden on healthcare organizations. · They ...
-
AI Platform Engineer
Found in: Talent IN 2A C2 - 5 days ago
Arting Digital Anywhere in India/Multiple Locations/Bangalore permanentThis is a remote position. · Our Interest : · We are seeking a talented and motivated backend engineer to join our team. The ideal candidate will have experience working with Python, Django, and building REST APIs, as well as knowledge of Kafka, ORM queries, relational and NoSQL ...
-
Power Platform Engineer
Found in: Talent IN 2A C2 - 5 days ago
Forward Eye Technology Anywhere in India/Multiple Locations permanentRolew : Power Platform · Job Description : · - Must have 6+ years of experience in the requirement analysis, design, development, and implementation of Applications. · - Must have 3+ years of experience in Power Platform. · - Good to have experience in Azure and .Net · - Strong c ...
-
Solution Architect
Found in: Talent IN 2A C2 - 5 days ago
Orion Innovation Anywhere in India/Multiple Locations permanentJob Responsibilities: · - Team Leadership: Lead and manage a diverse team of engineers (Data, Application, DevOps, and QA Engineers), providing guidance, mentoring, and support to ensure high performance and continuous improvement. · - Engineering Delivery: Drive the successful ...
-
Azure Databricks Engineer
Found in: Talent IN 2A C2 - 5 days ago
Talent-Max Consultant Anywhere in India/Multiple Locations permanentExperience: 4-7 Years · Location : Bhilai, Indore, Bangalore · Job Description : · We are seeking a skilled DataBricks Engineer to join our team. In this role, you will be responsible for engineering reliable data pipelines for sourcing, processing, distributing, and storing data ...
-
Data Engineer
Found in: Talent IN 2A C2 - 4 days ago
Mobile Programming LLC Anywhere in India/Multiple Locations/Bangalore permanentJob Description : · Position : Data Engineer · Experience : 6+ years · Work Mode : Work from Office · Location : Bangalore · Experience in Nifi or Tibco is mandatory. · Mandatory Skills : ETL, DevOps platform, Nifi or Tibco · Please note : This position is focused on development ...
-
Artificial Intelligence Lead Engineer
Found in: Talent IN 2A C2 - 5 days ago
CP360 INDIA PRIVATE LIMITED Anywhere in India/Multiple Locations/Bangalore/Kerala permanentAI Lead Engineer - NLP/LLM/ML · Job Description : · The candidate we are looking for : · We are looking for an experienced AI lead engineer with a minimum of 5+ years of experience. · Primary Responsibilities : · - Partner with product managers and product owners to understand bu ...
-
Senior Software Development Engineer
Found in: Talent IN 2A C2 - 5 days ago
Talent500 Anywhere in India/Multiple Locations permanentAt Ford Motor Credit Company, we believe freedom of movement drives human progress. We also believe in providing you with the freedom to define and realize your dreams. With our incredible plans for the future of mobility, we have a wide variety of opportunities for you to accele ...
-
Principal DevOps Engineer
Found in: Talent IN 2A C2 - 5 days ago
Direction HR Solutions Anywhere in India/Multiple Locations permanentRole : Principal DevOps Engineer · Exp : 6+ Years · Location : Full Time Remote · Job description : · A technical, hands-on Principal DevOps Engineer who can implement and support a world- class service to provide our customers with an always-on, state-of-the-art, automated SaaS ...
-
Database Engineer
Found in: Talent IN 2A C2 - 5 days ago
True Tech Professionals Private Limited Anywhere in India/Multiple Locations permanentPosition : Database Engineer · About Us : · Join our innovative Data Center of Excellence group, a collaborative team dedicated to maintaining database standards, implementing best practices, and ensuring high availability for all transactional database clusters on our cloud plat ...
-
Data Engineer
Found in: Talent IN 2A C2 - 5 days ago
Forward Eye Technology Anywhere in India/Multiple Locations permanentJob Description : · Overview : · As a Data Engineer specializing in Azure Data Platform, you will be responsible for designing, building, and maintaining data solutions on Microsoft Azure. Your expertise in data modeling, ETL/ELT processes, and tools such as Azure Data Factory (A ...
-
Data Engineering Lead
Found in: Talent IN 2A C2 - 4 days ago
VAST Consulting Anywhere in India/Multiple Locations permanentJob Description : · Should have 8+ years of working experience. · - Bachelor's or Master's degree in Computer Science, Engineering, or related field. · - Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions. ...
-
Senior Data Engineer
Found in: Talent IN 2A C2 - 5 days ago
VAST Consulting Anywhere in India/Multiple Locations permanentJob Description : · Should have 5+ years of working experience. · - Bachelor's or Master's degree in Computer Science, Engineering, or related field. · - 5+ years of experience in a data engineering role with strong understanding of graph databases, streaming and batch analytics, ...
-
Big Data Developer
Found in: Talent IN 2A C2 - 5 days ago
Risk Resources LLP Anywhere in India/Multiple Locations permanentResponsibilities : · - Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP · - Define the technical vision and roadmap for big data architecture within the organization · - Architect and implement scalable, high-performan ...
-
Technical Product Manager
Found in: Talent IN 2A C2 - 5 days ago
VAST Consulting Anywhere in India/Multiple Locations permanentMartech/CDP industries experience is mandatory · Note : · Person should have started career in development then moved into product management. · - He/she will be responsible for supporting the senior product team, Engineering team and would be willing to take on significant resp ...
-
Data Engineer
Found in: Talent IN 2A C2 - 5 days ago
Rocket Consulting Anywhere in India/Multiple Locations/Pune permanentA Data Engineer/developer having good experience working with · Primary skills : Python, AirFlow - ETL skills - GCP · Secondary skills : Google Cloud Composer - Google Big Query - Google Cloud · - Storage - SQL - MS SQL Serve · - Proven experience as a Data Engineer/Developer wit ...
-
Senior SailPoint Developer
Found in: Talent IN 2A C2 - 5 days ago
Valarr Anywhere in India/Multiple Locations permanentJob Description : · The Sr. SailPoint Engineer with 6 to 8 years is responsible for designing, programming, implementing and maintaining the Sailpoint application that provides Identity and Access Management · - They work closely with other Information Security Engineers to archi ...
-
Senior AWS Cloud Engineer
Found in: Talent IN 2A C2 - 4 days ago
Unijob Solution & Training Pvt Ltd Anywhere in India/Multiple Locations/Bangalore permanentJob Role : Senior AWS Cloud Engineer. · Exp : 5 to 10 Year. · Location : Pune. · Package : 15 to 20 LPA. · Notice Period : Immediate to 30 Days. · Job Description : · Responsibilities : · - Design, implement, and maintain cloud-based solutions on the Google Cloud Platform (GCP). ...
-
Azure Data Engineer
Found in: Talent IN 2A C2 - 5 days ago
DEVENIR SOFTWARE PRIVATE LIMITED Anywhere in India/Multiple Locations permanentPosition : Azure Data Engineer · Experience : 4 to 12+ years · Relevant 5+ Exp is must · Location : Pan India · Fulltime role · Immediate : · - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform · - Develop and implement data solutions using Azu ...
-
AWS DevOps Architect
Found in: Talent IN 2A C2 - 4 days ago
Move Forward Technologies Pvt. Ltd. Anywhere in India/Multiple Locations permanentMandatory Skills: Linux, CloudFormation, Infrastructure as Code (using CDK , ARM, Terraform), AWS Services (including EC2, ELB, ASG, VPC, S3, CloudWatch, CloudFormation, CloudTrail, ECS, and EKS), DHCP, DNS, NGINX, HA-Proxy, Docker, Kubernetes, Helm, DB technologies (such as Cass ...
Azure DataLake Platform Engineer - Anywhere in India/Multiple Locations - LotusOne Talent Solutions
Found in: Talent IN 2A C2 - 5 days ago
Description
Job Description :
Required Skills and Qualifications :
Preferred Qualifications :