- At least 6 years' experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud.
- Azure Data Factory Pipelines - Create new Azure Data Factory pipelines in cloud based data warehousing systems such as Azure Synapse.
- Experience with Azure services: Azure Data Lake Gen 2, Data factory, Data Fllows, and Synapse (Azure SQL DW).
- Data Quality and Anomaly Detection - Improve existing tools (dbt cloud) to measure data quality through metrics and automatic alerting.
- Experience in working with Azure Databricks environment for data transformation.
- Experience in working with unstructured data (text) and making data available for down stream NLP analysis.
- Data Modeling - Partner with data consumers to improve existing data models and build different facets of the business for analytic use cases, Build star and snowflake schemas.
- Development of data pipelines to third party API's both internal providers and external
- Experiace in working with NoSQL data bases like MongoDB and pull data from those databases.
- Expertise building data pipelines on large complex data sets using Spark or other open source frameworks
- Expertise in a scripting language like Python (or similar) and a query language like SQL
- Knowledge of scheduling, logging, monitoring, alert frameworks
- Experience in Source/Target: ADLSGen2, PostGres DB, Azure SQL DW.
- Orchestration Using Databricks Jupyter Notebooks preferred.
- Experience working in large scale/distributed SQL, NoSQL (MongoDB) environments.
- Experience in modeling and implementing ETL / ELT on columnar MPP database technologies.
- Experience with Agile software development process.
- Proven experience deploying machine learning algorithms to production
- Demonstrated proficiency in writing high-quality and scalable code and integrating with git version control systems
- Experience leading successful data engineering projects and operationalizing machine learning algorithms
- Experience with streaming architectures e.g. Kafka, Stream, PubSub.
-
Data Engineer
1 week ago
CareerXperts Consulting IndiaWe are searching for a skilled and passionate Data Engineer to join our growing team. You will play a pivotal role in designing, building, and maintaining the data pipelines that power our analytics and machine learning initiatives. · Responsibilities: · Design, develop, and impl ...
-
Data Engineer
4 days ago
Coffeee IndiaKey Qualifications: · Experience: Minimum 5+ years of experience in data engineering or a related field. · Technical Skills: Strong expertise in PySpark, Databricks, Python, Pandas, Hadoop, and AWS data technologies. · ETL Tools: Hands-on experience with ETL frameworks and tools. ...
-
Data Engineer
3 days ago
VSquare Systems Pvt. Ltd. IndiaJob Title: Data Engineer (Azure Databricks) · Location: Bangalore / Hybrid · Job Type: Full-time · Job Description: · Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my ex ...
-
Data Engineer
1 day ago
TekJobs IndiaResponsibilities: · We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics. · In this position, you will be responsi ...
-
Data Engineer
6 days ago
Straive IndiaJob Role- AWS Data Engineer · Experience- 4 to 6 years · Mode- Remote · The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing ca ...
-
Data Engineer
4 days ago
EXL IndiaData Engineer · Location – Gurgaon, Noida, Pune, Bangalore · Candidate should be highly comfortable with python (Libraries pandas, datetime, NumPy, config parser, sys, os, Json, requests, warnings) · We don't have any cloud-based solution, our whole framework is developed with Py ...
-
Data engineer
1 week ago
P360 IndiaGreetings from P360.. · About us: · P360 is an advanced pharma software company specializing in business technology development and implementation for pharmaceutical and life sciences companies worldwide. We specialize in technology that boosts operational efficiency across the e ...
-
Data Engineer
5 days ago
Infomatics Corp IndiaPosition Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure and systems. You will collaborate closely with cross-function ...
-
Data Engineer
4 days ago
CST - Cyber Sapient IndiaAbout Us: · At Cyber Sapient Technologies, we are at the forefront of innovation, leveraging cutting-edge technologies to drive digital transformation for our clients. As a leading technology solutions provider, we empower businesses to thrive in the digital age through strategic ...
-
Data Engineer
2 days ago
ProjectPro IndiaWhat would you do? · You will be aligned with our product directly and help us generate insights by leveraging the latest Big Data tools and techniques to deliver value to our clients. · You will also help us apply your expertise in building world-class solutions, conquering bus ...
-
Data Engineer
6 days ago
Eaglytics Co. IndiaData Engineer · Job Title: Data Engineer / ETL Engineer / Google Cloud Platform Developer · Location: India · Company: Eaglytics Co. · About Us: Join Eaglytics Co: Empowering Data-Driven Innovations · At Eaglytics Co, we're a remote team with roots in Dubai, UAE, now spanning the ...
-
Data Engineer
1 week ago
Amicus Technology IndiaThis position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises. · ROLES AND RESPONSIBILITIES: · Designing, developing, and testing Azure-based applications and services that meet business and technical requirement ...
-
Data Engineer
10 minutes ago
Idyllic Services Pvt. Ltd. IndiaJob Description: · Data Engineer role is expected to own and manage end to end activities within the team. Person would be entrusted to developed solutions/design ideas related to Data Engineering, service upkeep, developing new capabilities and identify design ideas to enable th ...
-
Data Engineer
1 week ago
CORUS Consulting IndiaWHAT YOU'LL DO · Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow. · Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analy ...
-
Data Engineer
1 week ago
Adeptmind IndiaAbout Adeptmind: · Adeptmind, an innovative AI company headquartered in Toronto, Canada, specializes in revolutionizing retail search experiences. Powering eCommerce search for major global retailers such as Staples, Decathlon, Ulta, and Polo, we are at the forefront of AI-centri ...
-
Data Engineer
6 days ago
RS Consulting IndiaResponsibilities: · Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets. · Collaborate with Business Intelligence team and other stakeholders for data requirements · Collaborate with the Data Management team to prov ...
-
Data Engineer
1 week ago
Bungee Tech IndiaCompany Description · At Bungee Tech, our unwavering focus is on empowering retailers and brands to deliver unparalleled customer experiences regardless of location or need. We recognize that accurate and superior quality data and market insights are the key to achieving this ob ...
-
Data Engineer
3 days ago
Aiverbalyze Technologies Private Limited IndiaAbout Us: We are a fast-growing and innovative tech company specializing in AI-driven solutions. Our mission is to revolutionize the way businesses interact with their customers. As a part of our team, you'll have the opportunity to work on cutting-edge projects, gain hands-on ex ...
-
Data Engineer
6 days ago
KniTT IndiaWriting SQL queries, Analyzing existing SQL Queries, SSIS Packages, optimize SQL queries to extract, transform, and load data efficiently. · Good with Query Patterns, Optimizing queries; Analyze and improve existing SQL queries and SSIS packages for performance and scalability. · ...
-
Data Engineer
2 days ago
S&P Global Market Intelligence India Full time· About the Role: · 09Job Description · Position Summary: · We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow ...
Azure Data Engineer - India - HTC Global Services
Description
Preferred: