- Design, develop, and maintain data pipelines to ingest, transform, and load data from various sources into the organization's data warehouse and data lake.
- Implement and manage data integration processes using ADF, SQL Server, and Databricks Notebooks.
- Develop and optimize stored procedures (SPROCs) for efficient data processing and retrieval.
- Design and implement data models, schemas, and data structures for the data warehouse and data lake.
- Collaborate with data scientists and analysts to ensure data quality, integrity, and consistency.
- Monitor and maintain data pipeline performance, identifying and resolving bottlenecks and inefficiencies.
- Implement and manage data security, access controls, and compliance measures.
- Provide technical support and troubleshooting for data pipeline and data warehouse issues.
- Stay up-to-date with industry trends, best practices, and emerging technologies in data engineering and data management.
- Mentor and support junior team members in data engineering principles and practices.
- Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
- 6+ years of experience in data engineering, data warehousing, or data management.
- Strong proficiency in ADF, SQL Server, and Databricks Notebooks.
- Experience with data pipeline design and implementation, including ETL processes.
- Knowledge of data modeling, schema design, and data structure optimization.
- Familiarity with data warehousing and data lake concepts and best practices.
- Strong understanding of data quality, integrity, and consistency principles.
- Experience with stored procedures (SPROCs) and SQL Server.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
-
Data Engineer
5 days ago
WaferWire Cloud Technologies Hyderabad, IndiaHi, · This is Sundeep from Waferwire Technologies and we are hiring Data Engineer with Azure Synapses and Pyspark and ADF experience · Role: Data Engineer · Experience: 3-8 Years · Location: Hyderabad · Job Description: · We are seeking a seasoned Data Engineer to join our team i ...
-
Data Engineer
5 days ago
Prudent Technologies and Consulting, Inc. Hyderabad, IndiaWe are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...
-
Data Engineer
3 days ago
ACL Digital Hyderabad, IndiaDear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days Max · Designation : AWS Data Engineer · Experience Required : 3 to 12 ...
-
Data Engineer
4 days ago
ValueLabs Hyderabad, IndiaRole: Data Engineer with AWS · Experience: 5-9 years · Notice Period: Immediate - 10 days · Location: Hyderabad · We are seeking a highly skilled Data Engineer to join our dynamic team. · Job Description · Key Responsibilities: · Develop and maintain data models, data flow diagra ...
-
Data Engineer
4 days ago
ACL Digital Hyderabad, IndiaDear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days Max · Designation : AWS Data Engineer · Experience Required : 3 to 12 ...
-
Data Engineer
5 days ago
SID Global Solutions Hyderabad, IndiaDear candidate, · Greetings · We are looking for Data Engineer role. Please find below the JD. If interested, please send me your updated resume to my email address: · Position: Data Engineer · Exp level: 5+ years · Skillset: SQL, AWS Stack, Python, Redshift and MYSQL · Roles & ...
-
Data Engineer
6 days ago
Accellor Hyderabad, IndiaHeadquartered in the Silicon Valley with offices in London, Hyderabad and Singapore, Accellor is a Microsoft Gold Partner and a premier Salesforce Partner that uses best-of-breed cloud technology to deliver superior customer engagement and business effectiveness for clients. We b ...
-
Data Engineer
5 days ago
Tech Mahindra Hyderabad, IndiaTitle: Data Operations Associate · Location: Hyderabad · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create susta ...
-
Data Engineer
2 days ago
Anblicks Hyderabad, IndiaPosition: Data Engineer - Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with AWS S3/ Azure ADLS Storage Accounts and Snowflake. · Strong experience in data eng ...
-
Data Engineer
5 days ago
Zelis Hyderabad, India Full timeResponsibilities: · Design, develop, and maintain Azure Data Factory Pipelines with at least 5 years of experience, ensuring scalability, reliability, and efficiency. · Implement and optimize data pipelines in at least one Columnar MPP Cloud data warehouse (e.g., Snowflake, Azure ...
-
Data Engineer
19 hours ago
Inspire Hyderabad, IndiaWe are looking for a Master Data Management (MDM) Engineer for the Enterprise Data Organization to build and maintain MDM data products across multiple data domains that will support key data consolidation and governance initiatives. The candidate will be required to possess stro ...
-
Data Engineer
5 days ago
C1 Global Innovation & Capability Center Hyderabad, IndiaThe Data Engineer's role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and re ...
-
Data Engineer
5 days ago
Growel Softech Pvt. Ltd. Bangalore/Hyderabad, India permanentJob Description : · Role : Data Engineer · Required Technical Skills : · - More than 5 years' experience implementing data solutions · - Strong proficiency in Python with an emphasis in building data pipelines · - Experience in big data technologies like HDFS, YARN, Map-Reduce, K ...
-
Data Engineer
2 days ago
WaferWire Cloud Technologies Hyderabad, IndiaHi,This is · Sundeep · from · Waferwire Technologies · and we are hiring · Data Engineer with Azure Synapses and Pyspark and ADF experience · Role: Data EngineerExperience: 3-8 YearsLocation: Hyderabad · Job Description:We are seeking a seasoned Data Engineer to join our team in ...
-
Data Engineer
2 days ago
Virtusa Hyderabad, IndiaData Engineer - CREQ187057 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real t ...
-
Data Engineer
2 days ago
Cognizant Hyderabad, IndiaCognizant is hiring Data EngineersLocation: HyderabadExp: 6 years to 15 years.Employment Type: Full Time.JD:Job Description:As a Data Engineer, you will be an integral part of our data team, focusing on creating and maintaining robust data pipelines using DBT and Python. Your rol ...
-
Data Engineer
2 days ago
ACL Digital Hyderabad, IndiaDear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days MaxDesignation : AWS Data EngineerExperience Required : 3 to 12 yearsQ ...
-
Data Engineer
2 days ago
ValueLabs Hyderabad, IndiaRole: · Data Engineer with AWSExperience: · 5-9 yearsNotice Period: · Immediate - 10 daysLocation: · Hyderabad · We are seeking a highly skilled Data Engineer to join our dynamic team. · Job Description · Key Responsibilities: · Develop and maintain data models, data flow diagram ...
-
Data Engineer
1 day ago
CN Solutions Hyderabad, India Full timeCompany Overview · CN Solutions is a leading IT services and IT consulting company that works in partnership with clients to provide first-class solutions for their manpower requirements. With a team of experienced professionals specializing in various technologies, we offer a wi ...
-
Data Engineer
2 days ago
Highspot Hyderabad, IndiaWhat You'll Do · Create optimal data pipeline architectureDevelop, and maintain end-to-end scalable data infrastructure and pipelines.Identify, design, and implement process improvements, automating manual processes and optimizing data delivery.Assist internal stakeholders with d ...
Data Engineer - Hyderabad, India - ValueLabs
Description
Experience - 6+Years
Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake
Secondary Skills - PowerBl, Data modeling
Notice Period - Immediate - 15 days
Job Description: The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support the organization's data-driven decision-making processes. The Data Engineer will work closely with data scientists, analysts, and other stakeholders to ensure the quality, efficiency, and reliability of data processing and storage systems. Key
Responsibilities:
Qualifications: