- Design and implement complex, distributed system which provides an efficient data pipeline for scalable ML analysis, and data transformation and analytics
- Architect data warehouses / data lakes etc. with big data technologies such as Spark, Python & Kafka and leveraging Maching Learning cloud platforms such as AWS
- Track data consumption patterns, performing intelligent sampling and caching, monitor schema changes and recommend opportunity areas
- Identify tooling and infrastructure capabilities to enable teams to efficiently complete and maintain data science projects
- Actively contribute to Engineering Process efficiencies such as CI/CD, Security enhancements, quality improvements, etc.
- Ensure responsible consumption of the provisioned data through governance mechanisms and compliance initiatives
- Have a good understanding of Agile, MLOps and DataOps principles
- Knowlegde about data visualization will be added advantage
- M.Sc. or Ph.D. in Chemistry OR BE/ B. Tech from IIT or Tier I colleges
- An advanced degree (MS or higher) in computer science, statistics, applied mathematics, data management, information systems will be an added advantage
- Certification in Big Data Technologies
- Certification in Cloud Platforms AWS
- Know-how of Quantum Computing is an added advantage
- 7 to 10 years of experience in the field of Data Engineering
- 5 to 7 years experience in data management discipline which includes data ingestion, preparation, cleansing, provisioning, automated testing, and quality checks
- 4+ years of hands-on experience in Big Data Technologies such as Data Lakes, and Data Warehouses
- Strong experience with advanced analytics tools using languages such as R, Python, Scala or others
- Strong experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets
- Strong experience in working with and optimizing existing ETL processes and data integration and data preparation flows and helping to move them in production
- Experience in designing and building streaming data platforms in Lambda / Kappa architectures
-
Data Engineer
2 days ago
ValueLabs Hyderabad, IndiaExperience - 6+Years · Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake · Secondary Skills - PowerBl, Data modeling · Notice Period - Immediate - 15 days · Job Description: The Data Engineer is responsible for d ...
-
Data Engineer
2 days ago
Prudent Technologies and Consulting, Inc. Hyderabad, IndiaWe are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...
-
Data Engineer
2 days ago
Inspire Brands Hyderabad Support Center Hyderabad, IndiaWe are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline (Data ingest, data transformation, data distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong tech ...
-
Data Engineer
4 days ago
Inspire Brands Hyderabad Support Center Hyderabad, IndiaJob Description: · We are seeking a skilled and motivated Data Engineering Support Analyst to join our team. As a Data Engineering Support Analyst, you will play a crucial role in ensuring the smooth operation and support of our data engineering. Your primary responsibility will ...
-
Data Engineer
1 week ago
ValueLabs Hyderabad, IndiaRole: Data Engineer with AWS · Experience: 5-9 years · Notice Period: Immediate - 10 days · Location: Hyderabad · We are seeking a highly skilled Data Engineer to join our dynamic team. · Job Description · Key Responsibilities: · Develop and maintain data models, data flow diagra ...
-
Data Engineer
2 weeks ago
ACL Digital Hyderabad, IndiaDear Folks, · We are hiring for the position of as AWS Data Engineer at Hyderabad location. · Only Interested and relevant candidates can share their resume at ) · Notice Period Required : Immediate to 15 Days Max · Designation : AWS Data Engineer · Experience Required : 3 to 12 ...
-
Data Engineer
1 week ago
The Ksquare Group Hyderabad, IndiaRequirements · Bachelor's degree in computer science, information technology, or a related field. · Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must. · Demonstrate advanced understanding in data engineering practices, Incl ...
-
Data Engineer
1 week ago
Tech Mahindra Hyderabad, IndiaTitle: Data Operations Associate · Location: Hyderabad · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create susta ...
-
Data Engineer
1 week ago
Anblicks Hyderabad, IndiaPosition: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with AWS S3/ Azure ADLS Storage Accounts and Snowflake. · Strong experience in data engi ...
-
Data Engineer
4 days ago
D2N Solutions Hyderabad, IndiaCompany Description · D2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate ...
-
Data Engineer
2 days ago
Inspire Brands Hyderabad Support Center Hyderabad, IndiaResponsibilities: · Design, develop and maintain reliable automated data solutions based on the identification, collection and evaluation of business requirements. Including but not limited to data models, database objects, stored procedures and views. · Developing new and enhanc ...
-
Data Engineer
1 day ago
Ten Lifestyle Group Hyderabad, IndiaOverview · We are looking for someone that can create a systematic ETL approach to plan and maintain data architecture while keeping it aligned with business requirements. Additional to this, support the data team in improving the process to store optimized datasets, the analytic ...
-
Data Engineer
4 days ago
Talentoj Hyderabad/Pune/Ahmedabad, India permanentAzure Data Engineer : · We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required. · The ideal can ...
-
Data Engineer
2 days ago
Arjava Consultants LLP Hyderabad, IndiaTitle : Data Engineer · Location : Hyderabad · Experience : 5+ (as Data Engineer) · Must have : Snowflakes, python, ETL, Data Bricks, Cloud, Spark. · Key Responsibilities : · - Lead and mentor a team of data engineers to design, develop, and maintain our data infrastructure, inc ...
-
Data Engineer
2 days ago
Egen Hyderabad, IndiaJob Description : · Egen is seeking a highly skilled Snowflake Data Engineer with expertise in data engineering, Snowflake, SQL, and strong experience in working with semi-structured data. The ideal candidate will have hands-on experience with various Snowflake data loading patt ...
-
Data Engineer
1 week ago
Inspire Hyderabad, IndiaWe are looking for a Master Data Management (MDM) Engineer for the Enterprise Data Organization to build and maintain MDM data products across multiple data domains that will support key data consolidation and governance initiatives. The candidate will be required to possess stro ...
-
Data Engineer
1 week ago
C1 Global Innovation & Capability Center Hyderabad, IndiaThe Data Engineer's role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and re ...
-
Engineer – Data Engineering
1 week ago
Infosys Hyderabad, IndiaEngineer – Data Engineering (Immediate Joiners only) · What you will be responsible for: · The design and development of data solutions for one of the world's largest corporations involved in the marketing and distribution of food products. · Implement distributed and highly ava ...
-
Data Engineer
1 week ago
Live Connections Hyderabad, IndiaRole - Data Engineer · Experience - 5+ years out of which 4 years should be relevant · Location - Hyderabad · Work Mode - Hybrid · Must Have · 4 years as a Data Engineer · Proven experience as a Data Engineer, with a focus on designing and implementing scalable data solutions ...
-
Data Engineer
5 days ago
HuQuo Hyderabad, India permanentMust-Have : · - 4+ years of experience in Data Engineering experience on Azure and Databricks · - Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required · - Experience Developing and tuning Spark Application and SparkSQL queries- · - Expertise t ...
Data Engineer - Hyderabad, India - Aragen Life Sciences
Description
Role: Data Engineer
Role Band: Manager
Reporting To: Data Science & AI Head
Location: Hyderabad
Context
The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as an input for further analysis by Business Analysts, Application development and Data Scientists
Candidate would be expected to independently/with minimal supervision :
Operating Network
Internal: CDO, Data Engineering Lead and Technology Tower Leads, Business Stakeholders – BU Heads, Functional Heads and their teams; IT Delivery Teams including SAP, Digital, Analytics, Infra & Security
External: Digital Ecosystem partners – Academia, Start-ups, Digital Giants, Technology Solution & Service Providers, Consulting Firms, Independent Research Firms, Capability Building Partners, Industry Peers
Contemporary Skills: Must have good knowledge of Agile Methodologies, Design Thinking, User Experience, Platform Business Models and Digital Technologies
Educational Qualifications:
Experience Required:
Key Personal Attributes
Strategic and Innovative Mind-set
Execution-oriented with hands-on experience of delivering Analytics-focussed Initiatives
Business focused, Customer & Service minded
Strong Consultative and Management skills
Good Communication and Interpersonal skills to manage senior stakeholders in business and IT
Confident in advising, developing, and articulating solutions
Result oriented and with a work ethic of delivering on-time and in scope
Learning Agility