- Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize
- Influence, build and maintain the largescale data infrastructure required for the AI projects, and
- Leverage an understanding of software architecture and software design patterns to write scalable,
- Maintain a catalog of all data assets (what data is available where). Be a single point source for all data related queries
- Building and maintaining datalake for consumption by AA models and visualization tools by integrating data from multiple sources
- Provide inputs in deciding dataschemas
- Design, develop and maintain the framework for analytical pipeline
- Develop common components to address pain points in machine learning project, like model lifecycle
- Provide input and help implement framework and tools to improve data quality
- Work in crossfunctional agile teams of highly skilled software/machine learning engineers, data scientists, designers, product managers and others to build the AI ecosystem within the Group
- Deliver on time, demonstrating strong commitment to deliver on the team mission and agreed backlog
- Ability to transform proof of concept machine learning models into scalable solutions
- Ability to apply software development best practice into machine learning project, including unit test, DevOps integration, release management, test driven development, etc.
- Experience in any one BI/ETL tool preferred (Informatica//SAP BW/Cognos BI)
- Experience with building complex data lakes and pipelines.
- Experience with Azure Synapse, Azure Data Lake (Azure Data Factory, Azure Data Bricks, Blob Storage, etc.) and Python required.
- Experience with at least one data visualization tools (e.g. Tableau/PowerBi/open source analytics) preferred
- Ability to automate development process of machine learning project by leverage state of art tools and technology like container, continuous integration and delivery, orchestration tools etc.
- Good understanding and experience with software design principle and design pattern
- Good understanding of Agile and scrum methodology, keep team focus on deliver business value
- Work Experience
- Proven working experience as a Data Engineer with 35 years of relevant experience.
- Experience in Pharma will be a plus.
- Functional Knowledge
- Machine Learning
- DevOps and continuous integration
- Agile wow and testdriven development
- Distributed computing
- Linux, Spark and Hadoop eco system
- Azure Analytics
- Azure Data Factory, Azure Data
- Bricks, Block Blob Storage, Azure DevOps, Azure Synapse
- Software development best practices
- Python/Scala/Java
- Docker, Kubernetes
- Data structure and algorithm
- RDBMS and NoSQL databases, good skill with SQL
- React native
- Tableau/ Open source analytics
-
Data Engineer
3 days ago
Layer7 SAPI de CV New Delhi, IndiaJob DescriptionThis is a remote position. · • Diseñar, crear y mantener canalizaciones de datos por lotes o en tiempo real en producción. · • Mantener y optimizar la infraestructura de datos necesaria para una extracción, transformación y carga precisas de datos de una amplia var ...
-
Data Engineer
19 hours ago
HARP Technologies and Services Delhi, India permanentJob Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...
-
Data Engineer
3 days ago
Blackstraw Delhi, IndiaData Engineer · Company Name: · Office Location: Delhi (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exa ...
-
Data Engineer
6 days ago
SKYGATE CONSULTING Bangalore/Gurgaon/Gurugram/Delhi NCR, India permanentData Engineer (Snowflake) · Job Description : · As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitc ...
-
Data Engineer
3 days ago
Straive New Delhi, IndiaJob Role- AWS Data EngineerExperience- 4 to 6 yearsMode- Remote · The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabili ...
-
Data Engineer
3 days ago
Aprisity Technologies New Delhi, IndiaWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems wi ...
-
Data Engineer
3 days ago
ZIDEA New Delhi, IndiaResponsibilitiesDesign, build, and maintain scalable data pipelines on AWS using services such as Amazon S3, Glue, and EMR.Develop and optimize ETL processes to ingest data from various sources into our data lake and data warehouse.Collaborate with data scientists and analysts to ...
-
Data Engineer
6 days ago
Vision Beyond Resources India Pvt. Ltd. Noida/Gurgaon/Gurugram/Delhi NCR/Chennai/Mumbai, India permanentRole : Data : UK Shift Range : 7+ Requirements : · - Excellent understanding of data structures with 5+ years of experience in enterprise-wide data platforms design and implementation. · - Strong knowledge of common design patterns used in Data Integrations and Warehousing. · - P ...
-
Data Engineer
6 days ago
WovV Technologies Bangalore/Any Location, India permanentJob Description : Data Engineer · Location : Remote · Experience : 5+ years. · Durations : 6 months with a very likely extension · Mandatory Technology : DBT, SQL, Snowflake,data integration practices, and Tableau · Primary Skills : Expertise in transaction refunds and a comprehe ...
-
Data Engineer
19 hours ago
Resources valley Delhi, India permanentJob Description : · Ownership of Data Engineering solution development, including ingestion, transformation, loading, modelling, curation, profiling, migration, and validation of data, also maintaining security, access control, compliance, and SLAs · - Design and create data mode ...
-
Data Engineer
6 days ago
INSIGHT GLOBAL SOLUTIONS Bangalore/Any Location, India permanentData Engineer · Must Haves : · - Bachelors Degree in science, technology, or another related field. · - 3+ years of data engineering experience. · - 3+ years of experience with Cloud platforms like GCP, Azure, Airflow. · - 4+ years of data warehouse, relational database, and SQL ...
-
Data Engineer
19 hours ago
Triumph Ladders Pvt. Ltd. Delhi Division, India permanentTitle - Data Engineer · Exp years · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group ...
-
Data Engineer
6 days ago
Vbeyond Delhi NCR/Mumbai/Noida, India permanentJOB SUMMARY : · We are seeking a skilled and experienced Data Engineer with strong developments skills and solid track record in terms of implementing scalability, availability and excellence when building data pipelines and platforms for our royalties and revenue share initiati ...
-
Data Engineer
3 days ago
iENGINEERING New Delhi, IndiaJob DescriptionWhat we're looking for: · To support our mission of delivering high quality AI services to revolutionalize the way American transportation authorities manage and maintain US road infrastructure, we're seeking a motivated Data Engineer to join our team at Transconom ...
-
Data Engineer
3 days ago
Cayian India Pvt Limited New Delhi, IndiaJob DescriptionCayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find o ...
-
Data Engineer
1 day ago
SIENT TECHOLOGIES PVT LTD New Delhi, IndiaCompany Overview: · SIENT Technologies is a pioneering technology firm at the forefront of innovation, dedicated to revolutionizing industries through the power of advanced solutions. Committed to excellence, we specialize in creating transformative technology that enhances effic ...
-
Data Engineers
3 days ago
Cubiccode Digital Media LLP New Delhi, IndiaWe are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaini ...
-
Data Engineer
6 days ago
HS Solutions Inc Any Location/Overseas/International/Bangalore/Atlanta, India permanentAbout the job : · Tech stack : · BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc. · - 3-5 years' Experience in Data warehouse and Data lake implementation. · - 1-2 years of experience in Google Cloud Platform (especially Big Query). · - 1-2 years of w ...
-
Data Engineer
3 days ago
ICF New Delhi, IndiaICF (NASDAQ: ICFI) is a global consulting services company with over 9,000 full- and part-time employees, but we are not your typical consultants. At ICF, business analysts and policy specialists work together with digital strategists, data scientists and creatives. We combine un ...
-
Data Engineer
6 hours ago
ICF New Delhi, India Full timeICF (NASDAQ: ICFI) is a global consulting services company with over 9,000 full- and part-time employees, but we are not your typical consultants. At ICF, business analysts and policy specialists work together with digital strategists, data scientists and creatives. We combine un ...
Data Engineer - Delhi Division, India - Triumph Ladders Pvt. Ltd.
Description
Title - Data EngineerExp yrs
Location - Delhi
Notice period days
Responsibilities :
Skills and Abilities :
Education :
Bachelors or masters in Computer Science or Engineering