- Design, develop, and deploy scalable data pipelines on AWS to support the creation of machinelearningready datasets for our SaaS application.
- Collaborate with software engineers to integrate data pipelines into our SaaS application architecture, ensuring seamless data ingestion and processing.
- Implement efficient ETL processes to extract, transform, and load data from various sources, including internal databases, thirdparty APIs, and streaming sources.
- Optimize data storage and retrieval for performance, scalability, and costeffectiveness, leveraging AWS services such as S3 Glue, Redshift, Athena, etc.
- Work closely with data scientists to understand modeling requirements and ensure the availability of clean, curated datasets for training and evaluation.
- Monitor and troubleshoot data pipelines to ensure reliability, availability, and data quality, implementing automated testing and alerting mechanisms.
- Implement security best practices for data storage, transmission, and access control, ensuring compliance with relevant regulations and standards.
- Document design specifications, deployment procedures, and operational processes, facilitating knowledge sharing and collaboration within the team.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or similar role, with at least 4 years of experience.
- Strong proficiency in AWS services such as S3 Glue, Redshift, Athena, EMR, Lambda, etc.
- Handson experience with data modeling, ETL development, and SQL.
- Excellent problemsolving skills and attention to detail.
- Strong communication and collaboration skills.
- AWS certification (e.g., AWS Certified Data Analytics
- Specialty, AWS Certified Solutions Architect
- Associate).
- Experience with programming languages such as Python, Scala, or Java.
- Experience with containerization and orchestration tools such as Docker and Kubernetes.
- Familiarity with DevOps practices and tools for CI/CD.
- Familiarity with machine learning concepts and workflows, including data preprocessing, feature engineering, and model evaluation.
- Experience with realtime data processing and streaming technologies.
-
Data Engineer
4 days ago
Nutrabay Bangalore/Anywhere in India/Multiple Locations permanentResponsibilities : · - Design and implement data pipelines for extracting, transforming, and loading data from various sources to our data warehouses and data lakes. · - Collaborate with data scientists and analysts to understand data requirements and ensure data quality and inte ...
-
Big Data Engineer
1 day ago
Connectio IT Pvt Ltd Bangalore/Anywhere in India/Multiple Locations permanentKey Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWS · Job Description : · Designing, installing, testing, and maintaining scalable data management systems · - Ensuring systems meet business requirements and industry standards · - Creating custom software components and ana ...
-
Senior Data Engineer
4 days ago
Lorven Technologies Bangalore/Anywhere in India/Multiple Locations permanentJob Description: · As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms. · - Leveraging your expertise in data engineering, cloud technologie ...
-
Lead Data Engineer
4 days ago
Lorven Technologies Bangalore/Anywhere in India/Multiple Locations permanentJob Description : · Primary skills as Azure ADF, Databricks · Secondary skills as Snowflake and other data engineering technologies. · - Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.) · Good Knowledge and Understanding of Data wa ...
-
EY - Data Engineer - AWS Services
4 days ago
Ernst & Young Bangalore/Anywhere in India/Multiple Locations/Mumbai permanentLanguage - Pyspark, Python, Sql · AWS services (in order)- glue, emr, redshift, lambda · - Database: Redshift · Exposure to airflow · - Design, construct, and maintain data architectures and pipelines that support campaign and marketing analytics. · - Utilize AWS cloud services ...
-
Lead Machine Learning Engineer
1 day ago
TalentPulse Consultant Bangalore/Anywhere in India/Multiple Locations permanentLead ML Engineer · Job Description : · We are seeking a dynamic Lead ML Engineer to join our team in a remote capacity, operating within the UK shift timings of 2pm to 11pm IST. · As the Lead ML Engineer, you will be responsible for leading the development and implementation of m ...
-
Tableau Developer
1 day ago
TIGI HR Solution Pvt. Ltd. Bangalore/Anywhere in India/Multiple Locations permanentTableau Developer. · Experience : 5-8 Years. · Responsibilities : · - Collaborate with the Data Engineering team to ensure accurate, available, and analyzable data sources. · - Design and develop dashboards using Tableau Desktop, including report authoring, troubleshooting, and d ...
-
Data Scientist
1 week ago
Awign Bangalore/Anywhere in India/Multiple Locations permanentDuration : 12 months. · Location : Bengaluru or Remote (If exceptional). · Timings : Full Time (As per company timings). · Notice Period : Immediate Joiner Required. · Role : Data Scientist. · Total Experience : 4+ Years. · Mandatory Skills : Machine Learning Techniques, Deep Lea ...
-
Senior Software Developer
3 days ago
Talhive HR Management LLP Bangalore/Anywhere in India/Multiple Locations permanentAbout Loopio : · Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. · Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our missi ...
-
Senior Product Manager
4 days ago
Gethyr Bangalore/Anywhere in India/Multiple Locations permanentVWO is seeking a dynamic Senior Product Manager to take ownership of one of our flagship products. · The Senior Product Manager will work closely with all teams at Wingify to shape and execute our product roadmap and strategy. · Responsibilities : · Strategic Vision : Define, exe ...
-
GCP Data Architect
4 days ago
NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Bangalore/Anywhere in India/Multiple Locations permanentSkills : · 1) Successfully executed at least couple of Production Migration projects on Google Cloud Platform · 2) Detailed understanding of Enterprise data architecture and management frameworks · 3) Must have hands on experience with various Google Platform Services like BigQu ...
-
SQL Developer
1 week ago
IBU Consulting Bangalore/Anywhere in India/Multiple Locations permanentExperience : 5-7 years · Tentative Joining From - April 1st Week · Education : Engineering background preferred · Summary : · We are seeking a highly motivated and skilled Power Platform & SQL Developer to join our team. · - In this role, you will be responsible for developing a ...
-
Senior Python Engineer
1 week ago
TalentXo Bangalore/Anywhere in India/Multiple Locations permanentWe're seeking a highly motivated Senior Python Engineer to join our dynamic team. · In this role, you'll play a pivotal role in designing, developing, and maintaining the robust backend systems that power our applications. · You'll collaborate closely with cross-functional teams ...
-
Java Architect
1 day ago
Squareroot Consulting Pvt Ltd Bangalore/Anywhere in India/Multiple Locations/Mumbai permanentJob Description : · We are looking for a talented Java Architect with a strong background in Microservices architecture, AWS, NoSQL databases, and CI/CD tools to join our SaaS/Cloud Native platform company. As a Java Architect, you will be responsible for designing and implement ...
-
Kodehash Technologies Pvt Ltd Bangalore/Anywhere in India/Multiple Locations permanentResponsibilities : · - Design and implement highly scalable, available, and performant REST API services using Java to support a flexible content delivery system. · - Develop and maintain software solutions, ensuring scalability, reliability, and extensibility. · - Collaborate wi ...
-
Tibco Developer
1 week ago
Cariva Technologies Bangalore/Anywhere in India/Multiple Locations permanentJOB SPECIFICATIONS : · - Proven ability to work with multi cultural , multi location teams · Certifications (Desirable) : · - TIBCO Certified Professional (TCP) or related certifications · Relevant certifications : · - This position will be reporting to Back-End Big Data Ops ...
-
Technical Support Engineer
1 week ago
Zyoin group Bangalore/Anywhere in India/Multiple Locations permanentResponsibilities : · - Work closely with the engineering team to address technical and product-related queries from both customers and L1/L2 teams. · - Replicate issues in test environments to diagnose and resolve. · - Utilize SQL skills to extract data relevant to customer quer ...
-
Data Scientist
4 days ago
Quantum Integrators Bangalore/Anywhere in India/Multiple Locations permanentJob Description: · Main responsibilities : · - Develop and support AI/ML solution using best in-class LLM/DL/ML models and statistical techniques. · - Perform code development, Unit testing, System testing, and debugging HPE's applications. · - Collaborate with business users, un ...
-
Product Manager
3 days ago
Talhive HR Management LLP Bangalore/Anywhere in India/Multiple Locations permanentAbout Loopio : · Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. · Our missi ...
-
Digihelic Solutions Pvt. Ltd. Bangalore/Anywhere in India/Multiple Locations/Dubai/Overseas/International permanentJob Title : SAP EWM Architect · Location : Dubai, UAE · Job Description : · We are seeking an experienced SAP EWM (Extended Warehouse Management) Architect to join our team in Dubai, UAE. · The ideal candidate will have extensive experience in designing, implementing, and optimiz ...
Data Engineer - Bangalore/Anywhere in India/Multiple Locations - Talhive HR Management LLP
3 days ago
Description
About Loopio :
Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires.
Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters.
We do this by giving both our customers and employees the tools they need to make an impact faster.
Loopers as our team members are affectionately dubbed driven and passionate.We're obsessed with feedback, personal growth, and doing work we're proud of. Empower people to focus on what matters.
From our Loopers (employees) to our Loopio Champions (customers), we aim to empower all of the people in Loopio's ecosystem to focus on winning, growth, differentiation, autonomy, mastery, purpose, and more of the things that matter
Job Description :
Function :
IT Operations and Support - DevOps / Cloud, Software Engineering - Big Data / DWH / ETL Amazon RedshiftPythonAmazon S3MapReduceAWS Glue
As an AWS Data Engineer focused on our SaaS application, you will play a key role in designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform.
You will collaborate closely with cross-functional teams, including software engineers and data scientists, to gather requirements, design data solutions, and ensure the availability of high-quality datasets for machine-learning analysis.
The ideal candidate will have a strong background in AWS services and data engineering.Responsibilities :
Requirements :