Data Engineer - india, India - Stealth AI Startup

Stealth AI Startup india, India

3 weeks ago

Technology / Internet

Description

The Data Engineer will be responsible for developing real-time and batch data integration pipelines. This role will ensure that data pipelines adhere to defined standards and are included in the established data integration framework. The Data Engineer will work closely with data scientists, analysts, and other stakeholders to ensure data availability for analysis and decision-making, significantly impacting our data-driven initiatives

Key Role Responsibilities:

Data Pipeline Development: Create and maintain scalable and efficient data pipelines for data extraction, transformation, and loading (ETL) processes, ensuring data accuracy and consistency.
Data Warehousing: Collaborate with Sr. Data Engineers and Data Architects to design and manage data lakes, storing and organizing large volumes of structured and unstructured data.
Data Modeling: Develop data models and schema designs that optimize data storage and retrieval, supporting various analytical and reporting needs.
Data Integration: Integrate data from multiple sources, including APIs and external databases, for real-time and batch data pipelines.
Data Quality Assurance: Implement data quality checks, validation, and cleansing processes to maintain data integrity.
Documentation: Create and maintain documentation for data engineering processes, data schemas, and ETL workflows.
Performance Optimization: Monitor and fine-tune data pipelines to ensure optimal performance and efficiency.
Collaboration: Work with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver solutions.

Qualifications, Experience, Skills & Competencies:

Minimum Qualifications:

Graduate or Post-graduate in Computer Science or a related field is preferred.

Minimum Experience:

Minimum of 3 years of IT experience with at least 2 years in a similar role.

Job-Specific Skills:

Knowledge of big data technologies such as Hadoop, Spark, Kafka, and related ecosystems.
Proficient in SQL and experience with data warehousing platforms like Snowflake, Redshift, or BigQuery.
Strong experience with ETL/ELT tools such as Alteryx, Talend, or Informatica.
Proficiency in programming languages, particularly Python, Java, or Scala.
Experience with database technologies, including SQL and NoSQL databases.
Familiarity with cloud platforms and services such as AWS, Azure, or Google Cloud.
Experience with data orchestration tools like Apache Airflow or Informatica.

Behavioral Competencies:

Practical understanding of agile methodologies.
Ability to work in small teams structured around delivering data products.
Proven problem-solving skills for unstructured, uncertain problems.
Data-oriented, analytical, performance-driven, and assertive.

Technical Competencies:

ETL Tools (Informatica, Google DataFlow, Data Factory): Expert
Real-Time (Apache Kafka, Google Pub-Sub): Expert
Data Modeling / Data Integration: Advanced
GBQ or Synapse or Oracle Autonomous DWH: Advanced
PowerBI / Alteryx: Basic
Python / Jupyter Notebooks: Advanced

Data Engineer

3 weeks ago

ReleWant india, India

Job Description · Chi siamo? · Relewant è una società di consulenza specializzata in ambito informatico con sede a Chiasso, in Svizzera. · Con noi, potrai mettere a frutto il tuo potenziale in un team coeso e vincente ed esplorare tecnologie sempre più innovative in contesti mu ...
WH371561 - Data Engineer

3 weeks ago

Westhouse india, India

Job Description · Westhouse è una società leader che opera nel campo della ricerca & selezione del personale, gestione · di progetti ed è autorizzata a tempo indeterminato per la somministrazione di lavoro con Autorizzazione Ministeriale Prot. n del 03/08/2018 · Per un nostro im ...
Operations Specialist

3 weeks ago

Data Engineer Academy india, India

Job Title: Operations Analyst · Location : Remote · Company Overview: · Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to ...
Data engineer

3 weeks ago

alfabet india, India

Job Description · Wij zijn gepassioneerd door innovatie in de vastgoedsector. Als een dynamisch team met een platte organisatiestructuur, streven we ernaar om door middel van geavanceerde data-analyse en AI-technologie de vastgoedwereld te revolutioneren. · We zijn op zoek naar ...
Data Engineer

3 weeks ago

Paralleldots Anywhere in India/Multiple Locations permanent

Job Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets ...
Data Engineer

3 weeks ago

Connectio IT Pvt Ltd Bangalore/Anywhere in India/Multiple Locations

This is a full-time on-site role for a GCP Data Engineer. · As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. · Job Description : · You will work closely with the developme ...
Data Engineer

3 weeks ago

Pro5 (formerly Mangtas) india, India

The Data Engineer will have strong software engineering skills, designing and creating data architectures for the data engineering and machine learning solutions we build. · Responsibilities include understanding of Data Engineering requirements, design, development of data pipe ...
Data Engineer

3 weeks ago

Coders Brain Technology Pvt. Ltd. Anywhere in India/Multiple Locations

Position Name : Data Engineer (Integration) · Experience Required : 10+yrs · Salary : As per the Market Standard or Else whatever budget you have · Notice period : Immediate joiner · Job Type : Full time · Location : Remote · Job Description : · - Understand all forms of da ...
Data Engineer

3 weeks ago

HARP Technologies and Services india, India

Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...
Data Engineer

3 weeks ago

Artefact india, India

Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing grow ...
Data Engineer

3 weeks ago

System Soft Technologies india, India

Job Summary · Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposes · Qualification · As a data engineer, your main resp ...
Data Engineer

3 weeks ago

Prescience Decision Solutions india, India

Job Description Build and support ETL jobs and components using Apache Spark, Python, Pyspark, Talend, Kafka, Hadoop, Airflow, and Google Cloud Platform (GCP). · Conduct requirement gathering sessions and comprehend project needs, translating them into technical tasks utilizing ...
Data Engineer

3 weeks ago

KARYA CONSULTANTS PRIVATE LIMITED india, India

As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...
Data Engineer

3 weeks ago

Capleo Global india, India

Lead Data Engineer · Experience: 8-10 years · Location: Bengaluru · Availability: Immediate to 30 days · Mandatory Skills: · Spark · Databricks · PySpark or Scala · SQL & Python · Github · DWH (Snowflake or Presto or Hive or Hadoop) · Data Pipeline & Data Model · We ...
Data Engineer

3 weeks ago

Huquo Consulting india, India

Position : Data Engineer · Location : Gurgaon · Experience : Min 4+ years · Role & Responsibilities Overview : · - A seasoned data team member with a good grasp of both business and technical aspects. · Good familiarity with data stack · - Interact with the other members of the ...
Data Engineer

2 days ago

Lingaro India

Role: Data Engineer – Lead Consultant · Location: India · About Lingaro: · Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping ...
Data Engineer –

3 weeks ago

HARMAN International india, India

HARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of ...
Data Engineer

4 days ago

Neurones IT Asia India

As a Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks. · Designing and delivering software using an agile and iterative approach based on Scrum or Kanban · Following and contributing to ...
Data Engineer

3 weeks ago

Getmycourse india, India

Job Description · This is a remote position. · Job title: Data Engineer · Schedule: Full time; 40 hours per week; Monday to Friday · Rate: 60, ,000 Philippine Pesos per month · We are seeking a highly skilled and experienced Data Engineer to join our Data Engineering team. The ...
Data Engineer

4 days ago

Anomaly Business Consult India

Location: Remote · Experience: 6+ years · Compensation: Better than industry standards · Only Immediate Joiners Requried · We are looking for a seasoned Azure Data Engineer to join our client's team. The successful candidate will possess extensive experience in designing, develo ...