- Location – Gurgaon, Noida, Pune, Bangalore
- Candidate should be highly comfortable with python (Libraries pandas, datetime, NumPy, config parser, sys, os, Json, requests, warnings)
- We don't have any cloud-based solution, our whole framework is developed with Python functions which contains utility functions & python codes specific to ingestions
- Candidates should be well versed with below data ingestion framework
- Truncate & Load
- Daily Append
- Upset (Ingest new records & modify existing records based on primary key)
- Our destination is Oracle where the data is getting ingested, and we have different sources as follows
- Rest API's (Api Document will be provided and Data Engineer have to identify the correct auth mechanism and ingest the data in relational DB by doing appropriate transformations) à Candidate can test locally using postman.
- We integrate lot of data from Azure SharePoint, ServiceNow, Splunk, Logscale, JIRA boards, Confluence pages. Links/URL's are provided, and expectation is candidate should be able to read through the documentation and ingest the data.
- RDBMS to RDBMS, Hadoop to RDBMS ingestion
- Ask relevant questions to Client architects/engineers during discovery phase for new data ingestion.
- We as a team are the RTB (Run the bank) & CTB (Change the Bank) for our application
- Candidate should be able to triage prod issues and provide fix. Also, RCA needs to be done and logics need to be incorporated in codes with try & except blocks to avoid same issues in future.
- Very comfortable with Linux, GIT, shell scripting and good knowledge of CI/CD pipeline.
- Intermediate SQL skills are needed (Advanced SQL- Good to have)
- Knowledge about operational work sets (Submitting CR (Change Request), Submit Firewall Requests) is a plus
-
Data Engineer
3 weeks ago
ReleWant india, IndiaJob Description · Chi siamo? · Relewant è una società di consulenza specializzata in ambito informatico con sede a Chiasso, in Svizzera. · Con noi, potrai mettere a frutto il tuo potenziale in un team coeso e vincente ed esplorare tecnologie sempre più innovative in contesti mu ...
-
WH371561 - Data Engineer
3 weeks ago
Westhouse india, IndiaJob Description · Westhouse è una società leader che opera nel campo della ricerca & selezione del personale, gestione · di progetti ed è autorizzata a tempo indeterminato per la somministrazione di lavoro con Autorizzazione Ministeriale Prot. n del 03/08/2018 · Per un nostro im ...
-
Operations Specialist
3 weeks ago
Data Engineer Academy india, IndiaJob Title: Operations Analyst · Location : Remote · Company Overview: · Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to ...
-
Data engineer
3 weeks ago
alfabet india, IndiaJob Description · Wij zijn gepassioneerd door innovatie in de vastgoedsector. Als een dynamisch team met een platte organisatiestructuur, streven we ernaar om door middel van geavanceerde data-analyse en AI-technologie de vastgoedwereld te revolutioneren. · We zijn op zoek naar ...
-
Data Engineer
3 weeks ago
Paralleldots Anywhere in India/Multiple Locations permanentJob Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets ...
-
Data Engineer
3 weeks ago
Connectio IT Pvt Ltd Bangalore/Anywhere in India/Multiple LocationsThis is a full-time on-site role for a GCP Data Engineer. · As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. · Job Description : · You will work closely with the developme ...
-
Data Engineer
3 weeks ago
Pro5 (formerly Mangtas) india, IndiaThe Data Engineer will have strong software engineering skills, designing and creating data architectures for the data engineering and machine learning solutions we build. · Responsibilities include understanding of Data Engineering requirements, design, development of data pipe ...
-
Data Engineer
3 weeks ago
Coders Brain Technology Pvt. Ltd. Anywhere in India/Multiple LocationsPosition Name : Data Engineer (Integration) · Experience Required : 10+yrs · Salary : As per the Market Standard or Else whatever budget you have · Notice period : Immediate joiner · Job Type : Full time · Location : Remote · Job Description : · - Understand all forms of da ...
-
Data Engineer
3 weeks ago
HARP Technologies and Services india, IndiaJob Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...
-
Data Engineer
3 weeks ago
Artefact india, IndiaArtefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing grow ...
-
Data Engineer
3 weeks ago
System Soft Technologies india, IndiaJob Summary · Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposes · Qualification · As a data engineer, your main resp ...
-
Data Engineer
3 weeks ago
KARYA CONSULTANTS PRIVATE LIMITED india, IndiaAs a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...
-
Data Engineer
3 weeks ago
Huquo Consulting india, IndiaPosition : Data Engineer · Location : Gurgaon · Experience : Min 4+ years · Role & Responsibilities Overview : · - A seasoned data team member with a good grasp of both business and technical aspects. · Good familiarity with data stack · - Interact with the other members of the ...
-
Data Engineer
2 days ago
Lingaro IndiaRole: Data Engineer – Lead Consultant · Location: India · About Lingaro: · Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping ...
-
Data Engineer
3 weeks ago
Prescience Decision Solutions india, IndiaJob Description Build and support ETL jobs and components using Apache Spark, Python, Pyspark, Talend, Kafka, Hadoop, Airflow, and Google Cloud Platform (GCP). · Conduct requirement gathering sessions and comprehend project needs, translating them into technical tasks utilizing ...
-
Data Engineer
3 weeks ago
Capleo Global india, IndiaLead Data Engineer · Experience: 8-10 years · Location: Bengaluru · Availability: Immediate to 30 days · Mandatory Skills: · Spark · Databricks · PySpark or Scala · SQL & Python · Github · DWH (Snowflake or Presto or Hive or Hadoop) · Data Pipeline & Data Model · We ...
-
Data Engineer –
3 weeks ago
HARMAN International india, IndiaHARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of ...
-
Data Engineer
3 weeks ago
Getmycourse india, IndiaJob Description · This is a remote position. · Job title: Data Engineer · Schedule: Full time; 40 hours per week; Monday to Friday · Rate: 60, ,000 Philippine Pesos per month · We are seeking a highly skilled and experienced Data Engineer to join our Data Engineering team. The ...
-
Data Engineer
3 weeks ago
Oracle india, India Regular EmployeeResponsibilities: · Data Engineering: 1. Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from diverse sources. 2. Implement and optimize distributed computing frameworks such as Apache Hadoop, Apache Sp ...
-
Data Engineer
4 days ago
Anomaly Business Consult IndiaLocation: Remote · Experience: 6+ years · Compensation: Better than industry standards · Only Immediate Joiners Requried · We are looking for a seasoned Azure Data Engineer to join our client's team. The successful candidate will possess extensive experience in designing, develo ...
Data Engineer - india, India - EXL
Description
Data Engineer