- Participate in the customer's system design meetings and collect the functional/technical requirements.
- Build up data pipelines for consumption by the data science team.
- Skillful in ETL process and tools.
- Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
- Experience in writing Python programs and SQL queries.
- Experience in SQL Query tuning.
- Experienced in Shell Scripting (Unix/Linux).
- Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.
- Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.
- Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka
- Suggest and implement best practices in data integration.
- Guide the QA team in defining system integration tests as needed.
- Split the planned deliverables into tasks and assign them to the team.
- Needs to Maintain/Deploy the ETL code and follow the Agile methodology
- Needs to work on optimization wherever applicable.
- Good oral, written and presentation skills.
- Degree in Computer Science, IT, or a similar field; a Master's is a plus.
- Hands-on experience with Python and Pyspark Or
- Hands-on experience with Spark and SCALA.
- Great numerical and analytical skills.
- Working knowledge of cloud platforms such as MS Azure, AWS, etc..
- Technical expertise in data models, data mining, and segmentation techniques
-
Data Engineer
3 weeks ago
ReleWant india, IndiaJob Description · Chi siamo? · Relewant è una società di consulenza specializzata in ambito informatico con sede a Chiasso, in Svizzera. · Con noi, potrai mettere a frutto il tuo potenziale in un team coeso e vincente ed esplorare tecnologie sempre più innovative in contesti mu ...
-
WH371561 - Data Engineer
3 weeks ago
Westhouse india, IndiaJob Description · Westhouse è una società leader che opera nel campo della ricerca & selezione del personale, gestione · di progetti ed è autorizzata a tempo indeterminato per la somministrazione di lavoro con Autorizzazione Ministeriale Prot. n del 03/08/2018 · Per un nostro im ...
-
Operations Specialist
3 weeks ago
Data Engineer Academy india, IndiaJob Title: Operations Analyst · Location : Remote · Company Overview: · Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to ...
-
Data engineer
3 weeks ago
alfabet india, IndiaJob Description · Wij zijn gepassioneerd door innovatie in de vastgoedsector. Als een dynamisch team met een platte organisatiestructuur, streven we ernaar om door middel van geavanceerde data-analyse en AI-technologie de vastgoedwereld te revolutioneren. · We zijn op zoek naar ...
-
Data Engineer
3 weeks ago
Paralleldots Anywhere in India/Multiple Locations permanentJob Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets ...
-
Data Engineer
3 weeks ago
Connectio IT Pvt Ltd Bangalore/Anywhere in India/Multiple LocationsThis is a full-time on-site role for a GCP Data Engineer. · As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. · Job Description : · You will work closely with the developme ...
-
Data Engineer
3 weeks ago
Pro5 (formerly Mangtas) india, IndiaThe Data Engineer will have strong software engineering skills, designing and creating data architectures for the data engineering and machine learning solutions we build. · Responsibilities include understanding of Data Engineering requirements, design, development of data pipe ...
-
Data Engineer
3 weeks ago
Coders Brain Technology Pvt. Ltd. Anywhere in India/Multiple LocationsPosition Name : Data Engineer (Integration) · Experience Required : 10+yrs · Salary : As per the Market Standard or Else whatever budget you have · Notice period : Immediate joiner · Job Type : Full time · Location : Remote · Job Description : · - Understand all forms of da ...
-
Data Engineer
3 weeks ago
HARP Technologies and Services india, IndiaJob Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...
-
Data Engineer
3 weeks ago
Artefact india, IndiaArtefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing grow ...
-
Data Engineer
3 weeks ago
System Soft Technologies india, IndiaJob Summary · Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposes · Qualification · As a data engineer, your main resp ...
-
Data Engineer
3 weeks ago
KARYA CONSULTANTS PRIVATE LIMITED india, IndiaAs a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...
-
Data Engineer
3 weeks ago
Huquo Consulting india, IndiaPosition : Data Engineer · Location : Gurgaon · Experience : Min 4+ years · Role & Responsibilities Overview : · - A seasoned data team member with a good grasp of both business and technical aspects. · Good familiarity with data stack · - Interact with the other members of the ...
-
Data Engineer
2 days ago
Lingaro IndiaRole: Data Engineer – Lead Consultant · Location: India · About Lingaro: · Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping ...
-
Data Engineer
3 weeks ago
Prescience Decision Solutions india, IndiaJob Description Build and support ETL jobs and components using Apache Spark, Python, Pyspark, Talend, Kafka, Hadoop, Airflow, and Google Cloud Platform (GCP). · Conduct requirement gathering sessions and comprehend project needs, translating them into technical tasks utilizing ...
-
Data Engineer
3 weeks ago
Capleo Global india, IndiaLead Data Engineer · Experience: 8-10 years · Location: Bengaluru · Availability: Immediate to 30 days · Mandatory Skills: · Spark · Databricks · PySpark or Scala · SQL & Python · Github · DWH (Snowflake or Presto or Hive or Hadoop) · Data Pipeline & Data Model · We ...
-
Data Engineer –
3 weeks ago
HARMAN International india, IndiaHARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of ...
-
Data Engineer
3 weeks ago
Getmycourse india, IndiaJob Description · This is a remote position. · Job title: Data Engineer · Schedule: Full time; 40 hours per week; Monday to Friday · Rate: 60, ,000 Philippine Pesos per month · We are seeking a highly skilled and experienced Data Engineer to join our Data Engineering team. The ...
-
Data Engineer
4 days ago
Anomaly Business Consult IndiaLocation: Remote · Experience: 6+ years · Compensation: Better than industry standards · Only Immediate Joiners Requried · We are looking for a seasoned Azure Data Engineer to join our client's team. The successful candidate will possess extensive experience in designing, develo ...
-
Data Engineer
3 weeks ago
Oracle india, India Regular EmployeeResponsibilities: · Data Engineering: 1. Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from diverse sources. 2. Implement and optimize distributed computing frameworks such as Apache Hadoop, Apache Sp ...
Data Engineer - india, India - Cynosure Corporate Solutions
Description
Job DescriptionJob Description:
We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To
succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.
Job Requirements:
Apache Kafka, Apache Spark, Hadoop, Hive, MySQL, PySpark, Python, SCALA