- Maintain knowledge of evolving industry trends, practices, techniques, and standards on Big Python/Pyspark from application development perspective.
- Be aware of DevOps practices and follow appropriate steps/tools to effect code migration during development phase.
- Collaborate with crosscommit teams for implementation of deliverables in all environments.
- Development of code and design to meet evolving needs while adhering to policy and standards.
- Write test cases for Unit testing and Functional testing when the application is developed
- Conduct and participate in coding and design reviews.
- Manage test plan & risks through development phases to implementation, ensure zero defects are introduced into the production environment.
- Ensure required documentation for projects and/or enhancements are created and updated.
- Monitor and support the production environment applications to ensure optimum stability and performance prior to handing over the code to operations team.
- Be aware of datawarehousing concepts and different facts/dimensionbased modelling mechanisms for implementing in a Datalake environment.
- Bachelor's degree in computer science, Engineering, or related field; or equivalent work experience.
- Mandatory
- Hands on experience in Python and PySpark. Python as a language is practically usable for anything, we are looking for application Development and Extract/Transform/Load and Datalake curation experience using Python.
- Hands on experience in version control tools like Git.
- Worked on Amazon's Analytics services like Amazon Athena, DynamoDB and AWS Glue
- Worked on Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services.
- Experience/knowledge of bash/shell scripting will be a plus.
- Has built ETL processes to take data, copy it, structurally transform it etc. involving a wide variety of formats like CSV, fixed width, XML and JSON.
- Have worked with columnar storage formats
- Parquet, Avro, and ORC etc.
- Hands on experience in tools like Jenkins to build, test and deploy the applications.
- Excellent debugging skills.
- Ability to quickly perform critical analysis and use creative approaches for solving complex problems.
- Strong academic background.
- Excellent written and verbal communication skills, and strong relationship building skills.
-
Data Engineer
2 days ago
Rocket Consulting Anywhere in India/Multiple Locations/Pune permanentA Data Engineer/developer having good experience working with · Primary skills : Python, AirFlow - ETL skills - GCP · Secondary skills : Google Cloud Composer - Google Big Query - Google Cloud · - Storage - SQL - MS SQL Serve · - Proven experience as a Data Engineer/Developer wit ...
-
Data Engineer
1 day ago
Change leaders Anywhere in India/Multiple Locations permanentPrimary Skill - GCP + Python + SQL · OR · GCP + Java + SQL · NP - Immediate to 35 Days max · Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineering e ...
-
Data Engineer
1 week ago
Ridgeant Techonologies Anywhere in India/Multiple Locations permanentResponsibilities : · - Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. · - Design, develop, and maintain data pipelines using AWS serverless techno ...
-
Data Engineer
1 week ago
Lancesoft India Pvt Ltd Anywhere in India/Multiple Locations permanentHiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with busin ...
-
Data Engineer
1 week ago
Arting Digital Anywhere in India/Multiple Locations permanentPosition Title : Data Engineer · Exp : 5+ years · Location : Remote · Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python · Qualification : Any · Roles and responsibilities : · - An offshore Data Engineer to work with the Investment Analytics team. · - This ...
-
Data Engineer
2 days ago
Mobile Programming Anywhere in India/Multiple Locations/Bangalore permanentJob Summary: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning ...
-
Data Engineer
2 days ago
Paralleldots Anywhere in India/Multiple Locations permanentJob Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets t ...
-
Data Engineer
1 week ago
Mobile Programming LLC Anywhere in India/Multiple Locations/Bangalore permanentJob Description : · Position : Data Engineer · Experience : 6+ years · Work Mode : Work from Office · Location : Bangalore · Experience in Nifi or Tibco is mandatory. · Mandatory Skills : ETL, DevOps platform, Nifi or Tibco · Please note : This position is focused on development ...
-
Data Engineer
1 day ago
Perfecthire Anywhere in India/Multiple Locations permanentJob Description : · We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. · A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) tr ...
-
Data Engineer
2 days ago
Aricent Anywhere in India/Multiple Locations permanentJob Profile : Data Engineer · Location : WFO/WFH (Both Available) · Specialization : IT/Cloud/Data Management · Job Description : · - Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; ca ...
-
Data Engineer
1 day ago
Forward Eye Technology Anywhere in India/Multiple Locations permanentJob Description : · Overview : · As a Data Engineer specializing in Azure Data Platform, you will be responsible for designing, building, and maintaining data solutions on Microsoft Azure. Your expertise in data modeling, ETL/ELT processes, and tools such as Azure Data Factory (A ...
-
Data Engineer
6 days ago
AAR Consultancy Anywhere in India/Multiple Locations permanentTechnical Skills : · 1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage. · 2. Data Engineering : Strong understanding of data engineering principles, including ...
-
Data Engineer
1 week ago
Liveconnections Anywhere in India/Multiple Locations permanentSkillset: · Data Engineering with strong SQL expertise. · Should be good in Talend, Snowflake. More preference to certified (in Talend/ Snowflake) resources. · - Should be experienced in implementing DWH projects. · - Having Informatica experience will be value-add. · Relevant Ex ...
-
Data Engineer
2 days ago
Forward eye technologies Anywhere in India/Multiple Locations permanentRole : Data Engineer · Location : Remote · Shift timings : IST · Contract Period : 3 months · Experience : 5 - 8 years · Responsibilities : · - Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues a ...
-
Data Engineer
1 week ago
consultancy Anywhere in India/Multiple Locations permanentNote : It's a work-from-home opportunity. · Skills You must have experience with: · - Twilio Segment - Customer Data Platform · - Google Analytics (Inc. Firebase) · - Experience creating tailored dashboards using PowerBi · - Experience in data management, data warehousing, data q ...
-
Data Engineer
22 hours ago
VAYUZ Technologies Anywhere in India/Multiple Locations permanentResponsibilities : · - Use Azure Data Factory (ADF) to create and manage data pipelines. · - Work with teams to understand what data they need and how to get it. · - Make sure our data is stored and processed efficiently. · - Write SQL queries to manipulate and analyze data.- · - ...
-
Data Engineer
1 week ago
TechFabric Anywhere in India/Multiple Locations permanentJob Description : · Candidate should have minimum 7Yrs working/hands-on experience in the below skills : · - With proficiency in Azure services , ADF, Data bricks, Synapse Analytics and Azure Storage · - Hands on experience in data modelling, batch and real time pipelines using ...
-
Lead Data Engineer
3 days ago
Vista Anywhere in India/Multiple Locations permanentAbout you : · - Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish · - Passionate about GenAI an excited to join a Team working on state of the art GenAI topics · - Ideate an ...
-
Azure Data Engineer
1 week ago
Vikisol Technologies Anywhere in India/Multiple Locations permanentAzure Data Engineer · Opportunity : Remote · Exp : 5+ years · Location : Remote · Skills : · - Azure Databricks · - Azure ADF · - PySpark · - Python · - SQL · Responsibilities : · - Collaborate on ETL data requirements. · - Design and optimize data pipelines (Azure Databric ...
-
Senior Data Engineer
22 hours ago
Rigel Networks Pvt Anywhere in India/Multiple Locations permanentRole Description: · This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL. · As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines. · You will collaborate with cross-functi ...
Data Engineer - Anywhere in India/Multiple Locations - Teksands
Description
The Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team.
You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards.
You must be a self-starter, think outside the box and enjoy coming up with innovative solutions to solve business and technology issues.
You keep yourself updated on the rapid technological advances and advise leadership how these advances can be leveraged to improve efficiency and enable new functionality.
If you are driven to succeed and prepared to meet the ever-changing needs of our industry, then you are ready for a career at Ameriprise.
Duties and Responsibilities:
Skill requirements: