- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.
- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture
- Mentoring Fother Junior Engineers in the Team
- Be a "goto" expert for data technologies and solutions
- Ability to provide on the ground troubleshooting and diagnosis to architecture and design challenges
- Troubleshooting and resolving technical issues as they arise
- Looking for ways of improving both what and how data pipelines are delivered by the department
- Translating business requirements into technical requirements, such as entities that need to be modelled, DBT models that need to be build, timings, tests and reports
- Owning the delivery of data models and reports end to end
- Perform exploratory data analysis in order to identify data quality issues early in the process and implement tests to ensure prevent them in the future
- Working with Data Analysts to ensure that all data feeds are optimised and available at the required times. This can include Change Capture, Change Data Control and other "delta loading" approaches
- Discovering, transforming, testing, deploying and documenting data sources
- Applying, help defining, and championing data warehouse governance: data quality, testing, coding best practises, and peer review
- Building Looker Dashboard for use cases if required
- Having 8+ years of extensive development experience using snowflake or similar data warehouse technology
- Having working experience with dbt and other technologies of the modern datastack, such as Snowflake, Apache Airflow, Fivetran, AWS, git ,Looker
- Experience in agile processes, such as SCRUM
- Extensive experience in writing advanced SQL statements and performance tuning them
- Experience in Data Ingestion techniques using custom or SAAS tool like fivetran
- Experience in data modelling and can optimise existing/new data models
- Experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with largescale, complex datasets
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
Resources valley Jaipur/Remote, India permanentJob Description : · Ownership of Data Engineering solution development, including ingestion, transformation, loading, modelling, curation, profiling, migration, and validation of data, also maintaining security, access control, compliance, and SLAs · - Design and create data mode ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Vbeyond Delhi NCR/Mumbai/Noida, India permanentJOB SUMMARY : · We are seeking a skilled and experienced Data Engineer with strong developments skills and solid track record in terms of implementing scalability, availability and excellence when building data pipelines and platforms for our royalties and revenue share initiati ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
KARYA CONSULTANTS PRIVATE LIMITED Delhi, IndiaAs a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
INSIGHT GLOBAL SOLUTIONS Bangalore/Any Location, India permanentData Engineer · Must Haves : · - Bachelors Degree in science, technology, or another related field. · - 3+ years of data engineering experience. · - 3+ years of experience with Cloud platforms like GCP, Azure, Airflow. · - 4+ years of data warehouse, relational database, and SQL ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
WovV Technologies Bangalore/Any Location, India permanentJob Description : Data Engineer · Location : Remote · Experience : 5+ years. · Durations : 6 months with a very likely extension · Mandatory Technology : DBT, SQL, Snowflake,data integration practices, and Tableau · Primary Skills : Expertise in transaction refunds and a comprehe ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
HS Solutions Inc Any Location/Overseas/International/Bangalore/Atlanta, India permanentAbout the job : · Tech stack : · BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc. · - 3-5 years' Experience in Data warehouse and Data lake implementation. · - 1-2 years of experience in Google Cloud Platform (especially Big Query). · - 1-2 years of w ...
-
Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Vision Beyond Resources India Pvt. Ltd. Noida/Gurgaon/Gurugram/Delhi NCR/Chennai/Mumbai, India permanentRole : Data : UK Shift Range : 7+ Requirements : · - Excellent understanding of data structures with 5+ years of experience in enterprise-wide data platforms design and implementation. · - Strong knowledge of common design patterns used in Data Integrations and Warehousing. · - P ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
Triumph Ladders Pvt. Ltd. Delhi, India permanentTitle - Data Engineer · Exp years · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
USEReady Technology Pvt. Ltd. Any Location/Bangalore, India permanentRole Responsibility : · - Translate functional specifications and change requests into technical specifications. · - Translate business requirement document, functional specification, and technical specification to related coding. · - Develop efficient code with unit testing and ...
-
Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
Triumph Ladders Pvt. Ltd. Delhi, India permanentTitle - Data Engineer · Exp yrs · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group · - ...
-
Data Engineering Manager
Found in: Talent IN 2A C2 - 1 day ago
Woolworths Group International Delhi, IndiaWhat we're like · At BIG W every day's a big day. For you, this could be the start of something big. · There are over 15,000 of us, in the biggest cities and the tiniest towns. And each of us has an important role to play to help make a real difference for families by providing r ...
-
Senior Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
Randstad Bangalore/Any Location, India permanentJob Description: · We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. · The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations ...
-
Azure Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
Visionyle Any Location, India permanentPosition Name: Azure Data Engineer · Position Mode: Permanent · Experience: 6 Years · Joining Location: Remote · Notice: Immediate · Mode of Interview : 2-3 rounds · SUMMARY: · Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Da ...
-
Senior Data Engineer
Found in: Talent IN 2A C2 - 3 days ago
Muoro Any Location, India permanentRole & Responsibilities: · - Design, architect, and develop code in a testable, scalable, and performant manner. · - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. · - Build a team that mines, analyzes, ...
-
AWS Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Change leaders Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India permanentJob Description : AWS Glue + Python Pyspark · Job Overview : · Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data ...
-
Senior Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Geektrust Bangalore/Remote, India permanentRole : Senior Data Engineer · Focus : AWS ecosystem · Key Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams. · Primary Skills : · Prog ...
-
Data Visualization Engineer
Found in: Talent IN 2A C2 - 3 days ago
Mobile Programming LLC Any Location, India permanentJob Description : · Mobile Programming is urgently hiring for a Data visualization Engineer who is responsible for the graphical representation of information and data. To be successful in this field, you must have knowledge of visual elements like charts, graphs, and maps, data ...
-
Data Warehouse Engineer
Found in: Talent IN 2A C2 - 2 days ago
INSIGHT GLOBAL SOLUTIONS Any Location/Bangalore, India permanentMust-haves : · - 5+ years of Data Warehouse engineering experience. · - Strong proficiency in Linux/Unix tools and scripting (Python). · - Strong proficiency with integrating ETL tools with database load utilities. · - Cloud Data Lake/Data warehouse technology and tools (Databric ...
-
Big Data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Sureminds Solutions Pvt. Ltd. Bangalore/Delhi NCR/Noida/Gurgaon/Gurugram/Pune, India permanentJob Description have skills : · 1. Handson experience of Spark, Scala and conversant with SQL · 2. Good knowledge on Hadoop (Oozie) · 3. Reverse engineer the SQL queries, Scala code to understand functionality · 4. Capable of identifying, analysing and interpret patterns and tren ...
-
GCP data Engineer
Found in: Talent IN 2A C2 - 2 days ago
Impetus Delhi, IndiaThe ideal candidate is a self-motivated, multi-tasker, and demonstrated team-player. You will be a lead developer responsible for the development of new software products and enhancements to existing products. You should excel in working with large-scale applications and framewor ...
Data Engineer - Bangalore/Gurgaon/Gurugram/Delhi NCR, India - SKYGATE CONSULTING
Found in: Talent IN 2A C2 - 2 days ago
Description
Data Engineer (Snowflake)Job Description :
As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.
We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt , Tableau/Looker for our business intelligence and embrace AWS with some GCP.
As a Data Engineer you'll be :