- Create and maintain optimal data pipeline architecture
- Assemble large, complex data sets that meet functional / nonfunctional business requirements
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with datarelated technical issues and support their data infrastructure needs
- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
- Work with data and analytics experts to strive for greater functionality in our data systems
- Advanced SQL and relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Strong analytic skills related to working with structured and unstructured datasets
- Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Manipulating, processing and extracting value from large disconnected datasets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- Big data tools like Hadoop, Spark, Kafka, etc.
- Message queuing, stream processing, and highly scalable big data data stores
- Building and optimizing big data data pipelines, architectures and data sets
- Relational SQL and NoSQL databases, including Postgres and Cassandra
- Development of data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- AWS cloud services: EC2, EMR, RDS, Redshift
- Streamprocessing systems: Storm, Spark-Streaming, etc.
- Objectoriented/object function scripting languages: Python, Scala, etc.
- Visualization tools
- Tableau, Power BI, Qlik etc.
- Rapid enhancement of skills with constant exposure to new industries and projects
- Diverse, dynamic and engaged data science environments
- To influence project direction and make significant contributions
- Opportunities to work closely with our industry and functional leads to elevate project delivery
- Constructive mentorship and career progression options
-
Data Enginer
6 days ago
NatWest Group Bengaluru, Karnataka, IndiaOur people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...
-
Data Engine
1 week ago
Decathlon Bengaluru, IndiaPermanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...
-
Data Engine
1 week ago
Decathlon India Bengaluru, India**Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...
-
Data Engineer t9
3 days ago
Mercedes-Benz Research and Development India Private Limited Bengaluru, India**Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...
-
Data Engineer-1
1 week ago
Commonwealth Bank Bengaluru, India**Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...
-
Data Engineer-2
14 hours ago
Deutsche Bank Bengaluru, Karnataka, India**Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...
-
Data Engineer 169368 Full-time
1 week ago
HyreFox Consultants Bengaluru, India Full timeBuild and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...
-
Azure Data Engineer-3-10years-hyderabad
1 week ago
Black & White Business Solutions Bengaluru, India**Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...
-
Data Engineer
22 hours ago
Joveo Bengaluru, IndiaWe are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...
-
Data Engineer
22 hours ago
Ascendion Bengaluru, India· Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...
-
Data Engineer
22 hours ago
LeadSquared Bengaluru, IndiaData Engineer: About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in exi ...
-
Data Engineer
22 hours ago
JRD Systems Bengaluru, IndiaRole · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...
-
Data Engineer
6 days ago
SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, IndiaRole Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...
-
Data Engineer
1 week ago
Quantum Labs Bengaluru, IndiaCompany Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...
-
Sr Data Engineer/Data Engineer
1 week ago
Trigent Software - Professional Services Bengaluru, IndiaSenior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...
-
Data Engineer
22 hours ago
C5i Bengaluru, IndiaThe Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...
-
Data Engineer
6 days ago
TEKsystems Bengaluru, IndiaJob Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...
-
Data Engineer
1 week ago
Razorpay Bengaluru, IndiaThe Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...
-
Data Engineer
22 hours ago
Ascendion Bengaluru, IndiaJob Title: Data Engineer · Job Location: Bangalore (Remote) · Experience Level: · 5-8 Years · Job Summary: · We are seeking an experienced Data Engineer with a strong background in SQL Server and Azure Data Factory to join our team. The ideal candidate will be responsible for des ...
-
Data Engineer
22 hours ago
UNO Digital Bank Bengaluru, IndiaOverview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering pos ...
Data Engineer - bangalore, India - HuQuo
Description
As Data Engineer, your specific responsibilities include the following :What we seek :
We are looking for a candidate with 2+ years of experience in a Data Engineer role for Mumbai location, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
What you can expect :
We emphasize career development, providing our data engineers with constructive feedback and mentorship through their careers. Our goal is to help our people be successful professionals and grow with their teams.
Data Engineers can expect :