-
Data Engine
4 days ago
Decathlon India Bengaluru, India**Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...
-
Data Enginer
3 days ago
NatWest Group Bengaluru, Karnataka, IndiaOur people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...
-
Data Engine
4 days ago
Decathlon Bengaluru, IndiaPermanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...
-
Data Engineer-1
5 days ago
Commonwealth Bank Bengaluru, India**Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...
-
Data Engineer t9
7 hours ago
Mercedes-Benz Research and Development India Private Limited Bengaluru, India**Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...
-
Data Engineer 169368 Full-time
1 week ago
HyreFox Consultants Bengaluru, India Full timeBuild and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...
-
Azure Data Engineer-3-10years-hyderabad
1 week ago
Black & White Business Solutions Bengaluru, India**Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...
-
Sr Data Engineer/Data Engineer
1 week ago
Trigent Software - Professional Services Bengaluru, IndiaSenior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...
-
Data Engineer
2 days ago
JRD Systems Bengaluru, IndiaRole : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong fo ...
-
Data Engineer
6 days ago
Course5i Bengaluru, IndiaThe Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...
-
Engineer, Data
6 days ago
Giant Eagle GCC , Karnataka, IndiaJob Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...
-
Data Engineer
3 days ago
Recro Bengaluru, IndiaExperience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestration To ...
-
Data Engineer
1 week ago
UNO Digital Bank Bengaluru, IndiaOverview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering po ...
-
Data Engineer
3 days ago
SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, IndiaRole Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...
-
Data Engineer
6 days ago
Quantum Labs Bengaluru, IndiaCompany Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...
-
Data Engineer
3 days ago
TEKsystems Bengaluru, IndiaJob Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...
-
Data Engineers
1 week ago
Multplyr Bengaluru, IndiaPayroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...
-
Data Engineer
4 days ago
Razorpay Bengaluru, IndiaThe Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...
-
Data Engineer
1 day ago
Info Origin Inc. Bengaluru, IndiaNEW OPPORTUNITY || CONTRACT TO HIRE ROLE FINANCIAL ANALYTICS DATA ENGINEER · Required Immediate to 30 days joiners only. · Position Title: Financial Analytics Data Engineer · Location: Bangalore/ Hyderabad/ Pune · Position Type: Contract to hire role · Required Experience: · 3+ ...
-
Data Engineer
10 hours ago
Sun Life Bengaluru, IndiaKey Responsibilities · This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. · Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of e ...
Senior Data Engineer - Bengaluru, India - Infimetrics Info Solutions
Description
Position : Senior Java (Data Engineer).
Reports to : Technical Lead.
Responsible for : Contributing to software development as per business requirements.
Purpose of Role :
- We are a data driven asset management firm with a very wide variety of datasets with varying frequency of updates that essentially drive our research models which ultimately determine the daily trading activity.
- We also trade a wide range of asset classes like Equities, Futures, Options, FX, Swaps, etc.
- New business requirements and enhancements to systems form a key part of our ongoing success.
- We constantly add asset classes to the trading systems, supply new data sets to our researchers, add new funds, create new risk measures, produce new reporting for portfolio managers, client services, fund accounting and improve our trade generation, execution, and back-office processes.
- This role is for a Senior Data Engineer to join the Data Development team.
- The team has a wide remit and are responsible for software changes across a range of systems including data delivery to the business and is spread across India and London.
- The role reports to the Technical Lead based in London and overlaps with UK business ours.
- Most of our existing stack is Java and MS SQL Server based.
- But we are in the process of migrating the data stack to the Cloud where Python is used more.
- We expect Java and Python to co-exist in our Technology landscape.
- The systems are proprietary and built on bespoke internal frameworks, but the direction of travel is more Open Source.
- Snowflake on AWS will be our primary data store going forward.
- We use Excel and Power BI for reporting and visualization.
- We also utilize tools like Jupyter notebooks and Ansible for release and deployment automation.
- We use JIRA for change management and follow an Agile approach to delivery.
- Your role will be to contribute to the development effort across various systems to deliver projects as per specification provided by the business and set by senior technical members of the team.
- You will also be required to provide 3rd line support to the Operations teams and provide necessary software fixes.
- The team generally tends to overlap UK hours but there would be occasional flexibility depending on need.
Primary Duties :
- Build a broad knowledge across various systems and processes via knowledge transfer and capture any missing information on the wiki.
- Gather software requirements by talking to various stakeholders and document them.
- Work closely with onshore teams and Technical Lead to ensure the technical deliveries are in line with business requirements.
- Provide necessary effort and time estimates for tasks to aid scheduling and prioritization.
- Provide necessary 3rd line support to the Operations teams including software fixes as needed.
- Work on any BAU development activity including on-boarding new data sets and delivering new markets into the system.
- Work with external vendors from time to time to gather necessary requirements for new data or changes to existing data specifications.
- Maintain pro-active communication with relevant stakeholders and keep them updated on progress.
General.
- Any other duties commensurate with the post holder's position and seniority; and.
- All employees should understand that it is their personal responsibility to comply with all organisational, statutory and regulatory policies and :
Strong proficiency in programming languages such as Python, Scala, or Java, with a focus on data processing frameworks like Apache Spark or Apache Flink.
Expertise in SQL and relational databases (e.g., PostgreSQL, MySQL) as well as NoSQL databases (e.g., MongoDB, Cassandra).
Experience with distributed computing platforms and technologies such as Hadoop, HDFS, and MapReduce.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud, and their data services (e.g., S3, Redshift, BigQuery).
Solid understanding of data warehousing concepts and technologies (e.g., Snowflake, Amazon Redshift).
Excellent problem-solving skills and attention to detail, with the ability to troubleshoot complex data issues.
Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Preferred Skills :
Experience with streaming data processing frameworks such as Apache Kafka or Apache Beam.
Knowledge of containerization and orchestration tools such as Docker and Kubernetes.
Understanding of machine learning concepts and frameworks (e.g., TensorFlow, PyTorch).
Certifications in relevant data engineering technologies (e.g., AWS Certified Big Data - Specialty, Google Professional Data Engineer).
)