Jobs
>
Bengaluru

    Big Data Engineer - Bangalore Urban, India - Algonomy

    Algonomy
    Algonomy Bangalore Urban, India

    Found in: Talent IN 2A C2 - 3 days ago

    Default job background
    Technology / Internet
    Description

    Role : Big Data Engineer

    Years of experience : 5-8 years

    Location : Bangalore

    At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.

    We aim to become the algorithmic bridge between consumers and brands/retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algonomy signifies an expertise in algorithms. As technology evolves our lives (and our clients') at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry's needs

    We are seeking an experienced Big Data Engineer with a minimum of 5 years of relevant experience to join our team to contribute to the development and maintenance of a robust data lake infrastructure on AWS and Azure platforms. The ideal candidate will possess in-depth expertise in big data technologies, data lake architecture, and cloud services, particularly AWS and Azure.

    Key Responsibilities:

    Design, architect, and build data lake solutions on AWS and Azure environments, ensuring scalability, availability, and security of data.

    Collaborate with cross-functional teams to understand data requirements, and implement data ingestion, processing, and storage solutions within the data lake framework.

    Optimize and tune data lake performance, implement data governance, and ensure data quality and consistency.

    Develop Extract, Transform, Load (ETL) processes, implement data pipelines, and orchestrate data workflows to support analytics and reporting needs.

    Conduct performance monitoring, troubleshooting, and capacity planning for the data lake infrastructure.

    Stay up-to-date with emerging technologies and best practices in big data, data lake, and cloud computing, and provide recommendations for continuous improvement.

    Minimum Requirements:

    Bachelor's degree in Computer Science, Engineering, or a related field.

    Minimum of 5 years of professional experience in big data engineering, data lake development, and cloud platforms (specifically AWS and Azure).

    Proficiency in big data technologies such as Hadoop, Spark, Hive, and related ecosystem tools.

    Hands-on experience with cloud services including Amazon S3, Amazon EMR, Amazon Redshift , AWS Athen , Azure Data Lake Storage, Azure HDInsight, Azure Synapse and related data services.

    Strong programming skills in languages such as SQL,Python, Scala, or Java for data processing and transformation.

    Knowledge of data warehousing concepts, data profile, data modeling, and database technologies.

    Experience with DevOps practices, containerization, and infrastructure as code tools (e.g., Docker, Kubernetes, Terraform) is a plus.

    Excellent problem-solving abilities, strong analytical skills, and the ability to work effectively in a team environment.

    We offer a collaborative and innovative work environment with opportunities for professional growth and development. If you are passionate about building scalable, high-performance data lake solutions and thrive in a dynamic, fast-paced environment, we encourage you to apply and join our team.

    ABOUT ALGONOMY

    Algonomy (previously Manthan-Rich Relevance) empowers leading brands to become digital-first with the industry's only real-time Algorithmic Customer Engagement (ACE) platform with built-in customer activation and analytics for the retail industry. With industry-leading retail AI expertise connecting demand to supply with a real-time customer data platform as the foundation, Algonomy enables 1:1 omnichannel personalization, customer journey orchestration & analytics, merchandising analytics and supplier collaboration. Algonomy is a trusted partner to more than 400 leading retailers, consumer brands, quick serve restaurant chains, convenience stores and more, and our global presence spans over 20 countries. More at

  • Joveo

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Multplyr

    Data Engineers

    Found in: Talent IN 2A C2 - 17 hours ago

    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • Ascendion

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Fractal

    Data Engineering

    Found in: Talent IN 2A C2 - 2 days ago

    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • Indium Software

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • IRIS Software Group

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago

    IRIS Software Group Bengaluru, India

    About IRIS : · IRIS Software Group is one of the UK's largest privately held software companies. Its purpose is to be the most trusted provider of mission-critical software and services, ensuring customers get it right first time, every time. · IRIS takes the pain out of processe ...

  • JRD Systems

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    JRD Systems Bengaluru, India

    JRD Systems Pvt. Ltd., a US-based company specialized in providing IT & Business Solutions with integration with Data Analytics, Mobility, Digital Technology and Open Source. We provide IT services to various industries like Transport and Logistics, Food Distribution, Automobile, ...

  • Tech Mahindra

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 1 day ago

    Tech Mahindra Bengaluru, India

    Role: GCP Data Engineer · Location: Hyderabad/ Bengaluru Work from office (Mon-Fri) · Duration: Full Time · Required Technical Skills: · ● More than 7 years' experience implementing data solutions · ● Strong proficiency in Python with an emphasis in building data pipelines · ● Ex ...

  • Mastek

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Mastek Bengaluru, India

    As a Snowflake Data Engineer, you'll lead the design and development of database solutions leveraging cloud tools and technologies. This includes modeling and prototyping database designs, ownership of database scripts, legacy data analysis and ETL/ELT solutions. You will also wo ...

  • Reflections Info Systems

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Reflections Info Systems Bengaluru, India

    Job Description · We are seeking a skilled Data Engineer with a minimum of 6 years of experience, preferably in a lead or key role, in implementing one or two large-scale data solutions. · The ideal candidate will have strong programming abilities in Scala or Python, as well as ...

  • TMRW House of Brands

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    TMRW House of Brands Bengaluru, India

    Data Engineer III · Responsibilities · Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning. · Develop and maintain core data framework and key infrastructures · Create and support the ETL pipeline to get ...

  • Allica Bank

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Allica Bank Bangalore Urban, India

    About Allica Bank · We are rare amongst banks in that our senior leadership team includes backgrounds at world-leading FinTechs, which shows in their active engagement with our cross-functional Product Squads, and in our bank-wide adoption of modern tools & techniques such as Dev ...

  • Tech Mahindra

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 days ago

    Tech Mahindra Bengaluru, India

    Experience level- 4+ years · Location- Bangalore · Shift- 12 PM to 9 PM/ 1 PM to 10 PM · Job Functions / Responsibilities · Build and document automated data pipelines from a wide range of data sources with an emphasis on automation and scale · Develop highly available applicatio ...

  • Informatica

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Intuitive Apps

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    Intuitive Apps Bengaluru, India

    Key Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, Databricks · Job Description : · Create and maintain optimal data pipeline architecture · Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required. · Design and develop ...

  • Mobile Programming

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Mobile Programming Bengaluru, India

    Job Summary: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning ...

  • Info Origin Inc.

    Data Engineer

    Found in: Talent IN 2A C2 - 17 hours ago

    Info Origin Inc. Bengaluru, India

    Position Title: Financial Analytics Data Engineer · Location: Hyderabad/Bangalore, KA, Onsite · Position Type: Full-Time · Position Duration: Permanent · Job Description: · The Corporate Solutions Technical Accounting team is looking for financial analytics engineer to design and ...

  • Sun Life

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Sun Life Bengaluru, India

    Key Responsibilities · This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. · Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of e ...

  • Informatica

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • EXL

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    EXL Bengaluru, India

    Job Location: Bangalore/Gurgaon · Shift Timing: 12:00PM IST – 10:30 PM IST · Experience: 5+ years · Job Summary: · Data Engineer (DE) is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. · Responsi ...