Jobs
>
Bengaluru

    Data Engineer - Bangalore, India - Grizmo Labs

    Grizmo Labs
    Grizmo Labs Bangalore, India

    6 days ago

    Default job background
    permanent Technology / Internet
    Description

    Responsibilities :

    • Develop, construct, test, and maintain architectures such as largescale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.
    • Assemble large, complex data sets that meet functional / nonfunctional business requirements, utilizing SQL, NoSQL, and cloudbased data warehousing solutions such as Amazon Redshift or Google BigQuery.
    • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc, using Python and PySpark.
    • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloudbased big data technologies like Apache Flink.
    • Create and design Data Lake with AWS Services like S3 Lambda, Step Functions, Cloud Formation, Kinesis, and Firehose.
    • Working knowledge of Apache Superset and Airbyte.
    • Work with stakeholders including the Executive, Product, Data, and Design teams to assist with datarelated technical issues and support their data engineering needs using data visualization tools like Tableau, Superset, Indicative
    • Create data tools for analytics and data engineering team members that assist them in building and optimizing our product into an innovative industry leader, using machine learning frameworks like TensorFlow, PyTorch, or Scikit-Learn.
    • Create segmentation using graph databases and knowledge with tools like Neo4j, AWS Neptune, or GraphQL.
    • Document and communicate data engineering solutions and methodologies using tools like Confluence, and Jira.
    • Assess and implement new data engineering tools and technologies to stay ahead in the industry.
    • Troubleshoot and solve issues in the data engineering infrastructure using monitoring and debugging tools like ELK Stack.

    Requirements :

    • The candidate should have at least 35 years of experience in building AWS Data Platform Solutions or relative BI Experience.
    • Experience in building and optimizing data pipelines using AWS/DBT ETL tools.
    • Experience with Superset, Airbyte, AWS S3 Lambda, Step Functions, AWS Redshift.
    • Experience in designing and deploying data platforms for supporting various data use cases including batch analysis, and realtime analytics.
    • Experience using Python, PySpark, Kinesis, Firehose, and Kafka for realtime streaming analytical solutions.
    • Experience in Data governance frameworks.
    • Experience in MySQL and Python.
    • Experience in Optimization of queries.
    • Good understanding of Data warehousing concepts.
    • Experience in Tableau, Hadoop, and AI/ML Data modeling.
    • Experience in Hive, Hbase, and EMR clusters.
    )
  • NatWest Group

    Data Enginer

    16 hours ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon India

    Data Engine

    1 day ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Decathlon

    Data Engine

    1 day ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Commonwealth Bank

    Data Engineer-1

    2 days ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    4 days ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Joveo

    Data Engineer

    4 days ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Ascendion

    Data Engineer

    4 days ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Giant Eagle GCC

    Engineer, Data

    3 days ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Recro

    Data Engineer

    14 hours ago

    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestration To ...

  • Course5i

    Data Engineer

    3 days ago

    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • UNO Digital Bank

    Data Engineer

    4 days ago

    UNO Digital Bank Bengaluru, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering po ...

  • Multplyr

    Data Engineers

    5 days ago

    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • Informatica

    Data Engineer

    5 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Indium Software

    Data Engineer

    5 days ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    14 hours ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    3 days ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • Sun Life

    Data Engineer

    5 days ago

    Sun Life Bengaluru, India

    Key Responsibilities · This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. · Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of e ...

  • Informatica

    Data Engineer

    5 days ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...