Jobs
>
Bengaluru

    Big Data Engineer - bangalore, India - ATech

    ATech
    ATech bangalore, India

    12 hours ago

    Default job background
    Technology / Internet
    Description
    Hiring For Big Data Engineer (Spark, Scala, AWS)


    Job description :

    • Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.
    • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
    • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
    • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.
    • Solid handson and Solution Architecting experience in Big-Data Technologies (AWS)
    • Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR
    • Handson experience of programming language like Scala with Spark.
    • Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases
    • Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred
    • Handson experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie
    • Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming)
    • Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation

    Technical skills requirements :

    • Hands on working Experience with AWS Athena
    • Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo
    • Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)
    • Feature Engineering Data Processing to be used for Model development
    • Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
    • Experience building data pipelines for structured unstructured, realtime batch, events synchronous asynchronous using MQ, Kafka, Steam processing
    • Handson working experience in analysing source system data and data flows, working with structured and unstructured data
    Must be very strong in writing SQL queries

    • Strengthen the Data engineering team with Big Data solutions
    • Strong technical, analytical, and problemsolving skills
    • Strong organizational skills, with the ability to work autonomously as well as in a teambased environment
    • Pleasant Personality, Strong Communication & Interpersonal Skills.
    )
  • Decathlon India

    Data Engine

    6 days ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • NatWest Group

    Data Enginer

    6 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    6 days ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    2 days ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Commonwealth Bank

    Data Engineer-1

    1 week ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    1 week ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    6 days ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    1 week ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • TEKsystems

    Data Engineer

    6 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • Razorpay

    Data Engineer

    1 week ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Ascendion

    Data Engineer

    7 hours ago

    Ascendion Bengaluru, India

    · Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...

  • UNO Digital Bank

    Data Engineer

    7 hours ago

    UNO Digital Bank Bengaluru, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering pos ...

  • Zyient

    Data Engineer

    7 hours ago

    Zyient Bengaluru, India

    Job Description/Requirements: · 1.6+ years of experience in data engineering or software development roles, with a focus on building and maintaining data pipelines and infrastructure. · Proficiency in programming languages such as Python, Java, or Scala, and experience with data ...

  • Info Origin Inc.

    Data Engineer

    1 week ago

    Info Origin Inc. Bengaluru, India

    NEW OPPORTUNITY || Immediate to 30 days Joiners || Data Engineer · Position Title: Data Engineer · Location: Bangalore/Hyderabad, India On-site · Position Type: Contract to hire · Required Experience: 4+Years · Job Description · Experience and Qualification: · Experience with SQL ...

  • LeadSquared

    Data Engineer

    7 hours ago

    LeadSquared Bengaluru, India

    Data Engineer: About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in exi ...

  • JRD Systems

    Data Engineer

    7 hours ago

    JRD Systems Bengaluru, India

    Role · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...

  • Informatica

    Data Engineer

    1 week ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • C5i

    Data Engineer

    7 hours ago

    C5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...