Jobs
>
Bengaluru

    Data Engineer - Bengaluru, India - Banyan Cloud

    Banyan Cloud
    Banyan Cloud Bengaluru, India

    13 hours ago

    Default job background
    Technology / Internet
    Description
    Who are we?
    About US

    Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA, which owns the SaaS product "Banyan Cloud", First of its kind Cyber Security Platform, which simplifies the code to cloud security for multi cloud and multi technologies.

    It's a once-in-a-lifetime opportunity to join our rocket ship start-up run by a world-class executive team.

    We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next gen data evolution challenges.

    This role will be responsible to build a highly scalable, available, and secure data infrastructure.

    The Data Engineer will work with software engineers and data science engineers to build and support various data initiatives of multiple services to ensure optimal data delivery architecture is consistent throughout ongoing projects.


    Job Responsibilities:
    Create and maintain optimal data pipeline architecture for data intensive applications.
    Ability to understand the business requirements, system architecture and process guidelines.
    Ability to code for multiple projects at a time.
    Ability to code for complex requirements under tight timelines.
    Ability to work with cross-functional / domain teams.
    Ability to handle end-to-end projects on an individual basis in fast-paced environment.
    Build, maintain and document data pipelines from scratch.

    Design and build scalable, reliable, and cost-effective data pipelines on the cloud using the latest technologies such as AWS, Azure, or Google Cloud Platform.

    Develop and maintain ETL workflows and data processing pipelines using tools such as Apache Spark and Kafka.
    Develop and maintain ETL pipelines using cloud ETL technologies like AWS Glue, Google Dataflow, Azure Data Factory
    Collaborate with data scientists and analysts to ensure that data is accurate, reliable, and accessible.

    Implement and maintain data storage solutions on the cloud, such as data lakes, data warehouses, or NoSQL databases like MongoDB, DynamoDB.

    Optimize data infrastructure performance and cost by monitoring usage, identifying bottlenecks, and recommending improvements.


    Job Requirements:
    3 to 5 years of experience with large-scale data processing and data pipelines.
    Programming experience on Python, Shell scripting, PySpark, and other data programming languages.
    Interaction with SQL as well as No SQL Databases (Mongodb), data warehouses, data lakes
    Experience with ETL/ELT tools such as Hadoop or Spark SQL tools such as Spark SQLQuery
    Experience with AWS/GCP/Azure web services like AWS Glue, S3, RDS, Azure Data Factory, Blob Storage, Google Data Flow)
    Creation of Web Services / APIs in Python
    Experience working with time series data
    Experience in data privacy and security-related projects

    Added advantage:
    Familiarity with regression and clustering algorithms
    Experience with classification algorithms like decision trees, random forests and XGBoost
    Extensive Experience working with Pandas, sci-kit learn, NumPy
    NLP, Reinforcement learning, Outlier detection, Neural networks
    Experience in Files Processing - XML, CSV, Excel, Json, etc Formats
    Knowledge of Structured and Non-Structured Data processing
    Knowledge of Distributed Big Data Processing
    Experience with 'TensorFlow' is a plus.

    Banyan Cloud provides equal employment opportunity (EEO)

    Banyan Cloud provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, pregnancy, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law.

    If you are unable to submit an application because of incompatible assistive technology or a disability, please contact us at
  • NatWest Group

    Data Enginer

    6 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    1 week ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    1 week ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    3 days ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Commonwealth Bank

    Data Engineer-1

    1 week ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • Deutsche Bank

    Data Engineer-2

    4 hours ago

    Deutsche Bank Bengaluru, Karnataka, India

    **Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    1 week ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Joveo

    Data Engineer

    13 hours ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Ascendion

    Data Engineer

    13 hours ago

    Ascendion Bengaluru, India

    · Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...

  • LeadSquared

    Data Engineer

    13 hours ago

    LeadSquared Bengaluru, India

    Data Engineer: About the Role: We are looking for a data engineer to work on building applications to migrate data from various data sources and building analytics engine to cater to product's KPI requirements along with some knowledge on data science concepts to implement in exi ...

  • JRD Systems

    Data Engineer

    13 hours ago

    JRD Systems Bengaluru, India

    Role · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    6 days ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    1 week ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • C5i

    Data Engineer

    13 hours ago

    C5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • TEKsystems

    Data Engineer

    6 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • Genpact

    Data Engineer

    13 hours ago

    Genpact Bengaluru, India

    Inviting applications for the role of · Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...

  • Razorpay

    Data Engineer

    1 week ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Giant Eagle GCC

    Engineer, Data

    1 week ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...