Jobs
>
Bengaluru

    Senior Cloud Data Engineer - Bangalore, India - Info Origin Inc

    Info Origin Inc
    Info Origin Inc Bangalore, India

    3 days ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description :


    As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms.

    You will work closely with cross-functional teams to deliver scalable and efficient data solutions.


    Your primary responsibilities will include :

    Key Responsibilities :

    • Cloud Data Engineering : Design, develop, and maintain data pipelines, ETL processes, and data workflows on Azure Synapse, leveraging Azure Data Factory and other relevant services.
    • Python and PySpark : Utilize Python and PySpark for data processing and transformation tasks, ensuring data accuracy and performance.
    • Azure DevOps : Implement best practices for CI/CD pipelines, infrastructure as code, and automation to ensure a seamless and efficient development and deployment process.
    • Serverless Computing : Architect and build serverless data solutions using Azure Functions, AWS Lambda, or similar technologies for optimal resource utilization.
    • Data Governance : Implement data governance and data quality standards to ensure data integrity and compliance with regulatory requirements.
    • Performance Optimization : Continuously monitor and optimize data pipelines for scalability, performance, and cost efficiency.
    • Collaboration : Collaborate with data scientists, data analysts, and other stakeholders to understand their data requirements and provide data engineering support.
    • Documentation : Create and maintain technical documentation, including architecture diagrams, data flow diagrams, and standard operating procedures.
    • Mentorship : Provide guidance and mentorship to junior team members, fostering their growth and development.

    Qualifications :

    • Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
    • 810 years of experience in data engineering and cloud solutions.
    • Proficiency in Azure Synapse, Azure Data Factory, and other Azure services.
    • Strong programming skills in Python and experience with PySpark.
    • Experience with Foundry or similar data management platforms.
    • Expertise in Azure DevOps practices and tools.
    • Knowledge of serverless computing and microservices architecture.
    • Strong problemsolving skills and the ability to work in a collaborative, fastpaced environment.
    • Excellent communication and interpersonal skills.
    • Azure certifications (e.g. Azure Data Engineer, Azure DevOps Engineer) are a plus.)
  • HyreFox Consultants

    Data Engineer 169368 Full-time

    3 days ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    13 hours ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    3 days ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Joveo

    Data Engineer

    14 hours ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Ascendion

    Data Engineer

    9 hours ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Giant Eagle GCC

    Engineer, Data

    1 day ago

    Giant Eagle GCC Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Fractal

    Data Engineering

    1 day ago

    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • ParallelDots

    Data Engineer

    5 days ago

    ParallelDots Bengaluru, India

    Company Description · ParallelDots is a leading image recognition solution provider for FMCG companies and retailers globally. Our technology helps optimize in-store execution and maximize sales. For more information on our technology, visit · Role Description · This is a full-t ...

  • Cloud Raptor

    Data Engineer

    5 days ago

    Cloud Raptor Bangalore Urban, India

    At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across · many industries. Focused on cloud technologies and technical expertise, we help organisations · navigate the ever-changing landscape of the digital era. · With dedicated Centres of ...

  • Multplyr

    Data Engineers

    1 day ago

    Multplyr Bengaluru, India

    Payroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...

  • Indium Software

    Data Engineer

    1 day ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • Informatica

    Data Engineer

    1 day ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • TekWissen India

    Data Engineer

    5 days ago

    TekWissen India Bengaluru, India

    Role: Data Engineer · Location: Bangalore, India · Total experience: 7+ Years · Relevant experience: 5-7 Years · Expected Notice period: Immediate · POSITION SUMMARY · Data Engineers build and maintain data systems in support of data analytics and data science activities. The Dat ...

  • IRIS Software Group

    Data Engineer

    14 hours ago

    IRIS Software Group Bengaluru, India

    About IRIS : · IRIS Software Group is one of the UK's largest privately held software companies. Its purpose is to be the most trusted provider of mission-critical software and services, ensuring customers get it right first time, every time. · IRIS takes the pain out of processe ...

  • TEKsystems

    Data Engineer

    4 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • Applicantz

    Data Engineer

    5 days ago

    Applicantz Bengaluru, India

    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER. · Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use ...

  • Banyan Cloud

    Data Engineer

    17 hours ago

    Banyan Cloud Bengaluru, India

    Who are we? · About US · Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA, which owns the SaaS product "Banyan Cloud", First of its kind Cyber Security Platform, which simplifies the code to cloud security for multi ...

  • Mastek

    Data Engineer

    1 day ago

    Mastek Bengaluru, India

    As a Snowflake Data Engineer, you'll lead the design and development of database solutions leveraging cloud tools and technologies. This includes modeling and prototyping database designs, ownership of database scripts, legacy data analysis and ETL/ELT solutions. You will also wo ...

  • Tech Mahindra

    Data Engineer

    1 week ago

    Tech Mahindra Bengaluru, India

    Role: GCP Data Engineer · Location: Hyderabad/ Bengaluru Work from office (Mon-Fri) · Duration: Full Time · Required Technical Skills: · ● More than 7 years' experience implementing data solutions · ● Strong proficiency in Python with an emphasis in building data pipelines · ● Ex ...

  • Razorpay

    Data Engineer

    5 days ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...