Jobs
>
Senior Data Engineer
>
Bengaluru

    Senior Data Engineer - Bengaluru, India - Quantiphi

    Quantiphi
    Quantiphi Bengaluru, India

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    Default job background
    Technology / Internet
    Description

    Role description:

    As a Data Engineer, you will play a pivotal role in designing, developing, and optimizing data pipelines on Google Cloud Platform (GCP). Your primary responsibility will be to ensure efficient data flow and seamless integration with GCP services while adhering to best practices and data architecture standards. Should be comfortable working with extremely abstract and ambiguous requirements. Must be capable of handling extremely changing business environments with the capability to wear multiple hats at once. Must be able to consult improvisations in various old school data engineering methods. Should be a very good team player.

    Key Responsibilities:

    • Design and Develop Data Pipelines: Create robust and efficient (infrastructure and cost efficient) data pipelines on GCP to facilitate the seamless flow of data.
    • Cross-functional Collaboration: Collaborate with cross-functional teams/stakeholders to understand data requirements and deliver high-quality data solutions in the least amount of time.
    • Collaborate with Data Architects: Work closely with client and team data architects to implement data models and pipelines and ensure their integration with GCP services.
    • Optimize Data Storage Solutions: Utilize BigQuery, Cloud Storage, and other appropriate GCP services to optimize data storage solutions.
    • Troubleshooting: Proactively troubleshoot data and pipeline-related issues to ensure smooth operation and reliability.

    Essential Skills:

    • Excellent problem-solving and troubleshooting skills.
    • Ability to work under pressure and extreme tight deadlines.
    • Should be comfortable writing Shell scripts.
    • Strong communication and collaboration abilities
    • Strong proficiency in GCP Data tools, Python and SQL (complex modeling, stored procedures, etc.) with a deep understanding of their core concepts
    • GCP Composer: Leverage working knowledge of GCP Composer for orchestrating and managing workflows efficiently.
    • ETL/ELT Pipeline Development: Develop Extract, Transform, Load (ETL or ELT) pipelines using GCP services such as Cloud Function, Cloud Run, Dataflow, and App Engine, GCS, BIgquery, pubsub, cloud tasks, cloud scheduler, API Gateway
    • Data warehouse concepts

    Good to have:

    • Knowledge of LMS and education sector
    • Working knowledge of IICS
  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    Found in: Appcast Linkedin IN C2 - 4 days ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • Ascendion

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 1 day ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Cloud Raptor

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Cloud Raptor Bengaluru, India

    At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across · many industries. Focused on cloud technologies and technical expertise, we help organisations · navigate the ever-changing landscape of the digital era. · With dedicated Centres of ...

  • Informatica

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • TEKsystems

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • CareerXperts Consulting

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    CareerXperts Consulting Bengaluru, India

    Data Engineer - Become a Data Whisperer · Are you passionate about building the foundation for data-driven decision making? · We're looking for a talented Data Engineer to join our team and play a key role in unlocking the power of our data. You'll design, develop, and maintain d ...

  • Indium Software

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • Razorpay

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Applicantz

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 4 days ago

    Applicantz Bengaluru, India

    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER. · Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use ...

  • Demyst

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago

    Demyst Bengaluru, India

    Our Solution · Demyst unlocks innovation with the power of data. Our platform helps enterprises solve strategic use cases, including lending, risk, digital origination, and automation, by harnessing the power and agility of the external data universe. We are known for harnessing ...

  • TMRW House of Brands

    Data Engineer

    Found in: Talent IN 2A C2 - 6 hours ago

    TMRW House of Brands Bengaluru, India

    Data Engineer III · Responsibilities · Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning. · Develop and maintain core data framework and key infrastructures · Create and support the ETL pipeline to get ...

  • Mastek

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    Mastek Bengaluru, India

    As a Snowflake Data Engineer, you'll lead the design and development of database solutions leveraging cloud tools and technologies. This includes modeling and prototyping database designs, ownership of database scripts, legacy data analysis and ETL/ELT solutions. You will also wo ...

  • Info Origin Inc.

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Info Origin Inc. Bengaluru, India

    NEW OPPORTUNITY || Immediate to 30 days Joiners || Data Engineer · Position Title: Data Engineer · Location: Bangalore/Hyderabad, India On-site · Position Type: Contract to hire · Required Experience: 4+Years · Job Description · Experience and Qualification: · Experience with SQL ...

  • Informatica

    Data Engineer

    Found in: Talent IN 2A C2 - 6 hours ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • JRD Systems

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    JRD Systems Bengaluru, India

    JRD Systems Pvt. Ltd., a US-based company specialized in providing IT & Business Solutions with integration with Data Analytics, Mobility, Digital Technology and Open Source. We provide IT services to various industries like Transport and Logistics, Food Distribution, Automobile, ...

  • Reflections Info Systems

    Data Engineer

    Found in: Talent IN 2A C2 - 6 hours ago

    Reflections Info Systems Bengaluru, India

    Job Description · We are seeking a skilled Data Engineer with a minimum of 6 years of experience, preferably in a lead or key role, in implementing one or two large-scale data solutions. · The ideal candidate will have strong programming abilities in Scala or Python, as well as ...

  • Allica Bank

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    Allica Bank Bangalore Urban, India

    About Allica Bank · We are rare amongst banks in that our senior leadership team includes backgrounds at world-leading FinTechs, which shows in their active engagement with our cross-functional Product Squads, and in our bank-wide adoption of modern tools & techniques such as Dev ...

  • EXL

    Data Engineer

    Found in: Talent IN 2A C2 - 6 hours ago

    EXL Bengaluru, India

    Job Location: Bangalore/Gurgaon · Shift Timing: 12:00PM IST – 10:30 PM IST · Experience: 5+ years · Job Summary: · Data Engineer (DE) is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. · Responsi ...

  • Dexian India

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 6 hours ago

    Dexian India Karnataka, India

    Strong Platform engineer (Admin) experience with Data Mesh/Virtualization such as Dremio and Starburst and a deep understanding of database technologies of various distributed file and table formats such as Iceberg, Delta, Apache and standard methods in data transformation using ...

  • Info Origin Inc.

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Info Origin Inc. Bengaluru, India

    Position Title: Financial Analytics Data Engineer · Location: Hyderabad/Bangalore, KA, Onsite · Position Type: Full-Time · Position Duration: Permanent · Job Description: · The Corporate Solutions Technical Accounting team is looking for financial analytics engineer to design and ...