Jobs
>
Senior Data Engineer
>
Bengaluru

    Senior Data Engineer - Bengaluru, India - Mitchell Martin Inc.

    Mitchell Martin Inc.
    Mitchell Martin Inc. Bengaluru, India

    Found in: Appcast Linkedin IN C2 - 5 hours ago

    Default job background
    Description

    JOB DESCRIPTION

    The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.

    The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering Centre of Excellence in Bangalore, India. This is a great opportunity to join a data-first media company and be part of our Enterprise Data Platform team that prides itself in making Clients a data-driven organization. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.

    A SNAPSHOT OF YOUR RESPONSIBILITIES

    • Collaborate with and across Agile teams to design and develop data engineering solutions by rapidly delivering value to our customers
    • Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
    • Design and develop highly optimized data engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
    • Build highly performing real-time data ingestion solutions for streaming workloads
    • Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
    • Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
    • Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
    • Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
    • Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
    • Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
    • Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.
    • Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
    • Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
    • Communicate clearly and effectively to technical and non-technical leadership

    WHAT YOU WILL NEED

    • Education: Bachelor's degree in Computer Science, Computer Engineering, or relevant field

    Work Experience:

    • Senior Data Engineer: 7+ years of experience in architecting, designing and building Data Engineering solutions and Data Platforms
    • Experience in building Data Warehouses/Data Platforms on Redshift/Snowflake
    • Experience working with data acquisition and transformation tools such as Fivetran and DBT
    • Experience building highly optimized & efficient data engineering pipelines using Python, PySpark
    • Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink
    • Experience working with real-time data streams processing using Apache Kafka, Kinesis or Flink
    • Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)
    • Expertise in Advanced SQL programming and SQL Performance Tuning
    • Experience with version control tools such as GitHub or Bitbucket.
    • Expert level understanding of dimensional modeling techniques
    • Excellent communication, adaptability, and collaboration skills
    • Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
    • Strong logical and problem-solving skills with critical thinking

    NICE TO HAVE, BUT NOT A DEALBREAKER

    • Experience in designing and building applications using Container and serverless technologies
    • Experience working with fully automated workflow scheduling and orchestration services such as Apache Airflow
    • Experience working with semi-structured, unstructured data, No SQL databases
    • Experience with CI/CD using GitHub Actions or Jenkins
    • Experience designing and building APIs
  • TMRW House of Brands

    Data Engineer

    Found in: Talent IN 2A C2 - 5 hours ago

    TMRW House of Brands Bengaluru, India

    Data Engineer III · Responsibilities · Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning. · Develop and maintain core data framework and key infrastructures · Create and support the ETL pipeline to get ...

  • Informatica

    Data Engineer

    Found in: Talent IN 2A C2 - 5 hours ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    Found in: Appcast Linkedin IN C2 - 4 days ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • EXL

    Data Engineer

    Found in: Talent IN 2A C2 - 5 hours ago

    EXL Bengaluru, India

    Job Location: Bangalore/Gurgaon · Shift Timing: 12:00PM IST – 10:30 PM IST · Experience: 5+ years · Job Summary: · Data Engineer (DE) is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. · Responsi ...

  • Tavant

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 hours ago

    Tavant Bengaluru, India

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufa ...

  • Ecolab Digital Center

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 hours ago

    Ecolab Digital Center Bengaluru, India

    3+ Years professional experience in a data Engineer/analyst role or similar. · o At least 1 year of Development experience in ADF V2 . · o At least 1 years of Experience with Spark (PySpark and other python data libraries), Spark Scala is also fine. · o At least 1 years of experi ...

  • Datafoundry

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 1 hour ago

    Datafoundry Bengaluru, India

    Job Role - Data Engineer · Experience: 4-7 years · Location – Bangalore / Hyderabad / Visakhapatnam · Work Mode – On-site / Work from office (5 working days) · About Datafoundry AI: · We're Datafoundry AI, a dedicated team of data scientists, life sciences experts, and technol ...

  • Course5i

    Data Engineer

    Found in: Talent IN 2A C2 - 5 hours ago

    Course5i Bengaluru, India

    OVERVIEW · Course5 Intelligence · We enable organizations to make the most effective strategic and tactical moves relating to their customers, markets, and competition at the rapid pace that the digital business world demands. Founded in 2000, our business areas include Market ...

  • DigiKey Global Capability Center

    Data Engineer

    Found in: Talent IN 2A C2 - 5 days ago

    DigiKey Global Capability Center Bengaluru, India

    Data Engineer · Position Overview · This position is responsible for the design, development, and deployment of extraction, transformation, and load (ETL) processes and methodologies to satisfy corporate data movements across various environments. · This is not exclusively an ess ...

  • Coders Brain Pvt Ltd

    Data Engineer

    Found in: Talent IN 2A C2 - 8 hours ago

    Coders Brain Pvt Ltd Mumbai/Chennai/Pune/Bangalore, India permanent

    JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all aspects of the soft ...

  • Cloud Raptor

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Cloud Raptor Bengaluru, India

    At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across · many industries. Focused on cloud technologies and technical expertise, we help organisations · navigate the ever-changing landscape of the digital era. · With dedicated Centres of ...

  • TEKsystems

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • CareerXperts Consulting

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    CareerXperts Consulting Bengaluru, India

    Data Engineer - Become a Data Whisperer · Are you passionate about building the foundation for data-driven decision making? · We're looking for a talented Data Engineer to join our team and play a key role in unlocking the power of our data. You'll design, develop, and maintain d ...

  • LanceTech Solutions

    Data Engineer

    Found in: Talent IN 2A C2 - 8 hours ago

    LanceTech Solutions Mumbai/Bangalore/Chennai/Pune, India permanent

    Data Engineer - SQL, PLSQL, Snowflake, ETL · We're seeking an experienced Data Engineer with expertise in SQL, strong PLSQL skills, Snowflake, and ETL development. As a key member of our team, you'll design and implement data-driven solutions, collaborating with software develope ...

  • Reflections Info Systems

    Data Engineer

    Found in: Talent IN 2A C2 - 5 hours ago

    Reflections Info Systems Bengaluru, India

    Job Description · We are seeking a skilled Data Engineer with a minimum of 6 years of experience, preferably in a lead or key role, in implementing one or two large-scale data solutions. · The ideal candidate will have strong programming abilities in Scala or Python, as well as ...

  • Ascendion

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 1 day ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Razorpay

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Indium Software

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 hours ago

    Indium Software Bengaluru, India

    Title: Data Engineer · Experience: 2-6/7 Years · Work Location: Bengaluru/Hyderabad · Work Mode: Work from Office · Skills: Adv SQL, python, Spark or pyspark, Hive, Airflow, ETL, Good Communication skills, Business acumen , Team handling experience. · Roles and Responsibilities: ...

  • Informatica

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 hours ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • Info Origin Inc.

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Info Origin Inc. Bengaluru, India

    NEW OPPORTUNITY || Immediate to 30 days Joiners || Data Engineer · Position Title: Data Engineer · Location: Bangalore/Hyderabad, India On-site · Position Type: Contract to hire · Required Experience: 4+Years · Job Description · Experience and Qualification: · Experience with SQL ...