Big Data - Bengaluru / Bangalore - confidential

    confidential
    confidential Bengaluru / Bangalore

    3 days ago

    Full time ₹600,000 - ₹2,200,000 (INR) per year *
    Description

    Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute significantly to ensuring smooth data operations and enabling data-driven insights to meet various business objectives for our clients.

    Roles and Responsibilities:

    • Data Pipeline Development: Design, build, and maintain robust and scalable ETL (Extract, Transform, Load) pipelines for ingesting, transforming, and loading large datasets from various sources into Big Data platforms.
    • Big Data Ecosystem Utilization: Work with and optimize components of the Hadoop ecosystem (e.g., HDFS, Hive) and Apache Spark for distributed data processing and analysis.
    • Data Processing & Transformation: Develop efficient code using programming languages (e.g., Python, Scala, Java) to perform data manipulation, cleansing, and transformation for analytical purposes.
    • Database Management: Interact with and manage various databases, including relational (SQL) and NoSQL databases (e.g., Cassandra, MongoDB, HBase), for data storage and retrieval.
    • Troubleshooting & Optimization: Identify, troubleshoot, and resolve performance bottlenecks and issues within Big Data pipelines and infrastructure.
    • Data Quality & Governance: Assist in implementing data quality checks and contribute to data governance practices to ensure data accuracy, consistency, and reliability.
    • Collaboration: Collaborate effectively with Data Scientists, Data Analysts, and other engineering teams to understand data requirements and deliver reliable data solutions.
    • Monitoring & Support: Monitor Big Data jobs and processes, providing operational support and maintenance for developed solutions.
    • Continuous Learning: Stay updated with the latest trends and advancements in Big Data technologies and contribute to the adoption of new tools and best practices.

    Preferred Candidate Profile:

    • Experience: 2 to 4 years of hands-on experience in Big Data engineering or a related data-centric role.
    • Big Data Technologies: Practical experience with key Big Data technologies such as Apache Hadoop, Apache Spark, and data warehousing concepts (e.g., Hive).
    • Programming Skills: Proficiency in at least one programming language relevant to Big Data (e.g., Python, Scala, or Java).
    • Database Skills: Strong command of SQL for data querying and manipulation. Familiarity with NoSQL databases is a plus.
    • Cloud Exposure (Plus): Exposure to Big Data services on cloud platforms (e.g., AWS EMR, Azure Data Lake Analytics, Google Cloud Dataproc) is advantageous.
    • Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail in complex data environments.
    • Communication: Good verbal and written communication skills to effectively collaborate with team members and stakeholders.
    • Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related quantitative field.
    * This salary range is an estimation made by beBee
  • Work in company

    Big Data

    confidential

    Responsibilities: · Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud, combined with other technologies · Ensure the use of Big Query SQL, Java/Python/Scala and Spark reduces l ...

    Bengaluru / Bangalore ₹600,000 - ₹2,200,000 (INR) per year Full time

    3 days ago

  • Work in company

    Big Data

    Only for registered members

    Must have Skills: Big data SQL Java · Job Type Full time · ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Data Engineer – Big Data

    Only for registered members

    We are looking for a hands-on Data Engineer to join a high-impact data engineering team with a focus on developing the data platform and working with the product team to develop data and analytics pipeline.Work and enhance big data related opensource technologies. · Build and ope ...

    Bengaluru

    3 weeks ago

  • Work in company

    Data Engineer – Big Data

    Only for registered members

    We are looking for a hands-on Data Engineer to join a high-impact data engineering team with a focus on developing the data platform and working with the product team to develop data and analytics pipeline. · ...

    Bengaluru, Karnataka

    3 weeks ago

  • Work in company

    Big Data Developer

    Only for registered members

    We're hiring for one of the world's leading professional services firms. This organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies navigate complex challenges. · About the Role: · We are seeking a high ...

    Bengaluru ₹900,000 - ₹2,500,000 (INR) per year Full time

    5 days ago

  • Work in company

    Data Engineer – Big Data

    Only for registered members

    We are seeking a · Data Engineer · to build, enhance, and support · large-scale · batch and streaming data pipelines · for fraud detection and risk analysis. · The role focuses on processing user and transactional data using Spark SQL Flink SQL Hadoop/HDFS light Java work for Map ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Big Data Engineer

    Only for registered members

    As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform. · ...

    Bengaluru, Chennai, Hyderabad

    2 weeks ago

  • Work in company

    Big Data Developer

    Only for registered members

    Job Position: GCP Big Data Engineer · Job Type: Full-Time · Location: Bengaluru/Gurgaon · Experience: 5 to 10+ Years · Mandatory Skills: · Python for DATA, GCP Big Query, Python, GCP Data stream, ANSI-SQL · Job Summary · Seeking a Specialist with 5 years of experience in GCP Data ...

    Bengaluru, Karnataka ₹900,000 - ₹2,500,000 (INR) per year

    4 days ago

  • Work in company

    Big Data Engineer

    Only for registered members

    Analyze and understand the current Apache Spark platform codebase including performance nuances work with large-scale distributed systems for big data processing and analytics implement best practices for data storage processing and retrieval. · ...

    Bengaluru, Chennai, Pune

    1 month ago

  • Work in company

    Big Data Developer

    Only for registered members

    We are seeking a highly skilled Big Data Developer with strong expertise in Spark and Scala to join our dynamic team. · ...

    Bengaluru ₹900,000 - ₹2,500,000 (INR) per year Full time

    5 days ago

  • Work in company

    Big Data Developer

    Grid Dynamics

    Job Title: Big Data Developer · The ideal candidate will have at least 4 years of experience in developing big data solutions using technologies like Apache Spark, Scala, Python. · A strong understanding of SQL language and its application in data analysis reports. · This role re ...

    Bengaluru ₹900,000 - ₹2,500,000 (INR) per year

    9 hours ago

  • Work in company

    big data architect

    Only for registered members

    We are primarily looking for a Big Data Architect who has worked on large scale data implementation ingesting at least 1-5 TB of real time data into their system storage layer having data in hundreds of TBs or in petabyte scale. · ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Big Data Engineer

    Only for registered members

    We are looking for a Data Engineer with 3+ years of experience in building, maintaining, and supporting large-scale data pipelines. · ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Big Data Developer

    Only for registered members

    Design, develop, test, deploy and maintain large-scale big data solutions using Scala/Python programming languages. · Collaborate with cross-functional teams to gather requirements and deliver high-quality software products on time. · Develop scalable and efficient algorithms for ...

    Bengaluru, Hyderabad

    2 weeks ago

  • Work in company

    Data Engineer – Big Data

    Only for registered members

    We are seeking a Data Engineer to build, enhance and support large-scale batch and streaming data pipelines for fraud detection and risk analysis. · Strong hands-on experience with Spark SQL (not just Spark basics) for large-scale batch processing. · Practical Flink SQL experien ...

    Bengaluru

    1 month ago

  • Work in company

    Big Data Engineer

    Only for registered members

    We are looking for an experienced Senior Big Data Engineer to design, build and maintain scalable big data platforms. · 6+ years of hands-on experience in Big Data engineering using Spark and Scala. · Strong understanding of distributed systems and Big Data technologies such as H ...

    Bengaluru

    2 weeks ago

  • Work in company

    Data Engineer – Big Data

    Only for registered members

    We are seeking a data engineer to build enhance and support large-scale batch streaming data pipelines for fraud detection risk analysis. · ...

    Bengaluru

    3 weeks ago

  • Work in company

    Big Data Engineer

    Only for registered members

    This role involves designing, developing, and implementing Big Data solutions using Hadoop, Spark, and NoSQL databases. · ...

    Bengaluru ₹900,000 - ₹2,800,000 (INR) per year Full time

    5 days ago

  • Work in company

    Big Data Engineer

    Only for registered members

    We are looking for a Big Data Engineer with strong hands-on experience in Java, Apache Spark, Hive and SQL. The ideal candidate should have a solid understanding of big data processing, data transformation and analytical problem-solving. · Design, develop and maintain Big Data ap ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    Big Data Engineer

    confidential

    We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark ...

    Bengaluru / Bangalore ₹900,000 - ₹2,800,000 (INR) per year Full time

    3 days ago

Jobs
>
Big data
>
Jobs for Big data in Bengaluru