Jobs
>
Bengaluru

    Data engineer Lead/architect - Bengaluru, India - Expleo

    Expleo
    Expleo Bengaluru, India

    1 week ago

    Default job background
    Permanent or Fixed Term Contract
    Description

    Responsibilities

  • Define and achieve the strategy roadmap for Big Data architecture and design and overall enterprise data governance and management across the enterprise and Data Centers.
  • Establish standards and guidelines for the design & development, tuning, deployment and maintenance of information, advanced data analytics, ML/DL, data access frameworks and physical data persistence technologies.
  • Research in the areas of advanced data techniques, including data ingestion, data processing, data integration, data access, data visualization, text mining, data discovery, statistical methods, database design and implementation.
  • Experience in developing use cases, functional specs, design specs, ERDs etc.
  • Experience with the design and development of multiple object–oriented systems.
  • Experience with extending Free and Open–Source Software (FOSS) or COTS products.
  • Architect solutions for key business initiatives ensuring alignment with future state analytics architecture vision.
  • Work closely with the project teams as outlined in the SDLC engagement model to provide guidance in implementing solutions at various stages of projects.
  • Engage constructively with project teams to support project objectives through the application of sound architectural principles.
  • Develop and validate that the proposed solution architecture supports the stated & implied business requirements of the project.
  • Review technical team deliverables for compliance with architecture standards and guidelines.
  • Adopt innovative architectural approaches to leverage in-house data integration capabilities consistent with architectural goals of the enterprise.
  • Create architectural designs for different stakeholders that provide a conceptual definition of the information processing needs for the delivery project.
  • Provide right-fit solution to implement variety of data, analytics requirements using Big Data technologies in Insurance/Healthcare space.
  • Provide expertise in defining Big Data Technical Architecture and design using Hadoop, NoSQL and Visualization tools/platforms.
  • Ability to get down to the programming/code level and provide hands-on expertise in technical features of Big Data tools/platforms.
  • Lead a team of designers/developers and guide them throughout the system implementation life cycle.
  • Engage client Architects, Business SMEs and other stakeholders during Architecture, Design and implementation phases.
  • Define new data infrastructure platform to capture vehicle data. Research and develop new data management solutions, approaches and techniques for data privacy and data security, and advanced Data Analytics systems.
  • Design complex and distributed software modules using Big Data technologies, Streaming Data Technologies and Java/JEE for real-time stream/event data processing and real-time parametrized and full-text searching of data
  • Design NoSQL data models to achieve strong data consistency despite lack of ACID transactions
  • Design and enhance highly scalable, high performance and fault tolerant architectures across all tiers of the software and develop modules based on the architecture
  • Design and enhance the architecture that supports zero downtime requirements while different components of the system are updated/upgraded
  • Integrate with IoT devices using a data ingestion pipeline that allows application of configurable real-time rules
  • Use machine learning algorithms on the real-time data for predictive analytics
  • Design software, write code, write unit test cases, test code and review code on a daily-basis.
  • Lead multiple project modules and development teams simultaneously and ensure the quality of their deliverables and their timely delivery
  • Create/enhance scalable, high performance and fault-tolerant architectures
  • Use caching, queuing, sharding, concurrency control, etc. to improve performance and scalability
  • Enhance zero-downtime architecture during product deployment upgrades
  • Integrate with IoT devices using a data ingestion pipeline that allows application of configurable real-time rules
  • Identify the performance and scalability bottlenecks and provide solutions to resolve them
  • Perform code reviews, provide feedback and oversee code corrections to ensure compliance with the development guidelines on a daily-basis
  • Provide technical expertise in the diagnosis and resolution of issues, including the determination and provision of workaround solutions
  • Experience in data modeling and data processing architectures using NoSQL databases to achieve strong data consistency despite lack of ACID transactions

    • Qualifications

    Preferably BE/ME/BTech/MTech/MSc in computer science or related engineering field or MCA

    Should have relevant industry certifications like Big Data Architect

    Must possess Analytical, Interpersonal, Leadership & Organizational skills.

    Essential skills

    Required Skills:

  • Experience with distributed scalable Big Data store or NoSQL, including Cassandra, Cosmos DB, Cloudbase, HBase, or Big Table.
  • Experience in with Apache Hadoop and Hadoop Distributed File System (HDFS), S3 protocol, ObjectStore and with processing large data stores.
  • Experience on Hadoop, MapReduce, YARN, Zookeeper, Pig, Hive, Oozie, Flume, Sqoop, Spark and Storm, Hive, HBase, MongoDB, Cassandra
  • Experience on R, Qlik, Tableau, Postgres, Kerberos, Knox and Ranger
  • Experience on J2EE technologies including Webservices development and Enterprise Application Integration space.
  • Experience with Message Queue based technologies like RabbitMQ or ActiveMQ etc. would be considered plus point
  • Experience with other NoSQL Databases (CouchDB, Neo4j, InfiniteGraph, JanusGraph, ArangoDB, OrientDB, CockroachDB, Redis, Vitess
  • Real-time stream data processing frameworks: Beam, Spark Streaming, Flink, Kafka Stream, Apex, Heron, Storm etc.
  • Experience in Queuing: Kafka, ActiveMQ, RabbitMQ etc.
  • Experience with ETL design using tools Informatica, Talend, Oracle Data Integrator (ODI), Dell Boomi or equivalent
  • Experience with Big Data & Analytics solutions Hadoop, Pig, Hive, Spark, Spark SQL Storm, AWS (EMR, Redshift, S3, /Azure (HDInsight, Data Lake Design, Analytical services/Power BI)
  • Experience in developing code around Hadoop with Oozy, Sqoop, Pig, Hive, HBase, Avro, Parquet, Spark, NiFi
  • Experience with NoSQL platform (eg, Spark, Cassandra, Hadoop).
  • Experience with Lucene based cluster technology (eg, Elastic Search, Solr).
  • Experience with One of the queueing system (eg, Apache Kafka, RabbitMQ).
  • Experience with Cloud Computing / Distributed Computing / Amazon Web Services / GCP / AZURE
  • Experience with RESTful Web Services (eg, Jetty) & Java Spring framework

    • Experience

    OVERALL 14+ years HANDS-ON EXPERIENCE ON Big Data

  • Alstom

    Lead Architect

    2 weeks ago

    Alstom Bengaluru, India

    Req ID:449753 · Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated syst ...

  • HuQuo

    Lead Architect/Cloud Engineer

    4 weeks ago

    HuQuo Bangalore, India permanent

    Job Description : · Role/Responsibilities of an Architect/Cloud Engineer : · - Architect on our Cloud Platforms and Infrastructure team has close to 5 - 8 years of experience in DevOps, SecOps, or SysOps in a large enterprise environment and would take a lead role in the design ...

  • Alstom

    Lead Architect

    4 weeks ago

    Alstom bangalore, India

    Req ID:449753 · Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated syst ...

  • Cloud Software Group

    Lead Architect

    4 weeks ago

    Cloud Software Group bangalore, India Full time

    Primary Duties/Responsibilities · Design and implement Citrix cloud solutions tailored to client requirements. · Engage with stakeholders to assess business needs and recommend suitable Citrix architectures. · Mentor junior architects and provide technical leadership. · Coll ...

  • Amadeus

    Lead Architect

    4 weeks ago

    Amadeus bangalore, India

    Job Title · Lead ArchitectPosition Name - Lead Architect · The role: · Be responsible for software architecture throughout the development lifecycle, take into consideration system constraints and enterprise architecture strategic direction · Deep-dive, think long-term, ar ...

  • HARMAN International

    Lead/Architect

    1 week ago

    HARMAN International Bengaluru, India

    HARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of ...

  • International Battery Company

    Lead Architect

    1 week ago

    International Battery Company Bengaluru, India

    Lead Architect - IBC India FactoryJob Description & Qualifications: · At IBC (International Battery Company, Inc.), we are building proprietary NMC & I-NMC Prismatic cells for mobility applications (EVs) that will reduce battery complexity, have 40% higher energy density than LFP ...

  • Maneva Consulting Pvt. Ltd

    Cloud Architect Engineer Lead

    1 week ago

    Maneva Consulting Pvt. Ltd Bengaluru, India

    GreetingsFromManeva · JobDescription · JobTitle · Cloud Architect & Engineer Lead · LocationBangalore / Hyderabad /Chennai · Experience20 25Years · JobRequirements:1.Agile Program Setup Define the way teams should be organised andthe way they would work while ensuring alignment w ...

  • Alstom

    Lead Architect

    2 weeks ago

    Alstom Bangalore, India

    Req ID:449754 · Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated syst ...

  • Alstom

    Lead Architect

    4 weeks ago

    Alstom Bengaluru, India

    Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated systems, customized s ...

  • iMind Your Business Solutions Private Limited

    Java Lead Engineer/Architect

    4 weeks ago

    iMind Your Business Solutions Private Limited Bangalore, India

    Key Responsibilities : · - Design and implement platform features and functions using Java, Spring Technologies. · - Design of software service or application in alignment with architecture vision. · - Champion code quality initiatives, drive it with rigour in the team and bring ...

  • Cloud Software Group

    Lead Architect

    2 weeks ago

    Cloud Software Group Bengaluru, India

    Primary Duties/ResponsibilitiesDesign and implement Citrix cloud solutions tailored to client requirements.Engage with stakeholders to assess business needs and recommend suitable Citrix architectures.Mentor junior architects and provide technical leadership.Collaborate with sale ...

  • Amadeus

    Lead Architect

    2 weeks ago

    Amadeus Bengaluru, India

    Job TitleLead Architect · Position Name - Lead ArchitectThe role:Be responsible for software architecture throughout the development lifecycle, take into consideration system constraints and enterprise architecture strategic direction · Deep-dive, think long-term, architecting so ...

  • Photon

    Data Architect/Lead

    4 weeks ago

    Photon bangalore, India

    Job Title: Data Architect/Lead (Azure Data Systems) · Location: Bangalore · Job Description: · We are seeking a highly skilled Data Architect/Lead with expertise in Azure Data Systems to join our team. As a Data Architect/Lead, you will be responsible for designing and impl ...

  • Collabera Digital

    Lead Solutions Architect

    4 weeks ago

    Collabera Digital bangalore, India

    Position Details: · Job Title: Lead Solutions Architect · Experience : 10+ years · Location: Bengaluru / Chennai · Years of Experience : Min Years of Total Experience, with at least 5-8 years in Solution Architecture or Proposal Manager/Engineering role. · Job Details an ...

  • Aptus Data Labs

    Snowflake Lead/Architect

    3 weeks ago

    Aptus Data Labs Bengaluru, India

    Description : · We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. ...

  • Infosys

    AI Lead architect

    4 weeks ago

    Infosys bangalore, India

    Role & responsibilities · In the role of AI Lead Architect, you will interface with key stakeholders and apply your technical and domain proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture defin ...

  • Nous Infosystems

    Technical Lead/ Architect

    1 week ago

    Nous Infosystems Bengaluru, India

    .NET/CLOUD—TECHNICAL Lead / ARCHITECT · ABOUT NOUS · Nous Infosystems is a CMMi Level 5 SVC + SSD v1.3, ISO 9001:2008, ISO/IEC 27001:2013 certified global information technology firm providing software solutions and services across a broad spectrum of industries and domains. Nous ...

  • Hiret

    Lead Solution Architect

    4 weeks ago

    Hiret Bangalore, India permanent

    Lead Solution Architect : · - The Solution Architect you are a technical visionary responsible for translating business objectives into conceptual and practical solutions that will be the foundation for our future product roadmap. · - You are an expert within the e-commerce ecosy ...

  • Kadel Labs Private Limited

    Lead Azure Architect

    4 weeks ago

    Kadel Labs Private Limited bangalore, India

    Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers ...