Jobs

    Lead Big Data Engineer - Anywhere in India/Multiple Locations - Grownex HR Solution

    Grownex HR Solution
    Grownex HR Solution Anywhere in India/Multiple Locations

    1 day ago

    Default job background
    permanent Technology / Internet
    Description
    Role :
    Lead Big Data Engineer

    Work Mode :
    Remote(5 Days working)

    The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate would be joining an existing team of outstanding data engineers in the US and help us expand the data engineering team and work on different products and on different layers of the infrastructure.

    Job Profile - We is looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Applicants must have a passion for engineering with accuracy and efficiency, be highly motivated and organized, able to work as part of a team, and also possess the ability to work independently with minimal supervision.

    To be successful in this role, you should possess

    • Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.
    • Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.
    • Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Akka and Spark.
    • Understanding and critically reviewing existing data pipelines, and coming up with ideas in collaboration with Technical Leaders and Architects to improve upon current bottlenecks
    • Take initiatives, and show the drive to pick up new stuff proactively, and work as a Senior Individual contributor on the multiple products and features we have.
    • 7+ years of experience in developing highly scalable Big Data pipelines.
    • Indepth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm, and Hadoop, and the file types they deal with.
    • Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.
    • Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.
    • Experience with Git and build tools like Gradle/Maven/SBT.
    • Strong understanding of objectoriented design, data structures, algorithms, profiling, and optimization.
    • Have elegant, readable, maintainable and extensible code style.
    You are someone who would easily be able to-

    • Work closely with the US and India engineering teams to help build the Java/Scala based data pipelines
    • Lead the India engineering team in technical excellence and ownership of critical modules; own the development of new modules and features
    • Troubleshoot live production server issues.
    • Handle client coordination and be able to work as a part of a team, be able to contribute independently and drive the team to exceptional contributions with minimal team supervision
    • Follow Agile methodology, JIRA for work planning, issue management/tracking

    Additional Project/Soft Skills :

    • Should be able to work independently with India & US based team members.
    • Strong verbal and written communication with ability to articulate problems and solutions over phone and emails.
    • Strong sense of urgency, with a passion for accuracy and timeliness.
    • Ability to work calmly in high pressure situations and manage multiple projects/tasks.
    • Ability to work independently and possess superior skills in issue resolution.
    • Should have the passion to learn and implement, analyse and troubleshoot issues
    )
  • Aricent

    Data Engineer

    1 day ago

    Aricent Anywhere in India/Multiple Locations permanent

    Job Profile : Data Engineer · Location : WFO/WFH (Both Available) · Specialization : IT/Cloud/Data Management · Job Description : · - Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; ca ...

  • Change leaders

    Data Engineer

    1 day ago

    Change leaders Anywhere in India/Multiple Locations permanent

    Primary Skill - GCP + Python + SQL · OR · GCP + Java + SQL · NP - Immediate to 35 Days max · Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineering e ...

  • Paralleldots

    Data Engineer

    1 day ago

    Paralleldots Anywhere in India/Multiple Locations permanent

    Job Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets t ...

  • Megma Services

    Data Engineer

    1 day ago

    Megma Services Anywhere in India/Multiple Locations permanent

    Global Technology company requires Data Engineer - Remote(Work) · One of our client a specialized Artificial Intelligence solutions company. Our advanced training data, benchmarking and testing solutions allow our enterprise and high-tech global customers to create sophisticated ...

  • XANDER CONSULTING AND ADVISORY PRIVATE LIMITED

    Data Engineer

    1 day ago

    XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Anywhere in India/Multiple Locations permanent

    Primary Roles and Responsibilities: · - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack · - Ability to provide solutions that are forward-thinking in data engineering and analytics space · - Collaborate with DW/BI leads to understand new ETL pipel ...

  • Mobile Programming

    Data Engineer

    1 day ago

    Mobile Programming Anywhere in India/Multiple Locations/Bangalore permanent

    Job Summary: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning ...

  • Liveconnections

    Data Engineer

    1 day ago

    Liveconnections Anywhere in India/Multiple Locations permanent

    Skillset: · Data Engineering with strong SQL expertise. · Should be good in Talend, Snowflake. More preference to certified (in Talend/ Snowflake) resources. · - Should be experienced in implementing DWH projects. · - Having Informatica experience will be value-add. · Relevant Ex ...

  • Forward eye technologies

    Data Engineer

    1 day ago

    Forward eye technologies Anywhere in India/Multiple Locations permanent

    Role : Data Engineer · Location : Remote · Shift timings : IST · Contract Period : 3 months · Experience : 5 - 8 years · Responsibilities : · - Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues a ...

  • CliqHR

    Data Engineer

    1 day ago

    CliqHR Anywhere in India/Multiple Locations permanent

    Work Mode : Remote (but need to do WFO after joining of 1st week) · Preferred candidate profile : · - Minimum 5+ years of work experience in Data Analysis, BI or Data Engineering roles with a quantitative degree preferably in Computer Science, Statistics or Mathematics. · - Excel ...

  • Forward Eye Technology

    Data Engineer

    1 day ago

    Forward Eye Technology Anywhere in India/Multiple Locations permanent

    Job Description : · Overview : · As a Data Engineer specializing in Azure Data Platform, you will be responsible for designing, building, and maintaining data solutions on Microsoft Azure. Your expertise in data modeling, ETL/ELT processes, and tools such as Azure Data Factory (A ...

  • Teksands

    Data Engineer

    1 day ago

    Teksands Anywhere in India/Multiple Locations permanent

    The Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to req ...

  • Huquo

    Data Engineer

    1 day ago

    Huquo Anywhere in India/Multiple Locations permanent

    Position : AWS Data Engineer · Location : Pune/ Gurgaon/ Hybrid · Experience : 5+ · Job Description : · - 5+ years of experience as a Data Engineer on the AWS Stack · - AWS Solutions Architect or AWS Developer Certification required · - Solid experience with AWS services such as ...

  • Lancesoft India Pvt Ltd

    Data Engineer

    1 day ago

    Lancesoft India Pvt Ltd Anywhere in India/Multiple Locations permanent

    Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with busin ...

  • Arting Digital

    Data Engineer

    1 day ago

    Arting Digital Anywhere in India/Multiple Locations permanent

    Position Title : Data Engineer · Exp : 5+ years · Location : Remote · Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python · Qualification : Any · Roles and responsibilities : · - An offshore Data Engineer to work with the Investment Analytics team. · - This ...

  • consultancy

    Data Engineer

    1 day ago

    consultancy Anywhere in India/Multiple Locations permanent

    Note : It's a work-from-home opportunity. · Skills You must have experience with: · - Twilio Segment - Customer Data Platform · - Google Analytics (Inc. Firebase) · - Experience creating tailored dashboards using PowerBi · - Experience in data management, data warehousing, data q ...

  • Vikisol Technologies

    Azure Data Engineer

    1 day ago

    Vikisol Technologies Anywhere in India/Multiple Locations permanent

    Azure Data Engineer · Opportunity : Remote · Exp : 5+ years · Location : Remote · Skills : · - Azure Databricks · - Azure ADF · - PySpark · - Python · - SQL · Responsibilities : · - Collaborate on ETL data requirements. · - Design and optimize data pipelines (Azure Databric ...

  • PROVAB TECHNOSOFT PVT LTD

    Senior Data Engineer

    1 day ago

    PROVAB TECHNOSOFT PVT LTD Anywhere in India/Multiple Locations permanent

    Data Engineer · Mode : Work from Home · Experience : 6+year · Shift Timing : 2PM to 10PM · Must have : Python, Spark, React, AWS · Job Description : · - I would like to request a new resource for the data Engineering team who will be aligned with the human capital analytics team. ...

  • Forward eye technologies

    Snowflake Data Engineer

    1 day ago

    Forward eye technologies Anywhere in India/Multiple Locations permanent

    Job Title : Snowflake Data Engineer · Job Description : · We are seeking a talented Snowflake Data Engineer to join our team and contribute to the development and maintenance of our Snowflake Data Warehouse environment. As a Snowflake Data Engineer, you will play a critical role ...

  • DEVENIR SOFTWARE PRIVATE LIMITED

    Azure Data Engineer

    1 day ago

    DEVENIR SOFTWARE PRIVATE LIMITED Anywhere in India/Multiple Locations permanent

    Position : Azure Data Engineer · Experience : 4 to 12+ years · Relevant 5+ Exp is must · Location : Pan India · Fulltime role · Immediate : · - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform · - Develop and implement data solutions using Azu ...

  • Dotflick Solutions

    DevOps & Data Engineer

    1 day ago

    Dotflick Solutions Anywhere in India/Multiple Locations permanent

    Profile : DevOps and Data Engineer · Job description : This role is a Hybrid DevOps and Data Engineering. · Mode : WFO/WFH · Roles & responsibilities : · Setting up tools and required infrastructure · - Defining and setting development, test, release, update, and support process ...