Jobs
>
Hyderabad

    Senior Data Engineer - Hyderabad, India - V3 Staffing Solutions India P Limited

    V3 Staffing Solutions India P Limited
    V3 Staffing Solutions India P Limited Hyderabad, India

    1 month ago

    Show more Collapse job
    Default job background
    Technology / Internet
    Description

    We have this opening with the global company that is shaping the future of gaming through groundbreaking technology and unparalleled creativity.

    Senior Data Engineer (AWS): Crafting Efficient Data Pipelines for Cloud Platforms


    We're seeking a seasoned Senior Data Engineer with over 9 years of hands-on experience in crafting and implementing highly efficient ETL processes and robust data pipelines.

    If you're passionate about architecting scalable solutions and thrive in the dynamic realm of cloud technologies, this role is tailored for you.


    Key Responsibilities:

    Design and Implementation :
    Lead the design and implementation of cutting-edge ETL processes and data pipelines, ensuring optimal performance and reliability.

    Framework Development :

    Spearhead the development of generic frameworks tailored for data ingestion and processing on cloud-based platforms, fostering efficiency and reusability across projects.


    Streaming Integration :
    Bring your expertise in streaming-based integration patterns and stream processing to the forefront, driving real-time data processing capabilities.

    AWS Proficiency :

    Leverage your broad experience with AWS technologies, particularly DynamoDB, Glue, Athena, EMR, Redshift, Lambda, and Kinesis, to architect robust and scalable solutions.


    Python Mastery :

    Showcase your proficiency in Python, with a focus on PySpark, Spark SQL, and Databricks, to elevate data processing capabilities to new heights.


    CI/CD and DevOps :

    Play a pivotal role in CI/CD platform setup and deployment pipeline design, utilizing tools such as JFrog, Terraform, GitHub Actions, and Sonar, along with adeptness in Shell Scripting and Unit/Integration Testing.


    SQL Optimization :
    Demonstrate expert-level skills in writing and optimizing SQL queries, ensuring efficient data retrieval and manipulation.

    Scalable Warehousing Solutions :
    Architect scalable data warehousing solutions that cater to evolving business needs, driving actionable insights and informed decision-making.

    Agile and DevOps Practices :
    Embrace Agile software development and DevOps practices, fostering a culture of collaboration, innovation, and continuous improvement.

    Effective Communication :
    Collaborate seamlessly with technical and business teams, communicating effectively to bridge the gap between requirements and technical implementations.

    Data Expertise :

    Leverage your deep expertise in managing and utilizing large datasets across diverse data platforms, unlocking the full potential of data-driven strategies.


    Qualifications:
    Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
    Extensive hands-on experience (9+ years) in data engineering roles, with a focus on cloud platforms.
    Proven track record of designing and implementing scalable data pipelines and warehousing solutions.
    Strong proficiency in Python, SQL optimization, and AWS technologies.
    Familiarity with CI/CD practices and DevOps methodologies.
    Excellent communication and collaboration skills.


    If you're ready to embark on a journey of innovation and transformation in the realm of data engineering, join us in shaping the future of our cloud data platform.

    We have other current jobs related to this field that you can find below

  • ADP

    Data Engineer

    3 weeks ago

    ADP Hyderabad, India

    ***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago

    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...

  • Innova Solutions India

    Data Engineer

    3 weeks ago

    Innova Solutions India hyderabad, India

    JOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...

  • programming

    Data Engineer

    3 weeks ago

    programming Hyderabad, India

    Job Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...

  • Microsoft

    Data Engineer

    3 weeks ago

    Microsoft hyderabad, India

    Overview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...

  • WALLERO TECHNOLOGIES PRIVATE LIMITED

    Data Engineer

    1 week ago

    WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, India

    Roles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    2 weeks ago

    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • State Street

    Data Engineer

    2 weeks ago

    State Street Hyderabad, India Full time

    Role Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...

  • Livemindz

    Data Engineer

    1 day ago

    Livemindz Hyderabad, India

    Data Engineer(Talend, Snowflake, AWS) · Experience in working with Talend Big Data platform · Strong experience in performance tuning of ETL processes · Design and develop data source and target mappings, sessions, workflows C and ETL scripts · Expertise in SQL or PL/SQL · Experi ...

  • Appen

    Data Engineer

    3 weeks ago

    Appen hyderabad, India

    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In add ...

  • Aragen Life Sciences

    Data Engineer

    3 weeks ago

    Aragen Life Sciences hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...

  • Akrivia HCM

    Data Engineer

    3 weeks ago

    Akrivia HCM Hyderabad, India

    We are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago

    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineering - Senior Manager PwC US - Acceleration Center is seeking a seasoned and visionary GenAI Data Engineer to join our team at the Senior Manager level. In this leadership role, you will oversee the development and enhancement of data pipeline ...

  • Highspot

    Data Engineer

    3 weeks ago

    Highspot hyderabad, India

    What You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...

  • Unison Consulting Pte Ltd

    Data Engineer

    3 weeks ago

    Unison Consulting Pte Ltd hyderabad, India

    Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions. · Continuously improve security & observability telemetry services based on input from a divers ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    1 week ago

    RiskInsight Consulting Pvt Ltd Hyderabad, India Full time

    Key Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...

  • TechnoGen India Pvt. Ltd.

    Data Engineer

    3 weeks ago

    TechnoGen India Pvt. Ltd. hyderabad, India

    5+ years served as Data Engineer or Data Operations role · 5+ years of experience working with SQL · Extensive experience with Microsoft Azure Data Lake, Azure Data Bricks, Spark, Spark Architecture , Data Factory, and SQL Database products or equivalent products from other clo ...

  • Microsoft

    Data Engineer

    3 weeks ago

    Microsoft Hyderabad, India

    Overview · Come join an evolving team with a growth mindset, explore your passion and do your best work. "Operations Digital Solutions" Organization under "Finance Data & Experiences" is an Org that enables digital transformation for "Microsoft Business Operations". One of the ke ...

  • Awign Expert

    Data Engineer

    2 weeks ago

    Awign Expert Hyderabad, India

    Job Description · About the Role · Location: Hyderabad · Timings: Full Time (As per company timings) · Notice Period: (Immediate Joiner - Required) · Duration: 6 months · Experience – 5 to 9yrs · Work Mode– WFO · Job Description · We're looking for a Data/Web Engineer who will b ...

  • EDGESOFT

    Data Engineer

    2 weeks ago

    EDGESOFT Hyderabad, India

    Job Description : · The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastruc ...