Jobs
>
Data Engineer
>
Hyderabad

    Data Engineer - Hyderabad, India - State Street

    State Street background
    Full time
    Description

    Role Summary & Role Description

    As Data Engineer you will

  • Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center
  • Own and ensure that internal and external SLA's meet and exceed expectations, System centric KPIs are continuously monitored
  • Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations
  • Design and build systems for high availability, high throughput, data consistency, security, and end user privacy, defining our next generation of data analytics tooling
  • You will mentor other engineers and promote software engineering best practices across the organization designing systems with monitoring, auditing, reliability, and security at their core
  • Come up with solutions for scaling data systems for various business needs and collaborate in a dynamic and consultative environment
  • Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.
  • Knowledge of a programming language - Python, Scala, or SQL
  • Knowledge of end-to-end data analytics workflow
  • Hands-on professional experience in Databricks
  • Excellent time management and prioritization skills
  • Excellent written and verbal communication
  • Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
  • Core/Must have skills

  • Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.
  • Knowledge of a programming language - Python, Scala, or SQL
  • Knowledge of end-to-end data analytics workflow
  • Hands-on professional experience in Databricks
  • Excellent time management and prioritization skills
  • Excellent written and verbal communication
  • Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
  • Strong end-to-end ownership and a good sense of urgency to enable proper self-prioritization
  • Minimum 5+ years of Databricks experience using Azure Cloud
  • 5+ years of hands on expertise in Hadoop and Scala
  • Practical experience with Data Engineering and the accompanying DevOps & DataOps workflows
  • Good to have skills

  • Certification on Azure/AWS
  • Certification on Hadoop, Scala and Databricks
  • Familiarity with SDLC and Agile methodologies
  • Work Schedule

    Hybrid

    Keywords (If any)

    Hadoop, Scala and Databricks

    Why this role is important to us

    Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

    We offer a collaborative environment where technology skills and innovation are valued in a global organization. We're looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.

    Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.

    About State Street

    What we do. State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we're making our mark on the financial services industry. For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.

    Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks. You'll have access to flexible Work Programs to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.

    Inclusion, Diversity and Social Responsibility. We truly believe our employees' diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.

    State Street is an equal opportunity and affirmative action employer.

    Discover more at


  • programming

    Data Engineer

    3 weeks ago


    programming Hyderabad, India

    Job Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...

  • Akrivia HCM

    Data Engineer

    2 weeks ago


    Akrivia HCM Hyderabad, India

    We are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...

  • G5

    Data Engineer

    3 weeks ago


    G5 hyderabad, India

    We are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...

  • Highspot

    Data Engineer

    3 weeks ago


    Highspot hyderabad, India

    What You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    6 days ago


    RiskInsight Consulting Pvt Ltd Hyderabad, India Full time

    Key Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...

  • ADP

    Data Engineer

    3 weeks ago


    ADP Hyderabad, India

    ***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago


    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...

  • Innova Solutions India

    Data Engineer

    3 weeks ago


    Innova Solutions India hyderabad, India

    JOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...

  • ServCrust

    Data Engineer

    3 weeks ago


    ServCrust hyderabad, India

    Job Title: Data Engineer · Experience Level: 3-4 years · Location: Hyderabad · Job Type: Full-time · About Us: · ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP and Fintech platform. Its ease of commerce solutions are b ...

  • Microsoft

    Data Engineer

    3 weeks ago


    Microsoft hyderabad, India

    Overview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...

  • WALLERO TECHNOLOGIES PRIVATE LIMITED

    Data Engineer

    5 days ago


    WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, India

    Roles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...

  • Appen

    Data Engineer

    3 weeks ago


    Appen hyderabad, India

    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In add ...

  • Unison Consulting Pte Ltd

    Data Engineer

    3 weeks ago


    Unison Consulting Pte Ltd hyderabad, India

    Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions. · Continuously improve security & observability telemetry services based on input from a divers ...

  • Anblicks

    Data Engineer

    4 weeks ago


    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago


    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineering - Senior Manager PwC US - Acceleration Center is seeking a seasoned and visionary GenAI Data Engineer to join our team at the Senior Manager level. In this leadership role, you will oversee the development and enhancement of data pipeline ...

  • Two95 International Inc.

    Data Engineer

    4 weeks ago


    Two95 International Inc. Hyderabad, India

    Title: Data Engineer · Type: Full Time · Location: Hyderabad · Salary: · Open (INR) · Requirements · Job Description · Apply strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting sol ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    1 week ago


    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • Nityo Infotech

    Data Engineer

    3 weeks ago


    Nityo Infotech hyderabad, India

    · •More than 6 years IT experience · •Azure cloud experience is mandatory · •ADF, Databricks, Azure DE/ML cloud work experience is mandatory · •Good experience on Pyspark and Python · •atleast worked 4-5 Data engineering use cases · •should good understanding of DE concepts · •C ...

  • Aragen Life Sciences

    Data Engineer

    3 weeks ago


    Aragen Life Sciences hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...

  • CGI

    Data Engineer

    1 week ago


    CGI Hyderabad, India Full time

    Position Description: · At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm ...