Jobs
>
Data Engineer
>
Hyderabad

    Data Engineer - hyderabad, India - Appen

    Appen
    Default job background
    Description
    About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In addition, we utilize the industry's most advanced AI-assisted data annotation platform to collect and label various types of data like images, text, speech, audio, and video.Our data is crucial for building and continuously improving the world's most innovative artificial intelligence systems and Appen is already trusted by the world's largest technology companies. Now with the explosion of interest in generative AI, Appen is helping leaders in automotive, financial services, retail, healthcare, and governments the confidence to deploy world-class AI products.At Appen, we are purpose driven. Our fundamental role in AI is to ensure all models are helpful, honest, and harmless, so we firmly believe in unlocking the power of AI to build a better world. We have a learn-it-all culture that values perspective, growth, and innovation. We are customer-obsessed, action-oriented, and celebrate winning together.At Appen, we are committed to creating an inclusive and diverse workplace. We are an equal opportunity employer that does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.Appen is seeking a highly skilled and motivated Data Engineer to join our dynamic team. In this role, you will use your extensive knowledge of software development to build and enhance complex systems and applications, contributing to the evolution of AI and machine learning.

    Key Responsibilities:

  • Create and maintain optimal data pipeline architecture.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Build analytics tools that utilizes the data pipeline to provide actionable insights into customer delivered data, operational efficiency and other key business performance metrics.
  • Optimize and improve our existing data products.
  • Qualifications :

  • Bachelor's degree in computer science, Software Engineering, or a related field. A master's degree is a plus.
  • 2-5 years of experience in data engineering background.
  • Strong programming skills in Python/Java, excellent SQL skills.
  • Experience with relational SQL and NoSQL databases.
  • Expertise in AWS services EMR, RDS, Glue, Athena, S3, Data Pipeline, Redshift, Lambda, API Gateway.
  • Experience with big data tools: Spark, Kafka.
  • Experience with data streaming systems like spark-streaming, storm.
  • Experience with data pipeline and workflow management tools: Airflow
  • Experience with shell scripting.
  • Ability to quickly understand and appreciate underlying business context, problems and objectives of analytical projects.
  • Excellent time management skills
  • Clear communication skills to run well defined analysis and produce reports.
  • Appen is the global leader in data for the AI Lifecycle with more than 25 years' experience in data sourcing, annotation, and model evaluation. Through our expertise, platform, and global crowd, we enable organizations to launch the world's most innovative artificial intelligence products with speed and at scale. Appen maintains the industry's most advanced AI-assisted data annotation platform and boasts a global crowd of more than 1 million contributors worldwide, speaking more than 235 languages. Our products and services make Appen a trusted partner to leaders in technology, automotive, finance, retail, healthcare, and government. Appen has customers and offices globally.

  • programming

    Data Engineer

    3 weeks ago


    programming Hyderabad, India

    Job Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...

  • Akrivia HCM

    Data Engineer

    2 weeks ago


    Akrivia HCM Hyderabad, India

    We are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...

  • G5

    Data Engineer

    3 weeks ago


    G5 hyderabad, India

    We are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...

  • Highspot

    Data Engineer

    3 weeks ago


    Highspot hyderabad, India

    What You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...

  • RiskInsight Consulting Pvt Ltd

    Data Engineer

    6 days ago


    RiskInsight Consulting Pvt Ltd Hyderabad, India Full time

    Key Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...

  • ADP

    Data Engineer

    3 weeks ago


    ADP Hyderabad, India

    ***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago


    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...

  • Innova Solutions India

    Data Engineer

    3 weeks ago


    Innova Solutions India hyderabad, India

    JOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...

  • ServCrust

    Data Engineer

    3 weeks ago


    ServCrust hyderabad, India

    Job Title: Data Engineer · Experience Level: 3-4 years · Location: Hyderabad · Job Type: Full-time · About Us: · ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP and Fintech platform. Its ease of commerce solutions are b ...

  • Microsoft

    Data Engineer

    3 weeks ago


    Microsoft hyderabad, India

    Overview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...

  • WALLERO TECHNOLOGIES PRIVATE LIMITED

    Data Engineer

    5 days ago


    WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, India

    Roles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...

  • State Street

    Data Engineer

    1 week ago


    State Street Hyderabad, India Full time

    Role Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...

  • Unison Consulting Pte Ltd

    Data Engineer

    3 weeks ago


    Unison Consulting Pte Ltd hyderabad, India

    Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions. · Continuously improve security & observability telemetry services based on input from a divers ...

  • Anblicks

    Data Engineer

    4 weeks ago


    Anblicks Hyderabad, India

    Position: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...

  • PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    Data Engineer

    3 weeks ago


    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, India

    Description · : GenAI Data Engineering - Senior Manager PwC US - Acceleration Center is seeking a seasoned and visionary GenAI Data Engineer to join our team at the Senior Manager level. In this leadership role, you will oversee the development and enhancement of data pipeline ...

  • Two95 International Inc.

    Data Engineer

    4 weeks ago


    Two95 International Inc. Hyderabad, India

    Title: Data Engineer · Type: Full Time · Location: Hyderabad · Salary: · Open (INR) · Requirements · Job Description · Apply strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting sol ...

  • Prudent Technologies and Consulting, Inc.

    Data Engineer

    1 week ago


    Prudent Technologies and Consulting, Inc. Hyderabad, India

    We are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...

  • Nityo Infotech

    Data Engineer

    3 weeks ago


    Nityo Infotech hyderabad, India

    · •More than 6 years IT experience · •Azure cloud experience is mandatory · •ADF, Databricks, Azure DE/ML cloud work experience is mandatory · •Good experience on Pyspark and Python · •atleast worked 4-5 Data engineering use cases · •should good understanding of DE concepts · •C ...

  • Aragen Life Sciences

    Data Engineer

    3 weeks ago


    Aragen Life Sciences hyderabad, India

    Role: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...

  • CGI

    Data Engineer

    1 week ago


    CGI Hyderabad, India Full time

    Position Description: · At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm ...