- Create and maintain optimal data pipeline architecture.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
- Build analytics tools that utilizes the data pipeline to provide actionable insights into customer delivered data, operational efficiency and other key business performance metrics.
- Optimize and improve our existing data products.
- Bachelor's degree in computer science, Software Engineering, or a related field. A master's degree is a plus.
- 2-5 years of experience in data engineering background.
- Strong programming skills in Python/Java, excellent SQL skills.
- Experience with relational SQL and NoSQL databases.
- Expertise in AWS services EMR, RDS, Glue, Athena, S3, Data Pipeline, Redshift, Lambda, API Gateway.
- Experience with big data tools: Spark, Kafka.
- Experience with data streaming systems like spark-streaming, storm.
- Experience with data pipeline and workflow management tools: Airflow
- Experience with shell scripting.
- Ability to quickly understand and appreciate underlying business context, problems and objectives of analytical projects.
- Excellent time management skills
- Clear communication skills to run well defined analysis and produce reports. Appen is the global leader in data for the AI Lifecycle with more than 25 years' experience in data sourcing, annotation, and model evaluation. Through our expertise, platform, and global crowd, we enable organizations to launch the world's most innovative artificial intelligence products with speed and at scale. Appen maintains the industry's most advanced AI-assisted data annotation platform and boasts a global crowd of more than 1 million contributors worldwide, speaking more than 235 languages. Our products and services make Appen a trusted partner to leaders in technology, automotive, finance, retail, healthcare, and government. Appen has customers and offices globally.
-
Data Engineer
3 weeks ago
programming Hyderabad, IndiaJob Description : · Role Overview : · As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity ...
-
Data Engineer
2 weeks ago
Akrivia HCM Hyderabad, IndiaWe are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have extensive experience in designing, building, and maintaining scalable and reliable data ...
-
Data Engineer
3 weeks ago
G5 hyderabad, IndiaWe are seeking a talented and motivated Data Engineer to join our dynamic team. As a key member of the data analytics team, you will play a crucial role in designing, developing, and maintaining data pipelines, analytics systems, and reports. This person will drive our data moder ...
-
Data Engineer
3 weeks ago
Highspot hyderabad, IndiaWhat You'll Do · Create optimal data pipeline architecture · Develop, and maintain end-to-end scalable data infrastructure and pipelines. · Identify, design, and implement process improvements, automating manual processes and optimizing data delivery. · Assist internal stake ...
-
Data Engineer
6 days ago
RiskInsight Consulting Pvt Ltd Hyderabad, India Full timeKey Skills: · Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one. · In-depth knowledge with respect to Snowflake and its architecture. · provide solutioning and drive the implementation of DOPS features which includes ...
-
Data Engineer
3 weeks ago
ADP Hyderabad, India***Hiring on a Contract*** JOB DESCRIPTIO N Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant ...
-
Data Engineer
3 weeks ago
PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, IndiaDescription · : GenAI Data Engineer - Associate PwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their sk ...
-
Data Engineer
3 weeks ago
Innova Solutions India hyderabad, IndiaJOB DESCRIPTION · Innova Solutions is immediately hiring for a Data Engineer · Position Type: Full Time · Location: Hyderabad · As a Senior Software Engineer validity you will: · Big Data Engineer · Skills: · Hadoop and it's ecosystems tools like Spark, Kafka, Hive, Sqoop ...
-
Data Engineer
3 weeks ago
ServCrust hyderabad, IndiaJob Title: Data Engineer · Experience Level: 3-4 years · Location: Hyderabad · Job Type: Full-time · About Us: · ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP and Fintech platform. Its ease of commerce solutions are b ...
-
Data Engineer
3 weeks ago
Microsoft hyderabad, IndiaOverview · Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, ...
-
Data Engineer
5 days ago
WALLERO TECHNOLOGIES PRIVATE LIMITED Hyderabad, IndiaRoles & Responsibilities : · Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm. · - Innovative Problem Solving : D ...
-
Data Engineer
1 week ago
State Street Hyderabad, India Full timeRole Summary & Role Description · As Data Engineer you will · Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center · Own and ensure ...
-
Data Engineer
3 weeks ago
Unison Consulting Pte Ltd hyderabad, IndiaWork collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions. · Continuously improve security & observability telemetry services based on input from a divers ...
-
Data Engineer
4 weeks ago
Anblicks Hyderabad, IndiaPosition: Data Engineer- Snowflake · Experience: 5+ years · Location: Hyderabad · Anblicks · is Data and AI Company – We bring value to your data. · Skills & Experience: · Experience in working with · AWS S3/ Azure ADLS Storage Accounts and Snowflake . · Strong experience in · da ...
-
Data Engineer
3 weeks ago
PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited hyderabad, IndiaDescription · : GenAI Data Engineering - Senior Manager PwC US - Acceleration Center is seeking a seasoned and visionary GenAI Data Engineer to join our team at the Senior Manager level. In this leadership role, you will oversee the development and enhancement of data pipeline ...
-
Data Engineer
4 weeks ago
Two95 International Inc. Hyderabad, IndiaTitle: Data Engineer · Type: Full Time · Location: Hyderabad · Salary: · Open (INR) · Requirements · Job Description · Apply strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting sol ...
-
Data Engineer
1 week ago
Prudent Technologies and Consulting, Inc. Hyderabad, IndiaWe are searching for an experienced Python Data Engineer with a strong focus on ETL processes and API development. This role is pivotal in designing and implementing efficient, scalable ETL pipelines and developing APIs to facilitate data access and manipulation. The ideal candid ...
-
Data Engineer
3 weeks ago
Nityo Infotech hyderabad, India· •More than 6 years IT experience · •Azure cloud experience is mandatory · •ADF, Databricks, Azure DE/ML cloud work experience is mandatory · •Good experience on Pyspark and Python · •atleast worked 4-5 Data engineering use cases · •should good understanding of DE concepts · •C ...
-
Data Engineer
3 weeks ago
Aragen Life Sciences hyderabad, IndiaRole: Data Engineer · Role Band: Manager · Reporting To: Data Science & AI Head · Location: Hyderabad · Context · The Data Engineer will be a part of Aragen Digital X team and will build systems that collect, manage and convert raw data into usable information which will serve as ...
-
Data Engineer
1 week ago
CGI Hyderabad, India Full timePosition Description: · At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm ...
Data Engineer - hyderabad, India - Appen
Description
About Appen Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In addition, we utilize the industry's most advanced AI-assisted data annotation platform to collect and label various types of data like images, text, speech, audio, and video.Our data is crucial for building and continuously improving the world's most innovative artificial intelligence systems and Appen is already trusted by the world's largest technology companies. Now with the explosion of interest in generative AI, Appen is helping leaders in automotive, financial services, retail, healthcare, and governments the confidence to deploy world-class AI products.At Appen, we are purpose driven. Our fundamental role in AI is to ensure all models are helpful, honest, and harmless, so we firmly believe in unlocking the power of AI to build a better world. We have a learn-it-all culture that values perspective, growth, and innovation. We are customer-obsessed, action-oriented, and celebrate winning together.At Appen, we are committed to creating an inclusive and diverse workplace. We are an equal opportunity employer that does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.Appen is seeking a highly skilled and motivated Data Engineer to join our dynamic team. In this role, you will use your extensive knowledge of software development to build and enhance complex systems and applications, contributing to the evolution of AI and machine learning.Key Responsibilities:
Qualifications :