- Design and develop data pipelines for Generative AI projects by leveraging a combination of technologies, including Vector DB, Graph DB, Airflow, Spark, PySpark, Python, LangChain, AWS Functions, Redshift, and SSIS. This will involve the logical and efficient integration of these tools to create seamless, high-performance data flows that efficiently support the data requirements of our cutting-edge AI initiatives. Collaborate with data scientists, AI researchers, and other stakeholders to understand data requirements and translate them into effective data engineering solutions.
- User will be managing movement, organization and quality assessments of large set of data to facilitate the creation of Knowledge base for RAG systems and model training
- Demonstrate familiarity with data integration services such as AWS Glue and Azure Data Factory, showcasing the ability to effectively utilize these platforms for seamless data ingestion, transformation, and orchestration across various sources and destinations.
- Possess proficiency in constructing data warehouses and data lakes, demonstrating a strong foundation in organizing and consolidating large volumes of structured and unstructured data for efficient storage, retrieval, and analysis.
- Optimize and maintain data pipelines to ensure high-performance, reliable, and scalable data processing.
- Develop and implement data validation and quality assurance procedures to ensure the accuracy and consistency of the data used in Generative AI projects.
- Monitor and troubleshoot data pipeline performance, identify bottlenecks, and implement improvements as necessary.
- Stay current with emerging trends and technologies in the fields of data engineering, Generative AI, and related areas to ensure the continued success of our projects.
- Collaborate with team members on documentation, knowledge sharing, and best practices for data engineering within a Generative AI context.
- Ensure data privacy and security compliance in accordance with industry standards and regulations
- Bachelors or Masters degree in Computer Science, Engineering, or a related field.
- Strong experience with data engineering technologies, including Vector DB, Graph DB, Airflow, Spark, PySpark, Python, langchain, AWS Functions, Redshift, and SSIS.
- Strong understanding of data warehousing concepts, ETL processes, and data modeling.
- Strong understanding of S3 and code-based scripting to move large volumes of data across application storage layers
- Familiarity with Generative AI concepts and technologies, such as GPT-4, Transformers, and other natural language processing techniques.
- Excellent problem-solving, analytical, and critical thinking skills.
- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Knowledge of cloud computing platforms, such as AWS, Azure, or Google Cloud Platform, is a plus.
- Experience with big data technologies, such as Hadoop, Hive, or Presto, is a plus.
- Familiarity with machine learning frameworks, such as TensorFlow or PyTorch, is a plus.
- A continuous learning mindset and a passion for staying up-to-date with the latest advancements in data engineering and Generative AI.
-
Job Description: PowerApps & Co-Pilot Studio Developer · Key Responsibilities: · Design, develop, and maintain applications using PowerApps and Co-Pilot Studio. · Implement prompt engineering techniques to optimize AI-driven solutions. · Develop and integrate custom plugins to en ...
Kolkata, Delhi, Mumbai Full time1 day ago
-
Lead and manage software development projects and technical teams in alignment with organizational goals · Design, develop, test, and deploy scalable software applications and systems · Collaborate with cross-functional teams to gather requirements and deliver solutions efficient ...
Kolkata, Delhi, Mumbai ₹600,000 - ₹1,600,000 (INR) per year Full time5 days ago
-
Prudential s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our peop ...
Kolkata, Delhi, Mumbai Full time5 days ago
-
CCTechs Digital Transformation Team partners with global AEC and manufacturing customers to modernize engineering workflows through advanced CAD/CAE automation, PLM integrations, and BIM-enabled digital twins. We are seeking high-energy Interns who can combine domain expertise wi ...
Kolkata, Delhi, Mumbai Full time5 days ago
-
B.Tech./ master s in computer science/ chemical/ electrical/ Electronics/ Mechatronics/ Instrumentation & Controls/ Industrial Engineering with a strong publication record. · Working knowledge of Mobile application development and deployment for Android & iOS platform. · Experien ...
Kolkata, Delhi, Mumbai Full time1 day ago
-
We are looking for a seasoned Tech Lead / Architect with extensive experience in web application development using Angular JS, Node JS, cloud platforms, and low-code/no-code environments . The ideal candidate will have a deep understanding of full-stack development, architectural ...
Kolkata, Delhi, Mumbai ₹2,800,000 - ₹6,500,000 (INR) per year Full time1 day ago
-
We are seeking a highly skilled Site Reliability Engineer (SRE) to maintain the stability of our software product throughout its entire development lifecycle. You will be responsible for measuring and monitoring the system's general state, analyzing incident data, automating moni ...
Kolkata, Delhi, Mumbai ₹1,500,000 - ₹3,500,000 (INR) per year Full time5 days ago
-
Key Responsibilities: · Lead and manage cross-functional data engineering teams for successful delivery of data initiatives. · Architect, design, and implement scalable and efficient data pipelines and ETL workflows. · Develop high-quality, reusable code using Python and SQL for ...
Kolkata, Delhi, Mumbai Full time1 day ago
-
We are seeking a skilled API Software Engineer to join our dynamic team in India. The ideal candidate will be responsible for designing and developing robust APIs that power our applications and services. You will work closely with cross-functional teams to ensure seamless integr ...
Kolkata, Delhi, Mumbai Full time5 days ago
-
Expect more. Connect more. Be more at Diebold Nixdorf. Our teams automate, digitize, and transform the way more than 75 million people around the globe bank and shop in this hyper-connected, consumer-centric world. Join us in connecting people to commerce in this vital, rewarding ...
Kolkata, Delhi, Mumbai Full time5 days ago
-
Roles and Responsibilities: · What are we looking for · SRE organization s mission at SentinelOne (S1) is to keep our uptime promise to our customers by ensuring we meet our SLOs/SLAs, help our engineering teams ship software to our customers fast and with quality and ensure our ...
Kolkata, Delhi, Mumbai ₹4,500,000 - ₹8,000,000 (INR) per year Full time5 days ago
-
Must have 3+ years of IT experience, relevant experience of at least 1 year in Snowflake. · In-depth understanding of Data Warehousing, ETL concepts and modeling structure principles · Experience working with Snowflake Functions, hands on exp with Snowflake utilities, stage and f ...
Kolkata, Delhi, Mumbai Full time1 day ago
-
Key Responsibilities: · Architectural Leadership: · Define, design, and oversee the architecture of complex Java-based applications and systems. · Lead the architectural reviews and technical assessments for projects, ensuring alignment with overall enterprise architecture. · Col ...
Kolkata, Delhi, Mumbai ₹3,500,000 - ₹6,500,000 (INR) per year Full time1 day ago
-
What will you do · As a Senior Software Engineer on our Cloud Native Security team, you will be responsible for developing and scaling detection engines for SentinelOne's next-generation cloud security platform. If you have a growth mindset and are excited by the prospect of buil ...
Kolkata, Delhi, Mumbai ₹2,200,000 - ₹3,800,000 (INR) per year Full time5 days ago
-
We are looking for a skilled Technical Content Writer with 12 years of experience to join our growing team. In this role, you will create high-quality, engaging, and accurate content that communicates complex technical concepts clearly and compellingly. You will work closely with ...
Kolkata, Delhi, Mumbai ₹300,000 - ₹900,000 (INR) per year Full time5 days ago
-
Required Skills And Qualifications · At least 8 years of experience implementing Chatbot technologies · Knowledgeable in basic concepts of NLP and NLU Intent Classification, Keyword/Entity extraction , Text Similarity, Text Pre-processing, dialog flows, speech to text, text to sp ...
Kolkata, Delhi, Mumbai Full time1 day ago
-
What will you do · As a Staff Technical Support Engineer specializing in Windows environments, you'll be a key member of our Endpoint Security team. You'll serve as the final escalation point for complex issues related to SentinelOne agents deployed on Windows, working closely wi ...
Kolkata, Delhi, Mumbai ₹1,800,000 - ₹4,200,000 (INR) per year Full time5 days ago
-
Job Description: Responsibilities: · Lots of coding And problem solving. And more coding · Working in a dynamic atmosphere of an evolving strategy and scope · Participating in discussions & brainstorming sessions on architecture, design, and logic/algorithms · Working closely wit ...
Kolkata, Delhi, Mumbai ₹600,000 - ₹2,200,000 (INR) per year Full time1 day ago
-
What are we looking for · We are seeking a highly skilled and experienced Salesforce CPQ Developer who is proficient in both the administrative and development aspects of Salesforce CPQ and the broader Salesforce platform. · This senior-level role requires a deep understanding ...
Kolkata, Delhi, Mumbai Full time5 days ago
-
Key Responsibilities: · Design, implement, and manage CI/CD pipelines for seamless deployment · Automate infrastructure provisioning using tools like Terraform, Ansible, or CloudFormation · Monitor system performance, troubleshoot issues, and ensure high availability · Manage clo ...
Kolkata, Delhi, Mumbai ₹800,000 - ₹2,200,000 (INR) per year Full time5 days ago
Data Engineer AWS/ Power platform Engineer - Kolkata, Delhi, Mumbai - Systechcorp Private Limited
Description
Qualifications we seek in you:
Preferred Qualifications/ skills
-
IT - RPA Developer
Full time Systechcorp Private Limited- Kolkata, Delhi, Mumbai
-
sse (it)
Full time confidential- Kolkata, Delhi, Mumbai
-
Senior CIAM Engineer
Full time confidential- Kolkata, Delhi, Mumbai
-
Intern-Digital Transformation
Full time confidential- Kolkata, Delhi, Mumbai
-
Full Stack Developer Android ios
Full time Ztek Consulting- Kolkata, Delhi, Mumbai
-
Tech Lead/Architect
Full time Fort Technologies- Kolkata, Delhi, Mumbai
-
Site Reliability Engineer
Full time confidential- Kolkata, Delhi, Mumbai
-
Senior Azure API Management
Full time Ztek Consulting- Kolkata, Delhi, Mumbai
-
API Software Engineer
Full time confidential- Kolkata, Delhi, Mumbai
-
Advanced Applications Programming Analyst
Full time confidential- Kolkata, Delhi, Mumbai
-
Staff Site Reliability Engineer
Full time confidential- Kolkata, Delhi, Mumbai
-
Snowflake Developer
Full time The It Mind Services- Kolkata, Delhi, Mumbai
-
Lead Architect
Full time Comviva Technology- Kolkata, Delhi, Mumbai
-
Senior Software Engineer
Full time confidential- Kolkata, Delhi, Mumbai
-
Technical Content Writer
Full time confidential- Kolkata, Delhi, Mumbai
-
Kore AI Tech Lead
Full time Systechcorp Private Limited- Kolkata, Delhi, Mumbai
-
Staff Technical Support Engineer
Full time confidential- Kolkata, Delhi, Mumbai
-
React native
Full time Systechcorp Private Limited- Kolkata, Delhi, Mumbai
-
Staff Salesforce CPQ Developer
Full time confidential- Kolkata, Delhi, Mumbai
-
DevOps Engineer
Full time confidential- Kolkata, Delhi, Mumbai
