Consultant - Databricks & Generative AI - Bangalore, India - Staffington Consulting Pvt Ltd

Description

• Set up Databricks workspaces for data analysis and machine learning tasks.
• Import and explore data using Databricks, ensuring data quality and integrity.
• Collaborate with crossfunctional teams to design, develop, and deploy AI solutions leveraging GPT, LLMOps, and Small Language Models.
• Research and experiment with various AI architectures and frameworks to optimize model performance and efficiency.
• Build and train AI models for a wide range of applications including natural language processing, text generation, and conversational AI.
• Implement data cleansing and preprocessing techniques to prepare data for analysis and modeling.
• Train and evaluate machine learning models within the Databricks platform.
• Advance machine learning capabilities on Databricks by implementing advanced algorithms and techniques.
• Deploy and integrate machine learning models with Databricks for realworld applications.
• Monitor and manage machine learning workflows to ensure optimal performance and efficiency.
• Optimize machine learning workflows on Databricks using various optimization techniques.
• Implement version control for machine learning projects to track changes and manage collaboration.
• Address data security considerations within the Databricks environment to protect sensitive information.
• Understand and utilize Spark clusters for distributed data processing and analysis.

• Databricks ML Certification (i.e. Databricks Lakehouse ML Associate Certified or Databricks Lakehouse ML Professional Certified)
• Experience in ML Engineering
• Gen AI (GPT or LLMOps or Small Language Model)