Jobs
>
Bengaluru

    Databricks Pyspark SQL - Bengaluru, India - PradeepIT Consulting Services Pvt Ltd

    Default job background
    Description

    Jobdescription:

    Role:Databricks PysparkSQL

    Year ofExperience:48Years

    Responsibilities:

    1. Collaboratewith crossfunctional teams to understand data requirements anddesign efficient data processingsolutions.
    2. Develop and maintain ETL processesusing Databricks and PySpark for largescale dataprocessing.
    3. Optimize and tune existing datapipelines to ensure optimal performance andscalability.
    4. Create and implement data qualityand validation processes to ensure the accuracy ofdata.
    5. Work with stakeholders to understandbusiness needs and translate them into actionable datasolutions.
    6. Collaborate with the data scienceteam to support machine learning model deployment and integrationinto production systems.
    7. Troubleshoot andresolve datarelated issuespromptly.

    Requirements:

    1. Bachelorsdegree in Computer Science Engineering or a relatedfield.
    2. Proven experience working withDatabricks PySpark and SQL in a professionalsetting.
    3. Strong proficiency in designing andoptimizing ETL processes for largescale datasets.
    4. Experience with data modeling datawarehousing and database designprinciples.
    5. Familiarity with cloud platformssuch as AWS Azure orGCP.

    Remote Work :

    No


  • Black & White Business Solutions

    Pyspark, Python, SQL

    8 hours ago


    Black & White Business Solutions Bengaluru, Karnataka, India

    **Job Information**: · Industry · **IT Services*** · Province · **Karnataka*** · City · **Bangalore North*** · Postal Code · **560001*** · Country · **India*** · Apache Pyspark, python, sql JD: · Key Skills/Experience: · SQL, Python and Pyspark are required with AWS Cloud exposur ...


  • RARR Technologies Pvt Ltd Bengaluru, India

    For LTIMINDTREE · Years- Full Time- BANGALORE/BENGALURU**Job Skills**: · SQL · ADB · PYSPARK · AZURE DATABRICKS · SYNAPSE ANALYTICS · **Responsibilities**: · - Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF). · - Write efficie ...


  • PradeepIT Consulting Services Pvt Ltd Bengaluru, India Full time

    Job description: · Role: Databricks + Pyspark + SQL · Year of Experience:4-8 Years · Responsibilities: · Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions. · Develop and maintain ETL processes using Databricks a ...


  • Infogain Bengaluru, India

    Position: · Lead - Azure Databricks · Overall IT experience: · 9 to 13 years · Primary Skills: · Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse · Secondary Skills: · U-SQL, Spark, Scala, Python · Work Location: · Bengaluru, Pune, Mumbai, Noida, Gurugram · Mode o ...


  • Infogain Bengaluru, India

    Position: · Lead - Azure DatabricksOverall IT experience: · 9 to 13 yearsPrimary Skills: · Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: · U-SQL, Spark, Scala, PythonWork Location: · Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: · Hybri ...


  • Infogain Bangalore City, India

    Position: Lead Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain ...


  • Alp Consulting Limited bangalore, India

    Detailed JD *(Roles and Responsibilities) · Senior ETL tester having good experience working on SQL queries. · Knowledge in DWH concepts, Agile, Azure data factory, Databricks, Pyspark · Mandatory skills* · ETL testing, SQL, Agile, Azure, Pyspark · Desired skills* · Functio ...


  • Mresult Services Private Limited Bangalore, India permanent

    What are we looking for · Proven experience in implementing and delivering data solutions and pipelines on AWS. · Cloud Platform by using services AWS Glue, Lambda, Redshift. · Strong SQL, Python & Pyspark knowledge. · Hands-on experience in AWS, Databricks, Snowflake · Snow ...

  • Vega Intellisoft

    Data Architect

    1 week ago


    Vega Intellisoft Bengaluru, India

    SPARK, Pyspark, Python,SQL, HIVE or IMPALA, AIRFLOW Or oozie, GCP, DATA WAREHOUSING ETL KNOWLEDGE, DOCKER, API/MICROSERVICES, KUBERNETES · - Key Skills: · - SPARK, Pyspark, Python,SQL, HIVE or IMPALA, AIRFLOW Or oozie, GCP, DATA WAREHOUSING ETL KNOWLEDGE, DOCKER, API/MICROSERVICE ...


  • Capgemini Bengaluru, India

    Experience with Azure Data Bricks, Data Factory · - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics · - Experience in Python/Pyspark/Scala/Hive Programming. · - Experience with Azure Databricks/ADB · - Experience with build ...

  • Vega Intellisoft

    Python, R

    5 days ago


    Vega Intellisoft Bengaluru, India

    EXP - 6+ yrs. · - CTC - 18 LPA. · - Location - Any UST office location. · - NP - Immediate to 30 days. · - Skills : Python, R, SQL, PySpark, Scala Experience with machine learning models.- Statistical analysis · - Visualizing data o Detecting patterns and anomalies in datasets · ...

  • Cognizant

    Aws Pyspark

    1 week ago


    Cognizant Bengaluru, India

    Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks · Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. · Good knowledge of Configuring and working on Multi node clusters and dis ...

  • ACE Talent Consulting

    Data Streaming

    4 days ago


    ACE Talent Consulting Bengaluru, India

    ob Description: · Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. · Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. · **Responsibilities** ...

  • ACE Talent Consulting

    Data Streaming

    4 days ago


    ACE Talent Consulting Bengaluru, India

    Job Description: · Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. · Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. · **Responsibilities* ...

  • ITC Infotech India Ltd

    Azure Data Bricks

    1 week ago


    ITC Infotech India Ltd Bengaluru, Karnataka, India

    **NSR-6319: ITC Infotech - Databricks/PySpark offshore Developer**: · Offshore Lead Databricks/PySpark Developer · **Minimum Qualifications and Job Requirements**: · - Must be a team player. · - Must have following · SCALA, SQL, Spark/Spark Streaming, Big Data Tool Set, Linux, Py ...

  • ITC Infotech India Ltd

    Data Scientist

    1 week ago


    ITC Infotech India Ltd Bengaluru, India

    Responsibilities/deliverables Data Engineer for Commercial Data Science · - Strong experience in analytical background (BI, data analyst or even data scientist). Should be able to independently find, investigate and troubleshoot issues with data sources than the building of pipel ...

  • RARR Technologies

    Databricks with Spark

    8 hours ago


    RARR Technologies Bengaluru, India

    **Job Details - Databricks With Spark /Python/Pyspark · - Pooja Deighe**: · **Job ID**: · - RARR Job 2809**Job Title**: · - Databricks With Spark /Python/Pyspark · - Pooja Deighe**Job Type**: · - Permanent**Job Location**: · - BENGALURU / BANGALORE, CHENNAI, MUMBAI, PUNE**Total E ...

  • Luxoft

    Data Scientist

    1 week ago


    Luxoft Bengaluru, India

    **Project** Description**: · **Responsibilities**: · Proficiency in statistical analysis and computing, algorithm categories such as Supervised Learning, Unsupervised Learning, Optimization Algorithms, Deep Learning, Search Algorithms, MLOps/MLFlow · Experience in: Python, Spark, ...

  • CIEL HR Services

    Java + Spark

    3 days ago


    CIEL HR Services Bengaluru, India

    Strong experience in **ETL development with Java & Spark** · Strong experience with **Redshift, AWS S3, SQL** · Experience in developing **microservices** · Proficiency with **Lambda** expressions, **Pyspark** · Hands on experience with AWS services · Should have experience to le ...

  • CIEL HR Services

    Azure Databricks

    4 days ago


    CIEL HR Services Bengaluru, India

    Work experience-Above 6 years · Notice period-Immediate to 15 days · Work Mode-Hybrid · Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) · Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile P ...