- Collaboratewith crossfunctional teams to understand data requirements anddesign efficient data processingsolutions.
- Develop and maintain ETL processesusing Databricks and PySpark for largescale dataprocessing.
- Optimize and tune existing datapipelines to ensure optimal performance andscalability.
- Create and implement data qualityand validation processes to ensure the accuracy ofdata.
- Work with stakeholders to understandbusiness needs and translate them into actionable datasolutions.
- Collaborate with the data scienceteam to support machine learning model deployment and integrationinto production systems.
- Troubleshoot andresolve datarelated issuespromptly.
- Bachelorsdegree in Computer Science Engineering or a relatedfield.
- Proven experience working withDatabricks PySpark and SQL in a professionalsetting.
- Strong proficiency in designing andoptimizing ETL processes for largescale datasets.
- Experience with data modeling datawarehousing and database designprinciples.
- Familiarity with cloud platformssuch as AWS Azure orGCP.
-
Pyspark, Python, SQL
8 hours ago
Black & White Business Solutions Bengaluru, Karnataka, India**Job Information**: · Industry · **IT Services*** · Province · **Karnataka*** · City · **Bangalore North*** · Postal Code · **560001*** · Country · **India*** · Apache Pyspark, python, sql JD: · Key Skills/Experience: · SQL, Python and Pyspark are required with AWS Cloud exposur ...
-
Adb + Pyspark + SQL(Rarr Job 3323)
5 days ago
RARR Technologies Pvt Ltd Bengaluru, IndiaFor LTIMINDTREE · Years- Full Time- BANGALORE/BENGALURU**Job Skills**: · SQL · ADB · PYSPARK · AZURE DATABRICKS · SYNAPSE ANALYTICS · **Responsibilities**: · - Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF). · - Write efficie ...
-
Databricks + Pyspark + SQL
1 week ago
PradeepIT Consulting Services Pvt Ltd Bengaluru, India Full timeJob description: · Role: Databricks + Pyspark + SQL · Year of Experience:4-8 Years · Responsibilities: · Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions. · Develop and maintain ETL processes using Databricks a ...
-
Lead - Azure Databricks, Pyspark, SQL
16 hours ago
Infogain Bengaluru, IndiaPosition: · Lead - Azure Databricks · Overall IT experience: · 9 to 13 years · Primary Skills: · Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse · Secondary Skills: · U-SQL, Spark, Scala, Python · Work Location: · Bengaluru, Pune, Mumbai, Noida, Gurugram · Mode o ...
-
Lead - Azure Databricks, Pyspark, SQL
17 hours ago
Infogain Bengaluru, IndiaPosition: · Lead - Azure DatabricksOverall IT experience: · 9 to 13 yearsPrimary Skills: · Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: · U-SQL, Spark, Scala, PythonWork Location: · Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: · Hybri ...
-
Lead - Azure Databricks, Pyspark, Sql
16 hours ago
Infogain Bangalore City, IndiaPosition: Lead Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain ...
-
ETL testing, SQL, Agile, Azure, Pyspark
22 hours ago
Alp Consulting Limited bangalore, IndiaDetailed JD *(Roles and Responsibilities) · Senior ETL tester having good experience working on SQL queries. · Knowledge in DWH concepts, Agile, Azure data factory, Databricks, Pyspark · Mandatory skills* · ETL testing, SQL, Agile, Azure, Pyspark · Desired skills* · Functio ...
-
MResult - Data Architect - SQL/Python/PySpark
22 hours ago
Mresult Services Private Limited Bangalore, India permanentWhat are we looking for · Proven experience in implementing and delivering data solutions and pipelines on AWS. · Cloud Platform by using services AWS Glue, Lambda, Redshift. · Strong SQL, Python & Pyspark knowledge. · Hands-on experience in AWS, Databricks, Snowflake · Snow ...
-
Data Architect
1 week ago
Vega Intellisoft Bengaluru, IndiaSPARK, Pyspark, Python,SQL, HIVE or IMPALA, AIRFLOW Or oozie, GCP, DATA WAREHOUSING ETL KNOWLEDGE, DOCKER, API/MICROSERVICES, KUBERNETES · - Key Skills: · - SPARK, Pyspark, Python,SQL, HIVE or IMPALA, AIRFLOW Or oozie, GCP, DATA WAREHOUSING ETL KNOWLEDGE, DOCKER, API/MICROSERVICE ...
-
Azure Data Bricks 6 to 9 Years Pan India
1 week ago
Capgemini Bengaluru, IndiaExperience with Azure Data Bricks, Data Factory · - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics · - Experience in Python/Pyspark/Scala/Hive Programming. · - Experience with Azure Databricks/ADB · - Experience with build ...
-
Python, R
5 days ago
Vega Intellisoft Bengaluru, IndiaEXP - 6+ yrs. · - CTC - 18 LPA. · - Location - Any UST office location. · - NP - Immediate to 30 days. · - Skills : Python, R, SQL, PySpark, Scala Experience with machine learning models.- Statistical analysis · - Visualizing data o Detecting patterns and anomalies in datasets · ...
-
Aws Pyspark
1 week ago
Cognizant Bengaluru, IndiaMandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks · Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. · Good knowledge of Configuring and working on Multi node clusters and dis ...
-
Data Streaming
4 days ago
ACE Talent Consulting Bengaluru, Indiaob Description: · Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. · Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. · **Responsibilities** ...
-
Data Streaming
4 days ago
ACE Talent Consulting Bengaluru, IndiaJob Description: · Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. · Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. · **Responsibilities* ...
-
Azure Data Bricks
1 week ago
ITC Infotech India Ltd Bengaluru, Karnataka, India**NSR-6319: ITC Infotech - Databricks/PySpark offshore Developer**: · Offshore Lead Databricks/PySpark Developer · **Minimum Qualifications and Job Requirements**: · - Must be a team player. · - Must have following · SCALA, SQL, Spark/Spark Streaming, Big Data Tool Set, Linux, Py ...
-
Data Scientist
1 week ago
ITC Infotech India Ltd Bengaluru, IndiaResponsibilities/deliverables Data Engineer for Commercial Data Science · - Strong experience in analytical background (BI, data analyst or even data scientist). Should be able to independently find, investigate and troubleshoot issues with data sources than the building of pipel ...
-
Databricks with Spark
8 hours ago
RARR Technologies Bengaluru, India**Job Details - Databricks With Spark /Python/Pyspark · - Pooja Deighe**: · **Job ID**: · - RARR Job 2809**Job Title**: · - Databricks With Spark /Python/Pyspark · - Pooja Deighe**Job Type**: · - Permanent**Job Location**: · - BENGALURU / BANGALORE, CHENNAI, MUMBAI, PUNE**Total E ...
-
Data Scientist
1 week ago
Luxoft Bengaluru, India**Project** Description**: · **Responsibilities**: · Proficiency in statistical analysis and computing, algorithm categories such as Supervised Learning, Unsupervised Learning, Optimization Algorithms, Deep Learning, Search Algorithms, MLOps/MLFlow · Experience in: Python, Spark, ...
-
Java + Spark
3 days ago
CIEL HR Services Bengaluru, IndiaStrong experience in **ETL development with Java & Spark** · Strong experience with **Redshift, AWS S3, SQL** · Experience in developing **microservices** · Proficiency with **Lambda** expressions, **Pyspark** · Hands on experience with AWS services · Should have experience to le ...
-
Azure Databricks
4 days ago
CIEL HR Services Bengaluru, IndiaWork experience-Above 6 years · Notice period-Immediate to 15 days · Work Mode-Hybrid · Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) · Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile P ...
Databricks Pyspark SQL - Bengaluru, India - PradeepIT Consulting Services Pvt Ltd
Description
Jobdescription:
Role:Databricks PysparkSQL
Year ofExperience:48Years
Responsibilities:
Requirements:
Remote Work :
No