- Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.
- Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.
- Optimize and tune existing data pipelines to ensure optimal performance and scalability.
- Create and implement data quality and validation processes to ensure the accuracy of data.
- Work with stakeholders to understand business needs and translate them into actionable data solutions.
- Collaborate with the data science team to support machine learning model deployment and integration into production systems.
- Troubleshoot and resolve data-related issues promptly.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience working with Databricks, PySpark, and SQL in a professional setting.
- Strong proficiency in designing and optimizing ETL processes for large-scale data sets.
- Experience with data modeling, data warehousing, and database design principles.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
-
Pyspark, Python, SQL
13 hours ago
Black & White Business Solutions Bengaluru, Karnataka, India**Job Information**: · Industry · **IT Services*** · Province · **Karnataka*** · City · **Bangalore North*** · Postal Code · **560001*** · Country · **India*** · Apache Pyspark, python, sql JD: · Key Skills/Experience: · SQL, Python and Pyspark are required with AWS Cloud exposur ...
-
Adb + Pyspark + SQL(Rarr Job 3323)
5 days ago
RARR Technologies Pvt Ltd Bengaluru, IndiaFor LTIMINDTREE · Years- Full Time- BANGALORE/BENGALURU**Job Skills**: · SQL · ADB · PYSPARK · AZURE DATABRICKS · SYNAPSE ANALYTICS · **Responsibilities**: · - Design, develop, and implement end-to-end data pipelines and workflows using Azure Data Factory (ADF). · - Write efficie ...
-
Databricks Pyspark SQL
1 week ago
PradeepIT Consulting Services Pvt Ltd Bengaluru, IndiaJobdescription: · Role:Databricks PysparkSQL · Year ofExperience:48Years · Responsibilities: · Collaboratewith crossfunctional teams to understand data requirements anddesign efficient data processingsolutions. · Develop and maintain ETL processesusing Databricks and PySpark for ...
-
Lead - Azure Databricks, Pyspark, SQL
21 hours ago
Infogain Bengaluru, IndiaPosition: · Lead - Azure Databricks · Overall IT experience: · 9 to 13 years · Primary Skills: · Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse · Secondary Skills: · U-SQL, Spark, Scala, Python · Work Location: · Bengaluru, Pune, Mumbai, Noida, Gurugram · Mode o ...
-
Lead - Azure Databricks, Pyspark, SQL
21 hours ago
Infogain Bengaluru, IndiaPosition: · Lead - Azure DatabricksOverall IT experience: · 9 to 13 yearsPrimary Skills: · Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: · U-SQL, Spark, Scala, PythonWork Location: · Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: · Hybri ...
-
Lead - Azure Databricks, Pyspark, Sql
21 hours ago
Infogain Bangalore City, IndiaPosition: Lead Azure DatabricksOverall IT experience: 9 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, Pune, Mumbai, Noida, GurugramMode of work: Hybrid at Infogain ...
-
ETL testing, SQL, Agile, Azure, Pyspark
1 day ago
Alp Consulting Limited bangalore, IndiaDetailed JD *(Roles and Responsibilities) · Senior ETL tester having good experience working on SQL queries. · Knowledge in DWH concepts, Agile, Azure data factory, Databricks, Pyspark · Mandatory skills* · ETL testing, SQL, Agile, Azure, Pyspark · Desired skills* · Functio ...
-
Mresult Services Private Limited Bangalore, India permanentWhat are we looking for · Proven experience in implementing and delivering data solutions and pipelines on AWS. · Cloud Platform by using services AWS Glue, Lambda, Redshift. · Strong SQL, Python & Pyspark knowledge. · Hands-on experience in AWS, Databricks, Snowflake · Snow ...
-
Data Architect
1 week ago
Vega Intellisoft Bengaluru, IndiaSPARK, Pyspark, Python,SQL, HIVE or IMPALA, AIRFLOW Or oozie, GCP, DATA WAREHOUSING ETL KNOWLEDGE, DOCKER, API/MICROSERVICES, KUBERNETES · - Key Skills: · - SPARK, Pyspark, Python,SQL, HIVE or IMPALA, AIRFLOW Or oozie, GCP, DATA WAREHOUSING ETL KNOWLEDGE, DOCKER, API/MICROSERVICE ...
-
Azure Data Bricks 6 to 9 Years Pan India
1 week ago
Capgemini Bengaluru, IndiaExperience with Azure Data Bricks, Data Factory · - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics · - Experience in Python/Pyspark/Scala/Hive Programming. · - Experience with Azure Databricks/ADB · - Experience with build ...
-
Python, R
5 days ago
Vega Intellisoft Bengaluru, IndiaEXP - 6+ yrs. · - CTC - 18 LPA. · - Location - Any UST office location. · - NP - Immediate to 30 days. · - Skills : Python, R, SQL, PySpark, Scala Experience with machine learning models.- Statistical analysis · - Visualizing data o Detecting patterns and anomalies in datasets · ...
-
Aws Pyspark
1 week ago
Cognizant Bengaluru, IndiaMandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks · Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. · Good knowledge of Configuring and working on Multi node clusters and dis ...
-
Data Streaming
4 days ago
ACE Talent Consulting Bengaluru, Indiaob Description: · Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. · Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. · **Responsibilities** ...
-
Data Streaming
4 days ago
ACE Talent Consulting Bengaluru, IndiaJob Description: · Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. · Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. · **Responsibilities* ...
-
Azure Data Bricks
1 week ago
ITC Infotech India Ltd Bengaluru, Karnataka, India**NSR-6319: ITC Infotech - Databricks/PySpark offshore Developer**: · Offshore Lead Databricks/PySpark Developer · **Minimum Qualifications and Job Requirements**: · - Must be a team player. · - Must have following · SCALA, SQL, Spark/Spark Streaming, Big Data Tool Set, Linux, Py ...
-
Data Scientist
1 week ago
ITC Infotech India Ltd Bengaluru, IndiaResponsibilities/deliverables Data Engineer for Commercial Data Science · - Strong experience in analytical background (BI, data analyst or even data scientist). Should be able to independently find, investigate and troubleshoot issues with data sources than the building of pipel ...
-
Databricks with Spark
13 hours ago
RARR Technologies Bengaluru, India**Job Details - Databricks With Spark /Python/Pyspark · - Pooja Deighe**: · **Job ID**: · - RARR Job 2809**Job Title**: · - Databricks With Spark /Python/Pyspark · - Pooja Deighe**Job Type**: · - Permanent**Job Location**: · - BENGALURU / BANGALORE, CHENNAI, MUMBAI, PUNE**Total E ...
-
Data Scientist
1 week ago
Luxoft Bengaluru, India**Project** Description**: · **Responsibilities**: · Proficiency in statistical analysis and computing, algorithm categories such as Supervised Learning, Unsupervised Learning, Optimization Algorithms, Deep Learning, Search Algorithms, MLOps/MLFlow · Experience in: Python, Spark, ...
-
Java + Spark
3 days ago
CIEL HR Services Bengaluru, IndiaStrong experience in **ETL development with Java & Spark** · Strong experience with **Redshift, AWS S3, SQL** · Experience in developing **microservices** · Proficiency with **Lambda** expressions, **Pyspark** · Hands on experience with AWS services · Should have experience to le ...
-
Azure Databricks
4 days ago
CIEL HR Services Bengaluru, IndiaWork experience-Above 6 years · Notice period-Immediate to 15 days · Work Mode-Hybrid · Must have 5+ years of hands on experience in Azure Cloud development (ADF + DataBricks) · Strong in Azure SQL and good to have knowledge on Synapse / Analytics Experience in working on Agile P ...
Databricks + Pyspark + SQL - Bengaluru, India - PradeepIT Consulting Services Pvt Ltd
Description
Job description:
Role: Databricks + Pyspark + SQL
Year of Experience:4-8 Years
Responsibilities:
Requirements: