Jobs
>
Bengaluru

    Python/PySpark Developer - Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Pune/Chennai - CA-One India

    CA-One India
    CA-One India Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Pune/Chennai

    22 hours ago

    Default job background
    Technology / Internet
    Description

    Job description

    Job Opportunity: Pyspark Developer

    Experience: 6+ Years

    Location: Bangalore, Hyderabad, Pune, Chennai

    Job description :

    • Good hands-on experience in Pyspark, preferably more than 5 years
    • Should have good knowledge of Python and spark concepts
    • Develop and maintain data pipelines and ETL processes using Python and Pyspark.
    • Design, implement, and optimize Spark jobs for performance and scalability.
    • Perform data analysis and troubleshooting to ensure data quality and reliability
    • Proficient in Python programming language and PySpark concepts.
    • Design, develop, and maintain PySpark applications for data processing, analysis, and transformation.
    • Strong understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL.
    • Solid knowledge of data transformation and manipulation using PySpark libraries, functions, and SQL expressions.
    • Familiarity with distributed computing concepts and big data processing frameworks.
    • Solid understanding of databases & SQL at oracle, postgre and Snowflake.
    • Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data integration issues.
    • Ensure data quality and integrity by implementing data validation and error handling mechanisms in PySpark applications.
    • Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams.
    • Design and implement data storage solutions using Amazon S3 buckets considering scalability, security, and cost-efficiency.
    • Manage and organize data within S3 buckets, defining folder structures, access control policies, and data lifecycle management strategies.
    • Define and implement data schemas and structures using Avro and Parquet formats.

    Skills : spark, data processing, sql, data, design, s3, skills, structures, processing, concepts

    )
  • Cognizant Technology Solutions

    Python/pyspark

    1 week ago

    Cognizant Technology Solutions Bengaluru, India

    **Python/Pyspark Engineer** · **Job Location: Bangalore/Willing to relocate to Bangalore** · **Exp: 4 to 12 years** · **Introduction**: · We work with customers who need to improve their capacity to respond on computerized world and empower adaptability, evacuate execution bounda ...

  • Black & White Business Solutions

    Pyspark, Python, SQL

    8 hours ago

    Black & White Business Solutions Bengaluru, Karnataka, India

    **Job Information**: · Industry · **IT Services*** · Province · **Karnataka*** · City · **Bangalore North*** · Postal Code · **560001*** · Country · **India*** · Apache Pyspark, python, sql JD: · Key Skills/Experience: · SQL, Python and Pyspark are required with AWS Cloud exposur ...

  • SRS Infoway

    Databricks, Python, Pyspark

    1 week ago

    SRS Infoway Bengaluru, India

    **Total Exp**: 8+years · **Relvant Exp**: 4+years · **Notice Period**: Immediate-30days · **Mode of Hiring**: Permanent · **Location**: Bangalore ...

  • Virtusa

    Python Pyspark Lead

    16 hours ago

    Virtusa Bengaluru, India

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications, · Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALA · Experience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance ...

  • Mercedes-Benz Research and Development India Private Limited

    Python Developement

    4 days ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Skills · - Specific Knowledge: · - Excellent knowledge in Python 3.x. · - Strong understanding of object-oriented programming and Data Structures · - Write reusable, testable, scalable, and efficient Python code. · - Experience with code versioning tool Git · - ...

  • RARR Technologies

    Aws Glue + Pyspark + Python(Rarr Job 3485)

    5 days ago

    RARR Technologies Bengaluru, India

    For LTIMINDTREE · Years- Full Time- HYDERABAD, BANGALORE/BENGALURU, MUMBAI, PUNE, CHENNAI**Job Skills**: · PYTHON · PYSPARK · GLUE · AWS · - Experience on data migration from On-Prem databases to AWS Cloud on S3, Glue · - Understands where to obtain information needed to make the ...

  • Mercedes-Benz

    Python Developer

    22 hours ago

    Mercedes-Benz bangalore, India

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:InfotainmentGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:sofortVeröffentlichungsdatum:..4Stellennummer:MERB J ...

  • Corporate Resources

    Pyspark Developer

    22 hours ago

    Corporate Resources bangalore, India

    Job Description Designing and developing big data applications using the PySpark framework to meet the needs of the business · Writing and optimizing Spark SQL statements to extract and manipulate large datasets · Developing and deploying Spark algorithms to perform data proces ...

  • EMPASYS INFO SOLUTIONS PVT LTD

    Software Developer Python Pyspark AWS Devops

    6 hours ago

    EMPASYS INFO SOLUTIONS PVT LTD bangalore, India

    Job Role: SoftwareDeveloper (Python Pyspark AWS Devops ) · Experience: 5 YearsMandatory Skills: Python Pyspark AWSDevops · Location: Pune Work mode: Hybrid · Budget: 16 LPA Education:Graduate · TechnologySkills: · Strongknowledge of Python/Pyspark and Bash scripting · Expe ...

  • Genpact

    AM-Pyspark Developer

    22 hours ago

    Genpact bangalore, India Full time

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom ...

  • krazy mantra hr solutions

    Hiring For Data Bricks with Python/Pyspark

    1 week ago

    krazy mantra hr solutions Bengaluru/ Bangalore, India Full time

    Apply for Hiring For Data Bricks With Python/Pyspark, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on ...

  • EY

    Det-rce-python-developer-gdsf02

    8 hours ago

    EY Bengaluru, Karnataka, India

    At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build ...

  • EY

    Det mw python Developer gdsf02

    1 week ago

    EY Bengaluru, India

    At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build ...

  • EY

    Det rce python developer gdsf02

    4 days ago

    EY Bengaluru, Karnataka, India

    At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build ...

  • EY

    Det mw python Developer gdsf02

    1 week ago

    EY Bengaluru, India

    At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build ...

  • Mresult Services Private Limited

    MResult - Data Architect - SQL/Python/PySpark

    22 hours ago

    Mresult Services Private Limited Bangalore, India permanent

    What are we looking for · Proven experience in implementing and delivering data solutions and pipelines on AWS. · Cloud Platform by using services AWS Glue, Lambda, Redshift. · Strong SQL, Python & Pyspark knowledge. · Hands-on experience in AWS, Databricks, Snowflake · Snow ...

  • Dexian India

    Python Developer

    16 hours ago

    Dexian India Bengaluru, India

    Job Role: · Python Developer · Experience: · 3 – 5 years · Work Type: · Hybrid · Work Location : Bangalore · Skills: · Python Programming, Any Python Framework(Django, Pyspark, Pycharm, Numpy, Pandas) Test Automation experience, Server / Storage / Network domain · Qualifications: ...

  • Havells India Limited

    Havells - Azure Data Engineer - PySpark/Python

    22 hours ago

    Havells India Limited Bangalore, India

    We are looking to hire a Data Engineer to join our data team. You will take responsibility for managing our master data set, developing reports, and troubleshooting data issues. To do well in this role you need a very fine eye for detail, experience as a data analyst, and deep un ...

  • Capgemini

    Python Powershell Automation Developer-3-9

    6 days ago

    Capgemini Bengaluru, India

    Should be Expert in Python PowerShell hands on experience · - Knowledge on design techniques · - Good Analytical skills · - Should have good communication skills and ability to mentor guide juniors to achieve technical excellence · - Good time management skills · - End to End Aut ...

  • IT

    Python Developer

    21 hours ago

    IT bangalore, India

    Job Overview : · We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requi ...