Web Scraping Expert - Bengaluru, Karnataka, India - FullStackTechies

FullStackTechies
FullStackTechies
Verified Company
Bengaluru, Karnataka, India

2 weeks ago

Deepika Kaur

Posted by:

Deepika Kaur

beBee Recuiter
Description

AIMLEAP is Hiring:

Job Title:
Web Scraping Expert (Scrapy & Python)


Company:

AIMLEAP

CTC: 3 LPA - 5 LPA (
Depends on interview performance )


Department:
Data Engineering/Web Development


Summary:

We are seeking a talented and results-oriented Web Scraping Expert to join our team. You will be responsible for developing and maintaining robust web scraping pipelines using Scrapy, a high-performance Python framework.

You will leverage your expertise in Python and web scraping techniques to extract valuable data from various online sources in a reliable and scalable manner.


Responsibilities:


  • Design, develop, and maintain web scraping projects using Scrapy, including:
  • Crawling websites to extract specific data points
  • Implementing efficient crawling strategies to handle pagination, dynamic content, and complex website structures
  • Employing data extraction techniques with CSS selectors and XPath
  • Processing and cleaning scraped data using Python libraries (e.g., Pandas, NumPy)
  • Storing extracted data in appropriate formats (e.g., CSV, JSON, databases)
  • Collaborate with data engineers and analysts to identify data needs and define scraping requirements
  • Write welldocumented, maintainable, and efficient Scrapy code
  • Integrate scraping pipelines with other Python frameworks and tools as needed
  • Stay uptodate with the latest web scraping trends and best practices
  • Troubleshoot and address challenges related to rate limiting, authentication, and website changes
  • Implement caching strategies for efficient data retrieval and reduced website load
  • Consider potential ethical and legal implications of web scraping

Qualifications:


  • Proven experience with web scraping techniques and tools (Scrapy preferred)
  • Strong proficiency in Python programming
  • Knowledge of HTML and CSS for navigating website structures
  • Experience with data extraction methods (CSS selectors, XPath)
  • Familiarity with data cleaning and manipulation libraries (Pandas, NumPy)
  • Understanding of distributed crawling concepts for largescale data extraction
  • Excellent problemsolving and analytical skills
  • Ability to work independently and as part of a team
  • Strong communication and documentation skills

Salary:
₹300, ₹600,000.00 per year


Benefits:


  • Health insurance
  • Work from home

Schedule:

  • Day shift

Supplemental pay types:

  • Yearly bonus

Application Question(s):

  • Years of experience in web scraping
  • Do you have experience in Scrapy
  • Current CTC
  • Notice period (in days)
  • Experience in ,,

Experience:

- total work: 2 years (preferred)


Work Location:
Remote
More jobs from FullStackTechies
See all jobs of FullStackTechies