Python Developer

Python Developer

Location: Noida, Sector 1 (Work From Office)
Experience: Minimum 2 Years
Education: Any Graduate (B.Tech/B.E preferred)

Role Summary

We are looking for a skilled Python Developer with hands-on experience in web scraping, web crawling, and data extraction. The ideal candidate should be capable of building scalable scraping solutions, processing large datasets, and integrating data from multiple online and database sources efficiently.

Key Responsibilities

• Develop, maintain, and optimize web scrapers and web crawlers for extracting data from various online sources.
• Build scalable and efficient data extraction workflows using Python.
• Store extracted data in structured formats and databases.
• Perform data cleaning, validation, transformation, and formatting.
• Integrate multiple databases and external data sources into unified systems.
• Monitor, maintain, and manage logs using Python-based utilities/scripts.
• Troubleshoot scraping-related challenges including anti-bot mechanisms, dynamic websites, and performance bottlenecks.
• Ensure data accuracy, consistency, and reliability across systems.

Required Technical Skills

• Strong practical understanding of web scraping and web crawling concepts.
• Hands-on experience with:
  • Python
  • JavaScript
  • HTML/CSS
  • BeautifulSoup
  • Selenium
  • MySQL
• Working knowledge of:
  • Asynchronous Programming in Python
  • Python Threading & Multiprocessing
  • Event-driven programming
  • REST APIs and data handling
• Understanding of scalable application design principles.
• Experience integrating multiple databases and external data sources into a single system.

Preferred Skills

• Experience with MongoDB (added advantage).
• Knowledge of Scrapy or similar scraping frameworks.
• Familiarity with Linux environment and deployment processes.
• Understanding of proxies, rotating IPs, and captcha handling techniques.
• Exposure to cloud platforms or distributed scraping systems is a plus.
• Good debugging and problem-solving skills.

Soft Skills

• Strong analytical and logical thinking.
• Ability to work independently and within a team.
• Good communication and coordination skills.
• Ability to manage multiple tasks and deadlines efficiently.