Python - Team Lead

Python Team Lead

Location: Noida, Sector 1 (Work From Office)
Experience: Minimum 5–7 years
Education: B.E./B.Tech

Role Summary

We are seeking an experienced Python Team Lead with strong expertise in data extraction, web scraping, and large-scale data processing. The ideal candidate will lead a team of developers, design scalable scraping architectures, ensure data quality, and drive continuous improvement in data workflows and product capabilities.

Primary Responsibilities

• Lead and manage a team of Python developers working on web scraping and data extraction projects.
• Design, develop, and oversee scalable web scrapers and crawlers for extracting data from multiple online sources.
• Architect robust data pipelines for cleaning, transforming, and structuring large datasets.
• Ensure seamless integration of multiple data sources and databases into unified systems.
• Monitor system performance, logs, and troubleshoot issues proactively.
• Optimize scraping workflows for speed, scalability, and reliability.
• Conduct code reviews and enforce best practices in coding, documentation, and version control.
• Collaborate with product, operations, and business teams to enhance product features and data quality.
• Participate in client discussions to understand requirements and provide technical solutions.
• Mentor team members and support their technical growth and performance.

Basic Skills Required

• Strong hands-on experience in web scraping and web crawling.
• Proficiency in:
  • Python
  • JavaScript
  • HTML
  • BeautifulSoup
  • Selenium
  • MySQL
• Working knowledge of MongoDB (added advantage).
• Experience with asynchronous programming, threading, and multiprocessing in Python.
• Strong understanding of scalable system design and architecture.
• Experience in integrating multiple databases and data sources into unified systems.

Preferred Skills

• Experience in leading or mentoring development teams.
• Strong problem-solving and analytical skills.
• Exposure to event-driven programming and distributed systems.
• Ability to manage multiple projects and priorities efficiently.
• Good communication skills for cross-team and client interactions.