Open Roles
As a Senior Python Developer within the scraping team at NielsenIQ, you will be among our talented and passionate team helping us optimize data collection. You will design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones.
Conduct comprehensive code review and data validation to maintain the highest standards of code and data quality. Leverage in-depth knowledge of the HTTP protocol, modern web browser mechanisms, and internal tools to design sophisticated web crawling solutions that bypass advanced anti-bot countermeasures.
Architect and contribute to significant new developments across multiple codebases, providing clear technical documentation. Conduct training sessions for relevant teams when necessary. Your expertise will help shape the future of our data collection capabilities.
Master's degree in Computer Science, IT, or a related field is required. At least 3 years of professional experience in software engineering is essential. Knowledge of BeautifulSoup or Scrapy framework is required, along with familiarity with HTML and JavaScript and solid understanding of single-page applications.
Experience with RESTful and/or GraphQL APIs is required. Hands-on experience with major Python web frameworks such as Django, FastAPI, or similar is essential. Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting are required. Proven experience with major cloud providers such as AWS, GCP, or Azure is necessary.