Purpose of the Role
We are looking for a skilled Python Developer with experience in web scraping. The successful candidate will be responsible for developing and maintaining web scraping scripts to extract data from various sources. The ideal candidate should have experience in using Scrapy, Selenium, Requests, Beautiful Soup, and AWS Lambda. Additionally, knowledge of MySQL or NoSQL databases and Pandas will be considered a plus.
Duties and Responsibilities
- Develop and maintain web scraping scripts using Scrapy, Selenium, Requests, Beautiful Soup, and other relevant technologies
- Build and maintain AWS Lambdas to automate scraping tasks
- Develop data processing and analysis pipelines using Pandas and other relevant libraries
- Troubleshoot and debug scraping scripts
- Collaborate with cross-functional teams to identify and prioritize scraping needs
- Keep up-to-date with industry trends and developments in web scraping and related technologies
- Create documentation and maintain version control for all scraping scripts and associated code
Required Experience & Knowledge
- At least 2 years of experience in Python development for web scraping
- Strong knowledge of Scrapy, Selenium, Requests, Beautiful Soup, and other relevant technologies
- Experience building and maintaining AWS Lambdas
- Familiarity with MySQL or NoSQL databases
- Strong problem-solving and analytical skills
- Excellent written and verbal communication skills
- Ability to work independently as well as part of a team
Skills and Attributes
- Ability to work independently, as well as in a cross-border team
- Client-oriented approach and leadership experience ability to adapt to tech and non-tech communication
- Self-driven, enthusiastic and friendly persona
- “How do we do better” attitude
Required Education & Qualifications
- Advanced level of both spoken and written the English language
- Any relevant certificate would be considered a plus
