Job Description: 

  • Build scripts to programmatically gather information, do repetitive tasks, scrape websites, apps and to process the data gathered.
  • Organise and store information with existing tools or new tools.
  • Identify problem gaps, recommend and implement new methodologies and workflows to reduce manual labour or reduce resources spent.
  • Interpret results of scrapes to identify insights and present information in an actionable manner
  • Assist in analytics work as required, to drive actionable business decisions
  • Is ambitious about scalability and long term sustainability of various technical processes 


  • In-depth experience and proven track record of architecting, developing and extending complex web scraping processes (e.g. Python libraries such as Scrapy, pandas, mapreduce, BeautifulSoup)
  • Understand hows each of the internet protocol (http, https, xhr, jsonp, web services, etc) works, in order to scrape via various methods
  • Previous experience with scraping mobile apps is a strong bonus.
  • Experience with multi-processing, multi-threading is advantageous
  • SQL (Structured Query Language) knowledge would be an added advantage 
  • Good communication skills, with ability to explain technical details to a non-technical audience
  • Detail-oriented, willing and able to learn independently
  • A strong team player, collaborates well in cross-functional teams
  • Is open towards learning new technologies, and adapting to change.
  • Is passionate in shipping quality high performance code and has strong sense of ownership

Apply for this Job

* Required