Experience: 3+ Years

PipeCandy is the industry-standard dataset that tracks millions of eCommerce companies and several billion dollars of eCommerce GMV down to the transaction level. The ‘Who’s Who’ of the eCommerce ecosystem uses PipeCandy’s data and insights for strategic planning, thesis formation, market intelligence, and growth tactics execution. We are a part of Assembly, the eCommerce data, software, and content platform unicorn and we are a profitable company. We are backed by the world's top private equity firms.

About the Role:

PipeCandy is building a market/industry intelligence product that combines sophisticated ML/AI algorithms with deep sector intelligence focused on eCommerce and Digital Native companies. You will be a part of our technology team. We expect you to hustle when it's needed and scale when it's time to. If you belong to one of the camps (between being a hustler & being scale focused) as long as you are very good at your approach, we'd like to meet you.

Key Responsibilities:

  • Help develop and implement scalable and speedy data crawlers to extract large volumes of data
  • Help implement scrapers and data extraction modules to get clean and normalised data from crawled sites
  • Set up processes and code to monitor and maintain scrapers to address any changes in crawled website
  • Test third party APIs and develop appropriate processes and systems to integrate data from APIs with PipeCandy databases
  • Writing unit, integration and regression tests, some of which need to be automated

Techno-Functional Expertise Required:

  • 3+ years of hands-on web crawling and data scraping experience
  • Knowledge of crawling and scraping frameworks such as Request, BeautifulSoup, scrapy etc,.
  • Strong coding experience in Python
  • Knowledge and experience in the Go language and/or Typescript/Javascript will be a huge plus
  • Experience with SQL and NoSQL databases
  • Knowledge of deployment strategies in AWS or Azure or GCP

Skills Required:

  • Self-motivated and able to take responsibility and accountability for tasks allocated
  • Ability to work with business, data, and technology teams to deliver data acquisition projects
  • Ability to multi-task, solve problems and think strategically
  • Ability to work as part of a high-functioning, multi-tasking team
  • Clear analytical and communication skills

What's in it for you:

  • Goal-driven, apolitical, and aligned organization with great opportunities to learn from peers and founders across geographies
  • An opportunity to work with a unique global market leader in the eCommerce intelligence space and also only one such company that is built out of India
  • A financially stable, well-funded organization with high growth potential
  • Remote-friendly leave policies
  • A strong work culture where collaboration is easy
  • A group of ex-founders as colleagues who believe in getting things done
  • Access to Udemy for self-learning

Read about our founding principles and values, We mean them. Above all perks, these are what will make PipeCandy a great place for you to work.

Apply for this Job

* Required