Company Overview
At CommerceIQ, we help consumer brands accelerate their retail ecommerce market share growth and profitability through machine learning algorithms. We are building the world’s most complete and sophisticated Retail Ecommerce Management Platform, which connects and intelligently automates the management of retail ecommerce channels like Amazon, Walmart, and Instacart, across the entire ecommerce operational chain of retail media management, sales operations, supply chain, and digital self analytics.
We are in hyper growth mode, having recently raised our Series D funding at unicorn valuation (>$1B) and ended our third year of triple-digit revenue growth. Continued acceleration of our growth is fueled by landing new customers, expanding our platform through new products, managing new retail ecommerce platforms, and delivering exceptional customer service to unlock high net retention rates.
The Role:
A key component of our Data Acquisition platform is the fleet of crawlers that we use to gather millions of web pages from hundreds of retailers every day. In order to gather data in a predictable and reliable manner, it’s vital that each of our crawlers is able to navigate a retailer’s website without being detected as being a bot. The mission of our new Bot Detection team is to provide tools and services that allow our crawlers to avoid detection and to gather data with high-levels of success. To achieve this, the team provides two key systems, Firstly, a service to provide ‘good’ browsers, tailored to the needs and challenges of each retailer. Secondly, a library of captcha-solvers that help handle scenarios where detection is harder to avoid.
We’re looking for a highly skilled and technically curious Software Engineer to lead the team as we embark on the development of these vital systems.
What You'll Do:
- Lead a team of specialist engineers in the development of new services to help avoid bot detection systems and to solve captchas
- Analyse bot-detection systems, establishing how they work and how to avoid them
- Reverse engineer highly-obfuscated bot-detection JavaScript libraries, and determine exactly what actions they perform
- Collaborate with other senior engineers in the Data Acquisition tribe to determine an architectural approach to incorporate detection-avoidance capabilities into our wider platform
- Take responsibility for the health of the team; fostering a positive and collaborative culture
- Be responsible for all aspects of the team’s delivery and development; leading and championing agile processes, and driving continuous improvement
- Balance hands-on development alongside team leadership responsibilities
- Drive the growth and development of the team and its processes; exploring and championing new techniques, technologies and tools
- Participate in engineering and architecture forums to help build a culture of excellence within the engineering organisation
What You'll Bring:
- Extensive experience and a deep understanding of JavaScript
- Significant experience working with Linux/Unix
- Very strong understanding of web technologies: HTML, DOM, HTTP, and CSS
- Strong understanding of system networking
- Good interpersonal and communications skills
- An ability to think outside the box to solve difficult problems
- Experience working with cloud-based technologies and development processes
- Familiarity with SDLC and agile methodologies
- Strong understanding of modern coding practices and standards
- A passion for delivering quality software
Nice to Haves:
- Experience with web-scraping and its challenges
- Experience with TypeScript
- Experience of building services in the cloud, especially with Google Cloud Platform
- Experience of containerisation using Docker and Kubernetes
- Experience of building infrastructure as code, especially with Terraform
- Data analysis and SQL skills