Twilio is seeking a Senior Software Engineer for our Business Intelligence team with industry experience and a deep understanding of data usage and life cycles across a SaaS-based organization. We are looking for someone to build the data processing layer, used by our various business teams and applications, in a way that enables the wide variety of downstream reporting required (from real-time, to daily/weekly/monthly summaries).

About the job:

The person in this role will be responsible for the implementation of the data pipelines that extracts raw data from our internal platform or 3rd party systems and stores/summarizes/presents it appropriately for analysis across multiple business teams for both tactical and strategic initiatives. The individual will work closely with data engineers,analysts in Business Intelligence team, as well as the engineers in Data Platform team, to ensure the solutions that are developed and implemented are tightly aligned to enterprise business standards and principles. The individual will act as a subject matter expert for integrations and data pipelines for a given data mart/tools/technologies suite.

 

Responsibilities:

  • Build and launch real-time or batch data processing pipelines supporting data warehouse models for analytics.
  • Design, build and launch ETL (Extract, Transform & Load) pipelines following all architectural standards and best practices to populate data warehouse models for business analytics
  • Design, build and launch extremely efficient & reliable data pipelines to move or extract data (both large and small amounts) from upstream twilio systems or 3rd party systems into data warehouse platform.
  • Work across multiple teams in high visibility roles and own the solution end-to-end.
  • Organize, and mine massive data sets of both structured and unstructured data by implementing appropriate infrastructure tools and systems to house data for reporting and analytics purposes.
  • Develop solutions to extract, resolve, and unify information of various types from numerous disparate data sources and integrate cohesively with external business applications (Salesforce, Braintree, Eloqua, etc.).
  • Identify trends in large data sets and validate expected and unexpected trends in the data to assist in identifying solutions to resolve the unexpected.
  • Be (or rapidly become) a thought-leader in the area of data engineering with respect to entity resolution as it pertains to Twilio’s business goals.

Requirements:

  • 5+ years of diverse experience in building data processing solutions for business analytics
  • Experience working with Hadoop stack - Hive, Pig, MapReduce, Spark
  • Experience working with Columnar/MPP Database technologies such as Redshift, Teradata etc.
  • Experience dealing with automated data quality, anomaly detection processes.
  • Experience working with real-time stream processing technologies like Kafka, AWS kinesis, Redis, Spark streaming etc.
  • Experience or familiarity with NoSQL database technologies like Cassandra, DynamoDB etc.
  • Experience with DAG based open source workflow management solutions airflow etc.
  • Expert coding skills across a number of languages including SQL, Python, Scala etc.
  • Experience in processing various file formats such as Parquet, Avro, JSON etc with compression algorithms optimizing data storage in file systems.
  • Experience building 3rd party integrations with systems like salesforce, eloqua, zendesk etc.
  • Experience in a data warehouse environment with star and snowflake schema structures.
  • Experience dealing with performance optimization for large, scalable data systems.
  • Excellent oral and written communication skills and an ability to translate complicated technical issues for a non-technical business audience.
  • Creative, curious and fascinated by data and the trends they reveal.
  • Experience or Familiarity with Agile software development methodology

 

Bonus points:

  • Experience working with AWS stack

About us:

Twilio's mission is to fuel the future of communications. Developers and businesses use Twilio to make communications relevant and contextual by embedding messaging, voice and video capabilities directly into their software applications. Founded in 2008, Twilio has over 650 employees, with headquarters in San Francisco and other offices in Bogotá, Dublin, Hong Kong, London, Madrid, Mountain View, Munich, New York City, Singapore and Tallinn.

Twilio is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal opportunity regardless of race, color, ancestry, religion, gender, gender identity, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status and operate in compliance with the San Francisco Fair Chance Ordinance. #LI-POST 

Apply for this Job
* Required
(Optional)
Almost there! Review your information then click 'Submit Application' to apply.

File   X
File   X


U.S. Equal Opportunity Employment Information (Completion is voluntary)

Individuals seeking employment at Twilio are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.

Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.


Form CC-305

OMB Control Number 1250-0005

Expires 1/31/2020

Voluntary Self-Identification of Disability

Why are you being asked to complete this form?

Because we do business with the government, we must reach out to, hire, and provide equal opportunity to qualified people with disabilities1. To help us measure how well we are doing, we are asking you to tell us if you have a disability or if you ever had a disability. Completing this form is voluntary, but we hope that you will choose to fill it out. If you are applying for a job, any answer you give will be kept private and will not be used against you in any way.

If you already work for us, your answer will not be used against you in any way. Because a person may become disabled at any time, we are required to ask all of our employees to update their information every five years. You may voluntarily self-identify as having a disability on this form without fear of any punishment because you did not identify as having a disability earlier.

How do I know if I have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Disabilities include, but are not limited to:

  • Blindness
  • Deafness
  • Cancer
  • Diabetes
  • Epilepsy
  • Autism
  • Cerebral palsy
  • HIV/AIDS
  • Schizophrenia
  • Muscular dystrophy
  • Bipolar disorder
  • Major depression
  • Multiple sclerosis (MS)
  • Missing limbs or partially missing limbs
  • Post-traumatic stress disorder (PTSD)
  • Obsessive compulsive disorder
  • Impairments requiring the use of a wheelchair
  • Intellectual disability (previously called mental retardation)
Reasonable Accommodation Notice

Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.

1Section 503 of the Rehabilitation Act of 1973, as amended. For more information about this form or the equal employment obligations of Federal contractors, visit the U.S. Department of Labor's Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.


Share this job: