Join our team dedicated to developing and executing innovative solutions in support of customer mission success.


Job Description
 
Novetta has an immediate need for a Senior Data Engineer to join a fast-paced program in support of a government customer with a very critical national security mission. This is a multi-year program, where the successful candidate will work on an interdisciplinary project team of more than 30 highly qualified individuals with a wide array of skills that include client (reactjs), server (spring java), QA Automation Engineers, UI/UX Designers, and DevOps engineers. The team is responsible for building a next generation Mission Information System and is performing greenfield Software Development using modern technologies via an Agile DevOps approach.

This Senior Data Engineer will play a vital role collaborating as part of this cross-functional Agile team to create and enhance data ingestion pipelines and address big data challenges.  The Senior Data Engineer will work closely with the Chief Architect, systems engineers, software engineers, and data scientists on the following key tasks:
  • Provide Extraction, Transformation, and Load (ETL) experience coupled with enterprise search capabilities to solve Big Data challenges
  • Design and implement high-volume data ingestion and streaming pipelines using Open Source frameworks like Apache Spark, Flink, Nifi, and Kafka on AWS Cloud
  • Leverage strategic and analytical skills to understand and solve customer and business centric questions
  • Create prototypes and proofs of concept for iterative development
  • Learn new technologies and apply the knowledge in production systems
  • Monitor and troubleshoot performance issues on the enterprise data pipelines and the data lake
  • Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives
 
Required Qualifications / Experience:
 
  • BS in Computer Science, Systems Engineering, or a related technical field or equivalent experience with at least 8+ years in systems engineering or administration (6+ years with a MS/MIS Degree).
  • Must have an active Top Secret security clearance and able to obtain a TS/SCI with Polygraph.
  • 3 years of experience with big data tools: Hadoop, Spark, Kafka, NiFi.
  • 3 years of experience with object-oriented/object function scripting languages: Python (preferred) and/or Java.
  • 3 years of experience with and managing data across relational SQL and NoSQL databases like MySQL, Postgres, Cassandra, HDFS, Redis, and Elasticsearch.
  • 3 years of experience working in a Linux environment.
  • 2 years of experience working with and designing REST APIs.
  • Experience in designing/developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks.
  • Experience developing data ingest workflows with stream-processing systems: Spark-Streaming, Kafka Streams and/or Flink.
  • Experience transforming data in various formats, including JSON, XML, CSV, and zipped files.
  • Experience with performance tuning of ETL jobs.
  • Experience developing flexible ontologies to fit data from multiple sources and implementing the ontology in the form of database mappings / schemas.
  • Strong interpersonal and communication skills necessary to work effectively with customers and other team members.

 

Preferred Qualifications / Experience:

  • Data engineering experience in the Intelligence Community or other government agencies.
  • Experience with Microservices architecture components, including Docker and Kubernetes. 
  • Experience developing microservices to fit data cleansing, transformation and enrichment needs.
  • Experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, Athena and/or Glue.
  • Experience with Jira, Confluence and extensive experience with Agile methodologies.
  • Knowledge about security and best practices.
  • Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources.
  • Experience with software configuration management tools such as Git/Gitlab, Salt, Confluence, etc.
  • Experience with continuous integration and deployment (CI/CD) pipelines and their enabling tools such as Jenkins, Nexus, etc.
  • Detailed oriented/self-motivated with the ability to learn and deploy new technology quickly.

Clearance Level: TS/SCI with Poly



Novetta, from complexity to clarity.

Novetta delivers highly scalable advanced analytics and secure technology solutions to address challenges of national and global significance. Focused on mission success, Novetta pioneers disruptive technologies in machine learning, data analytics, full-spectrum cyber, cloud engineering, open source analytics, and multi-INT fusion for Defense, Intelligence Community, and Federal Law Enforcement customers. Novetta is headquartered in McLean, VA with over 1,000 employees across the U.S. 


Our culture is shaped by a commitment to our core values:

Integrity • We hold ourselves accountable to the highest standards of integrity and ethics.

Customer Success • We strive daily to exceed expectations and achieve customer mission success.

Employee Focus • We invest in our employees’ professional development and training, respecting individuality and fostering a culture of diversity and inclusion.

Innovation • We know that discovering new and innovative ways to solve problems is critical to our success and makes us a great company.

Excellence in Execution • We take pride in flawless execution as we build a company that is best in class. 



Earn a REFERRAL BONUS for the qualified people you know.

For more details or to submit a referral, visit bit.ly/NovettaReferrals.

Novetta is an equal opportunity/affirmative action employer.
All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law.

Apply for this Job

* Required

  
  
When autocomplete results are available use up and down arrows to review
+ Add Another Education


U.S. Equal Opportunity Employment Information (Completion is voluntary)

Individuals seeking employment at Novetta are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.

Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.


Form CC-305

OMB Control Number 1250-0005

Expires 05/31/2023

Voluntary Self-Identification of Disability

Why are you being asked to complete this form?

We are a federal contractor or subcontractor required by law to provide equal employment opportunity to qualified people with disabilities. We are also required to measure our progress toward having at least 7% of our workforce be individuals with disabilities. To do this, we must ask applicants and employees if they have a disability or have ever had a disability. Because a person may become disabled at any time, we ask all of our employees to update their information at least every five years.

Identifying yourself as an individual with a disability is voluntary, and we hope that you will choose to do so. Your answer will be maintained confidentially and not be seen by selecting officials or anyone else involved in making personnel decisions. Completing the form will not negatively impact you in any way, regardless of whether you have self-identified in the past. For more information about this form or the equal employment obligations of federal contractors under Section 503 of the Rehabilitation Act, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Disabilities include, but are not limited to:

  • Autism
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, or HIV/AIDS
  • Blind or low vision
  • Cancer
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or hard of hearing
  • Depression or anxiety
  • Diabetes
  • Epilepsy
  • Gastrointestinal disorders, for example, Crohn's Disease, or irritable bowel syndrome
  • Intellectual disability
  • Missing limbs or partially missing limbs
  • Nervous system condition for example, migraine headaches, Parkinson’s disease, or Multiple sclerosis (MS)
  • Psychiatric condition, for example, bipolar disorder, schizophrenia, PTSD, or major depression

1Section 503 of the Rehabilitation Act of 1973, as amended. For more information about this form or the equal employment obligations of Federal contractors, visit the U.S. Department of Labor's Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.