Job Description:
Develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions. Activities include the following tasks: Movement of structure and unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. Develop code to format data that supports exploration. Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives. Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models. Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions.
Responsibilities:
- Design and optimize Data Pipelines using Spark, Apache Iceberg, Trino, OpenSearch, Lucene, EMR cloud services, NiFi and Kubernetes containers and the Indexing, ODM and Viking Platform
- Ensure the pedigree and provenance of the data is maintained such that the access to data is protected
- Clean and preprocess data to enable access for advanced analytics
- Collaborate with enterprise working groups to advance the state of data standards
- Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings
- Collaborate with software engineers to update, configure, and maintain data services based on the requirements
- Conduct quarterly analysis and provide recommendations for data tools that support data functions within Viking, Indexing and ODM on the new environment
- Provide support that may include administration and performance tuning of data tools to keep current for continuous RMA efforts
Must haves:
- 4+ years of experience with data engineering
- Experience with data lifecycle engineering and development and maintenance of extract, transform and load (ETL) tools and services
- Experience with Cloud and on-prem data storage and processing solutions
- Experience with data engineering programming (Python, SQL, Spark or similar)
- Experience with COTS and open-source data engineering tools such as ElasticSearch, NiFi or similar
- Experience with Agile / Scrum
Nice to have:
- Bachelors degree
- Experience with Software engineering
Security Clearance:
- Active TS/SCI with polygraph clearance
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Maryland, New York, Washington, and the District of Columbia. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
Los Angeles County Information Only
If you live in or expect to work from Los Angeles County if hired for this position, please review below for important additional information.
Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed in the job posting, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation. Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Requesting An Accommodation