Data Engineer Job at Peraton, Gordon, GA

RkpabnBsNGdWV2ZlSTByRFlNL1ZER0ZvZkE9PQ==
  • Peraton
  • Gordon, GA

Job Description

Program Overview

About The Role

Peraton seeks a Data Engineer to provide technical contributions to Elasticsearch, Apache NiFi, Apache Kafka, Apache Spark, and Python- based Extract, Transform, Load (ETL) data processing pipelines and data quality monitoring using Cyber and Electromagnetic Spectrum (EMS) data. Location:  Fort Gordon, GA

Tasks include:

  • Translate (potentially vague) proposed business processes into corresponding automated data pipelines to ensure the right data is available to supported teams at the right location and format.
  • Create, modify, and automate production-grade ETL pipelines and data monitoring tools like Grafana, Prometheus, or Logstash.
  • Communicate with other data and machine learning engineers about combining compressed, JSON, parquet, database, and data lake-based datasets into a cohesive dataset capable of facilitating business processes.
  • Participate in the software development and deployment using Elasticsearch, Apache NiFi, Apache Kafka, Dask, Prefect, or Pachyderm, Apache Spark, Grafana, Markdown.

Qualifications

Required:

  • Minimum of 8 years with BS/BA; Minimum of 6 years with MS/MA.  Will consider HS + 12 years
  • 5+ years of experience, with a focus on experiences that directly
    relate to deploying and managing Data Science tools in AWS and Azure, and demonstrate practical, hands-on experience with multi-cloud environments 
    • 1+ years of direct technical experience with Apache ecosystem data engineering projects (NiFi, Kafka, Airflow, Spark, Iceberg, etc.)
    • 1+ years of direct technical implementation experience with Python based ETL of JSON, compressed, and columnar datasets

      Experience with Dask, Prefect, Pachyderm, Airflow, or similar Python ecosystem data engineering projects preferred

    • 1+ years of bash or PowerShell scripting

  • Direct technical experience; translating (potentially vague) proposed business processes into corresponding automated data pipelines; direct technical implementation experienced with creating, modifying, and automating production-grade ETL pipelines and data monitoring tools like Grafana, Prometheus, or Logstash.
  • Comfortable with detailed technical communication with other data and machine learning engineers about combining compressed, JSON, parquet, database, and data lake-based datasets into a cohesive dataset capable of facilitating business processes.
  • Expertise in AWS and Azure Platforms. 
    • Must have in-depth knowledge of both AWS and Azure cloud services, with specific skills in implementing and managing services that support DevSecOps workflows, such as container orchestration, serverless computing, and automated deployments.
  • A passion for innovative technology and protecting national defense through responsible software development and deployment
  • Must have experience with the following tools:
    • Elasticsearch
    • Apache NiFi
    • Apache Kafka
    • Apache Spark
    • Dask, Prefect or Pachyderm
    • Grafana
    • Markdown and GitLab Pages based documentation
  • Familiarity with at least one programming language preferred
  • Familiarity with Git preferred
  • Requires a Top Secret//SCI clearance with the ability to obtain a CI Polygraph and MEAD
  • U.S Citizenship Required

Peraton offers enhanced benefits to employees working on this critical National Security program, which include heavily subsidized employee benefits coverage for you and your dependents, 25 days of PTO accrued annually up to a generous PTO cap and eligible to participate in an attractive bonus plan.

SCA / Union / Intern Rate or Range

Details

Target Salary Range: $112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.

EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.

Job Tags

Contract work, Shift work,

Similar Jobs

Jovie of Michigan & Pittsburgh

Math and Science Tutors Needed Job at Jovie of Michigan & Pittsburgh

 ...College Tutorsof Ann Arbor, Canton & Northville, MIis searching for energetic, engaging, and dedicatedMath and Science Tutors.Do you have the ability toengage and connectwith students? Do you want to make a difference in the lives of students? If its your name we... 

Kirby-Smith Machinery, Inc. - Lubbock, TX

Sales and Operations Manager Job at Kirby-Smith Machinery, Inc. - Lubbock, TX

 ...opportunities for talented, energized professionals across the region who want to join our #WeAre1KirbySmith family!Sales and Operations Manager Benefits * Above-Average Industry Pay* Comprehensive Benefits Package (including Medical/Dental/Vision)* 401K Plan... 

Northwest Talent Solutions LLC

Operations Superintendent, Food Manufacturing (Night Shift) Job at Northwest Talent Solutions LLC

 ...Operations Superintendent Night Shift (Food Manufacturing) Location: Millsboro, Delaware Company: Confidential Partnering with Northwest Talent Solutions Schedule: Full-Time | Night Shift Compensation: Competitive Base Salary+ Benefits +... 

WeDriveU

Dispatcher Shuttle Bus Dispatcher Job at WeDriveU

 ...Skills Required and Physical Demands: ~1 yearsof professional experience working in one or more of the following capacities: dispatch call center customer service or hospitality. ~ Extremely detail-oriented and exceptional organizational skills ~ Proficiency in... 

Leidos

Endpoint Device Management Engineer Job at Leidos

Salary: $61,750 - 111,625 per year Requirements: We require a bachelor's degree with a minimum of 4 years of relevant experience or a masters degree with at least 2 years of experience in endpoint device management and Tier 3 end user support. Alternatively, 10 or...