System Testing and Evaluation Specialist

Plans, prepares, and executes tests of systems to evaluate results against specifications and requirements as well as analyze/report test results.

Below are the Knowledge, Skills, Abilities and Tasks identified as being required to perform this work role.

Knowledge of computer networking concepts and protocols, and network security methodologies.
Knowledge of risk management processes (e.g., methods for assessing and mitigating risk).
K0003Knowledge of laws, regulations, policies, and ethics as they relate to cybersecurity and privacy.
K0004Knowledge of cybersecurity and privacy principles.
K0005Knowledge of cyber threats and vulnerabilities.
K0006Knowledge of specific operational impacts of cybersecurity lapses.
K0027Knowledge of organization’s enterprise information security architecture.
K0028Knowledge of organization’s evaluation and validation requirements.
K0037Knowledge of Security Assessment and Authorization process.
K0044Knowledge of cybersecurity and privacy principles and organizational requirements (relevant to confidentiality, integrity, availability, authentication, non-repudiation).
K0057Knowledge of network hardware devices and functions.
K0088Knowledge of systems administration concepts.
K0091Knowledge of systems testing and evaluation methods.
K0102Knowledge of the systems engineering process.
K0126Knowledge of Supply Chain Risk Management Practices (NIST SP 800-161)
K0139Knowledge of interpreted and compiled computer languages.
K0169Knowledge of information technology (IT) supply chain security and supply chain risk management policies, requirements, and procedures.
K0170Knowledge of critical infrastructure systems with information communication technology that were designed without system security considerations.
K0179Knowledge of network security architecture concepts including topology, protocols, components, and principles (e.g., application of defense-in-depth).
K0199Knowledge of security architecture concepts and enterprise architecture reference models (e.g., Zachman, Federal Enterprise Architecture [FEA]).
K0203Knowledge of security models (e.g., Bell-LaPadula model, Biba integrity model, Clark-Wilson integrity model).
K0212Knowledge of cybersecurity-enabled software products.
K0250Knowledge of Test & Evaluation processes for learners.
K0260Knowledge of Personally Identifiable Information (PII) data security standards.
K0261Knowledge of Payment Card Industry (PCI) data security standards.
K0262Knowledge of Personal Health Information (PHI) data security standards.
K0287Knowledge of an organization’s information classification program and procedures for information compromise.
K0332Knowledge of network protocols such as TCP/IP, Dynamic Host Configuration, Domain Name System (DNS), and directory services.
S0015Skill in conducting test events.
S0021Skill in designing a data analysis structure (i.e., the types of data a test must generate and how to analyze that data).
S0026Skill in determining an appropriate level of test rigor for a given system.
S0030Skill in developing operations-based testing scenarios.
S0048Skill in systems integration testing.
S0060Skill in writing code in a currently supported programming language (e.g., Java, C++).
S0061Skill in writing test plans.
S0082Skill in evaluating test plans for applicability and completeness.
S0104Skill in conducting Test Readiness Reviews.
S0107Skill in designing and documenting overall program Test & Evaluation strategies.
S0110Skill in identifying Test & Evaluation infrastructure (people, ranges, tools, instrumentation) requirements.
S0112Skill in managing test assets, test resources, and test personnel to ensure effective completion of test events.
S0115Skill in preparing Test & Evaluation reports.
S0117Skill in providing Test & Evaluation resource estimate.
S0367Skill to apply cybersecurity and privacy principles to organizational requirements (relevant to confidentiality, integrity, availability, authentication, non-repudiation).
A0026Ability to analyze test data.
A0030Ability to collect, verify, and validate test data.
A0040Ability to translate data and test results into evaluative conclusions.
A0123Ability to apply cybersecurity and privacy principles to organizational requirements (relevant to confidentiality, integrity, availability, authentication, non-repudiation).
T0058Determine level of assurance of developed capabilities based on test results.
T0080Develop test plans to address specifications and requirements.
T0125Install and maintain network infrastructure device operating system software (e.g., IOS, firmware).
T0143Make recommendations based on test results.
T0257Determine scope, infrastructure, resources, and data sample size to ensure system requirements are adequately demonstrated.
T0274Create auditable evidence of security measures.
T0393Validate specifications and requirements for testability.
T0426Analyze the results of software, hardware, or interoperability testing.
T0511Perform developmental testing on systems under development.
T0512Perform interoperability testing on systems exchanging electronic information with other systems.
T0513Perform operational testing.
T0539Test, evaluate, and verify hardware and/or software to determine compliance with defined specifications and requirements.
T0540Record and manage test data.