Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts

Nor Azizah Ahmad, Sulfeeza Mohd Drus, Hairoladenan Kasim, Mohd Muneer Othman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Content validity is the process to validate the measurement items from the perspective of experts. Notably, there are lack of validated items measuring the perception of intention to adopt Enterprise Architecture (EA) in the public sector organisations. This study intended to develop and assess the content validity of measurement items for EAAQ as a survey instrument to public sector organisations. Twelve academic and industrial content experts have assessed the validity of 14 identified constructs and 52 measurement items. This study was conducted through two cycles of content validation process. The written EAAQ was distributed via email or by a meeting session with the content experts for assessing the measurement items. The analysis of content experts' consensus was examined using a quantitative approach called Content Validity Ratio (CVR) and Content Validity Index (CVI). Of the 52 items, 50 were accepted, as the CVR's critical value that must be abided by 0.75 (N = 8) and two items were rejected. Then, the accepted items were computed to a final form using CVI. The acceptable CVI value for the final EAAQ is 0.94. Therefore, a new 50-item EAAQ was developed based on validated content and face values by the experts for public sector organisations. In future, the measurement items should be reassessed on its psychometric properties for the EAAQ reliability and internal consistency. This instrument would be useful for measuring the perception of EA adoption in organisations.

Original languageEnglish
Title of host publicationISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages160-165
Number of pages6
ISBN (Electronic)9781538685464
DOIs
Publication statusPublished - 01 Apr 2019
Event9th IEEE Symposium on Computer Applications and Industrial Electronics, ISCAIE 2019 - Kota Kinabalu, Malaysia
Duration: 27 Apr 201928 Apr 2019

Publication series

NameISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics

Conference

Conference9th IEEE Symposium on Computer Applications and Industrial Electronics, ISCAIE 2019
CountryMalaysia
CityKota Kinabalu
Period27/04/1928/04/19

Fingerprint

Industry
Electronic mail

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Energy Engineering and Power Technology
  • Electrical and Electronic Engineering
  • Industrial and Manufacturing Engineering

Cite this

Ahmad, N. A., Mohd Drus, S., Kasim, H., & Othman, M. M. (2019). Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts. In ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics (pp. 160-165). [8743918] (ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISCAIE.2019.8743918
Ahmad, Nor Azizah ; Mohd Drus, Sulfeeza ; Kasim, Hairoladenan ; Othman, Mohd Muneer. / Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts. ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 160-165 (ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics).
@inproceedings{514f274ad05e46508aa289c278c525ee,
title = "Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts",
abstract = "Content validity is the process to validate the measurement items from the perspective of experts. Notably, there are lack of validated items measuring the perception of intention to adopt Enterprise Architecture (EA) in the public sector organisations. This study intended to develop and assess the content validity of measurement items for EAAQ as a survey instrument to public sector organisations. Twelve academic and industrial content experts have assessed the validity of 14 identified constructs and 52 measurement items. This study was conducted through two cycles of content validation process. The written EAAQ was distributed via email or by a meeting session with the content experts for assessing the measurement items. The analysis of content experts' consensus was examined using a quantitative approach called Content Validity Ratio (CVR) and Content Validity Index (CVI). Of the 52 items, 50 were accepted, as the CVR's critical value that must be abided by 0.75 (N = 8) and two items were rejected. Then, the accepted items were computed to a final form using CVI. The acceptable CVI value for the final EAAQ is 0.94. Therefore, a new 50-item EAAQ was developed based on validated content and face values by the experts for public sector organisations. In future, the measurement items should be reassessed on its psychometric properties for the EAAQ reliability and internal consistency. This instrument would be useful for measuring the perception of EA adoption in organisations.",
author = "Ahmad, {Nor Azizah} and {Mohd Drus}, Sulfeeza and Hairoladenan Kasim and Othman, {Mohd Muneer}",
year = "2019",
month = "4",
day = "1",
doi = "10.1109/ISCAIE.2019.8743918",
language = "English",
series = "ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "160--165",
booktitle = "ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics",
address = "United States",

}

Ahmad, NA, Mohd Drus, S, Kasim, H & Othman, MM 2019, Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts. in ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics., 8743918, ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics, Institute of Electrical and Electronics Engineers Inc., pp. 160-165, 9th IEEE Symposium on Computer Applications and Industrial Electronics, ISCAIE 2019, Kota Kinabalu, Malaysia, 27/04/19. https://doi.org/10.1109/ISCAIE.2019.8743918

Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts. / Ahmad, Nor Azizah; Mohd Drus, Sulfeeza; Kasim, Hairoladenan; Othman, Mohd Muneer.

ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics. Institute of Electrical and Electronics Engineers Inc., 2019. p. 160-165 8743918 (ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts

AU - Ahmad, Nor Azizah

AU - Mohd Drus, Sulfeeza

AU - Kasim, Hairoladenan

AU - Othman, Mohd Muneer

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Content validity is the process to validate the measurement items from the perspective of experts. Notably, there are lack of validated items measuring the perception of intention to adopt Enterprise Architecture (EA) in the public sector organisations. This study intended to develop and assess the content validity of measurement items for EAAQ as a survey instrument to public sector organisations. Twelve academic and industrial content experts have assessed the validity of 14 identified constructs and 52 measurement items. This study was conducted through two cycles of content validation process. The written EAAQ was distributed via email or by a meeting session with the content experts for assessing the measurement items. The analysis of content experts' consensus was examined using a quantitative approach called Content Validity Ratio (CVR) and Content Validity Index (CVI). Of the 52 items, 50 were accepted, as the CVR's critical value that must be abided by 0.75 (N = 8) and two items were rejected. Then, the accepted items were computed to a final form using CVI. The acceptable CVI value for the final EAAQ is 0.94. Therefore, a new 50-item EAAQ was developed based on validated content and face values by the experts for public sector organisations. In future, the measurement items should be reassessed on its psychometric properties for the EAAQ reliability and internal consistency. This instrument would be useful for measuring the perception of EA adoption in organisations.

AB - Content validity is the process to validate the measurement items from the perspective of experts. Notably, there are lack of validated items measuring the perception of intention to adopt Enterprise Architecture (EA) in the public sector organisations. This study intended to develop and assess the content validity of measurement items for EAAQ as a survey instrument to public sector organisations. Twelve academic and industrial content experts have assessed the validity of 14 identified constructs and 52 measurement items. This study was conducted through two cycles of content validation process. The written EAAQ was distributed via email or by a meeting session with the content experts for assessing the measurement items. The analysis of content experts' consensus was examined using a quantitative approach called Content Validity Ratio (CVR) and Content Validity Index (CVI). Of the 52 items, 50 were accepted, as the CVR's critical value that must be abided by 0.75 (N = 8) and two items were rejected. Then, the accepted items were computed to a final form using CVI. The acceptable CVI value for the final EAAQ is 0.94. Therefore, a new 50-item EAAQ was developed based on validated content and face values by the experts for public sector organisations. In future, the measurement items should be reassessed on its psychometric properties for the EAAQ reliability and internal consistency. This instrument would be useful for measuring the perception of EA adoption in organisations.

UR - http://www.scopus.com/inward/record.url?scp=85069164596&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069164596&partnerID=8YFLogxK

U2 - 10.1109/ISCAIE.2019.8743918

DO - 10.1109/ISCAIE.2019.8743918

M3 - Conference contribution

T3 - ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics

SP - 160

EP - 165

BT - ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Ahmad NA, Mohd Drus S, Kasim H, Othman MM. Assessing content validity of enterprise architecture adoption questionnaire (EAAQ) among content experts. In ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics. Institute of Electrical and Electronics Engineers Inc. 2019. p. 160-165. 8743918. (ISCAIE 2019 - 2019 IEEE Symposium on Computer Applications and Industrial Electronics). https://doi.org/10.1109/ISCAIE.2019.8743918