Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Introduction

...

Further, our solution is the unique in the market able to calculate COCOMO III automatically. 

...

Quality Reviewer-Effort Estimation computes two different BackFired Function Point based on QSM and SRM methods. While SRM (developed by Capers Jones, Namcook Analytics ltd) is a traditional Back Firing method based on a single coefficient per programming language (last updated: 2014), the QSM Function Points Languages Table contains continuously updated function point language gearing factors for 37 distinct programming languages/technologies. Quality Reviewer-Effort Estimation module computes QSM FP using two different coefficients (Low and Average), depending of some configurable project’s attributes like CSM (Code Structure Modularity)  and FC (Flow Complexity).


Image RemovedImage Added

OMG® AUTOMATED FP

Quality Reviewer-Effort Estimation Automated Function Points™ (AFP) capability is an automatic function points counting method based on the rules defined by the International Function Point User Group (IFPUG®) (http://www.ifpug.org/). It automates this manual counting process by using the structural information retrieved by source code analysis (including OMG® recommendation about which files and libraries to exclude), database structure (data definition files), flat files (user maintained data) and transactions.  The Object Management Group (OMG®) Board of Directors has adopted the Automated Function Point (AFP) specification in 2013. The push for adoption was led by the Consortium for IT Software Quality (CISQ®). Automated Function Points demonstrates a 10 X reduction in the cost of manual counted function points, and they aren't estimations; they're counts — consistent from count to count and person to person. Even more importantly, the standard is detailed enough to be automatable; i.e., it can be carried out by a program. This means it's cheap, consistent, and simple to use — a major maturation of the technology.

Image RemovedImage Added


COCOMO - REVIC

...

This process enables comparing an older version of the project to a newer one, as results will measure the time and cost of the delta (change) between the two versions. This Effort estimation option performs a truly differential source code comparison, since analysis is based on a parser, free from the "negative SLOC" problem.

Image RemovedImage Added

Programming Cost per Hour

...

It is a simplified Industry sector and Application Type classification, for compatibility with available Datasets.

Security Reviewer stratifies Project data into homogenous subsets to reduce variation and study the behavioral characteristics of different software application domains.

Stratifying the data by Application Type reduces the variability at each size range and allows for more accurate curve fitting.

IndustryApplication Type
Business

Business Agile

Package Implementation

Government

Web Systems

Business Financial/Insurance

Health Care

IoT/Analytics/Big Data

Retail

ERP/CRM/SRM/SCM/PLM

Energy/Utilities

Command & Control
Scientific/AI
System Software 
TelecommunicationsPackage Implementation
Process Control/Manufacturing
Aerospace/Transportation/Automotive
Microcode/Firmware
Real-time Embedded/Medical

Current Application will be compared with 8000+ validated Software Projects, collected anonymously by country since 2013, and related to Industry sector and Application Type selected.

We recently cut older 5000+ Projects from the repository, collected before 2013, considered outdated. A Blockchain is used for the comparison.

Only Software Projects rated Medium or High confidence are used in our Industry trend lines and research.

Before being added to the repository, incoming Projects are carefully screened. On average, we reject about one third of the Projects screened per update.

Anchor
ManualEstimation
ManualEstimation
Manual Estimation

When neither Source Code nor Binaries are available, the Estimation can be done via a few manual input.

Once chosen the Project's Start and Finish Date, the Estimation can be based on:

Staff Size

Image Modified

Statement Of Work

(Estimation based on Task Of Works-TOW or Milestones.

Image Modified

  • Requirements

Image Modified

Use Cases

Image Modified

Low Code

Our solution provides unique features about Low Code apps Estimation. It supports a large number of Low-code Platforms.

Through input of few parameters, Quality Reviewer-Effort  Estimation is able of Estimate the Low Code App Development:

Image Modified

Different input is required, depending on selected Low Code Platform.

Distribution

After the Manual Input described above, the Estimated size (in Source Lines Of Code-SLOC) can be modulated by choosing a statistical Distribution algorithm:

Image Modified

By default, 3-Points Estimation is adopted. 3-Point Estimation improves accuracy by considering uncertainty arising out of Project Risks

3-Point Estimation is based on 3 different estimated values to improve the result. The concept is applicable for both Cost and Duration Estimation.

3-Point Estimate helps in mitigating the Estimation Risk. It takes into consideration uncertainty and associated risks while estimating values. The estimation can be done for an entire project, or for a WBS component or for an activity

Reporting

Reports are available in PDF, CSV and Word formats, localized in 4 languages

...

Those grids show, for each source file analyzed, the single Quality metrics used during Estimation, in terms of values and time spent:

Image RemovedImage AddedImage Removed

Image Added


The distribution regarding Effort (Time) and Size (Automated FP, QSM FP, SRM FP, SLOC, LLOC), can be viewed graphically. You can isolate Components and/or single Files that are out-of-range.

...

Technical Debt graph, shows all Technical Debt respect than Industry average.

SUPPORT TO STANDARDS

  •  ISO/IEC-12207 Software Implementation and Support Processes - COCOMO III Drivers 1 Appendix A 
  •  ISO/IEC-13053-1 DMAIC methodology and ISO 13053-2 Tools and techniques 
  •  ISO/IEC 14143 [six parts] Information Technology—Software Measurement—Functional Size Measurement
  •  ISO/IEC-18404:2015 - Quantitative methods in process improvement — Six Sigma
  •  ISO/IEC 19761:2011 Software engineering—COSMIC: A Functional Size Measurement Method
  •  ISO/IEC 20926:2009 Software and Systems Engineering—Software Measurement—IFPUG Functional Size Measurement Method
  •  ISO/IEC 20968:2002 Software engineering—Mk II Function Point Analysis—Counting Practices Manual
  •  ISO/IEC 24570:2018 Software engineering — NESMA functional size measurement method
  •  ISO/IEC 29881:2010 Information technology - Systems and software engineering - FiSMA 1.1 functional size measurement method

Anchor
Accuracy
Accuracy
Accuracy

...

Quality Reviewer Effort Estimation results, in order to be validated, have been successfully tested with the following public datasets:

Title/Topic: SiP effort estimation dataset
Donor: Derek M. Jones and Stephen Cullum (derek@knosof.co.ukStephen.Cullum@sipl.co.uk)
Date: June, 24, 2019
Sources:
Creators:
Title/Topic: Software Development Effort Estimation (SDEE) Dataset
Donor: Ritu Kapur (kr@iitrpr.ac.in)
Date: March 3, 2019
Sources:
Creators:
IEEE DataPort Ritu Kapur / Balwinder Sodhi
10.21227/d6qp-2n13
Title/Topic: Avionics and Software Techport Project
Donor: TECHPORT_32947 (hq-techport@mail.nasa.gov)
Date: July 19, 2018
Sources:
Creators:
Title/Topic: Effort Estimation: openeffort
Donor: Robles Gregoris (RoblesGregoris@zenodo.org)
Date: March 11, 2015
Sources:
Creators:
Zenodo
Title/Topic: Effort Estimation: COSMIC
Donor: ISBSG Limited (info@isbsg.org)
Date: November 20, 2012
Sources:
Creators:
Zenodo
Title/Topic: China Effort Estimation Dataset
Donor: Fang Hon Yun (FangHonYun@zenodo.org)
Date: April 25, 2010
Sources:
Creators:
Zenodo
Title/Topic: Effort Estimation: Albrecht (updated)
Donor: Li, Yanfu; Keung, Jacky W. (YanfuLi@zenodo.org)
Date: April 20, 2010
Sources:
Creators:
Zenodo
Title/Topic: Effort Estimation: Maxwell (updated)
Donor: Yanfu Li (YanfuLi@zenodo.org)
Date: March 21, 2009
Sources:
Creators:
Zenodo
Title/Topic: CM1/Software defect prediction
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov.
Title/Topic: JM1/Software defect prediction
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov.
Title/Topic: KC1/Software defect prediction
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov.
Title/Topic: KC2/Software defect prediction
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov.
Title/Topic: PC1/Software defect prediction
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Creators:
NASA, then the NASA Metrics Data Program.
http://mdp.ivv.nasa.gov
Title/Topic: Cocomo81/Software cost estimation
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Boehm's 1981 text, transcribed by Srinivasan and Fisher.
B. Boehm 1981. Software Engineering Economics, Prentice Hall.
Then converted to arff format by Tim Menzies from
Anchor
NASA60
NASA60
Title/Topic:
Cocomo NASA/Software cost estimation (NASA60)
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Latest Version: 1
Last Update: April 4, 2005
Additional Contibutors:
Zhihao Chen (zhihaoch@cse.usc.edu)
Sources:
Creators:
Data from different centers for 60 NASA projects from 1980s and 1990s was collected by Jairus Hihn, JPL, NASA, Manager SQIP Measurement & Benchmarking Element.
Title/Topic: Reuse/Predicting successful reuse
Donor: Tim Menzies (tim@barmag.net)
Date: December 2, 2004
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov.
Title/Topic: DATATRIEVE Transition/Software defect prediction
Donor: Guenther Ruhe (ruhe@ucalgary.ca)
Date: January 15, 2005
Sources:
Creators:
DATATRIEVETM project carried out at Digital Engineering Italy
Title/Topic: Class-level data for KC1 (Defect Count)/Software defect prediction
Donor: A. Günes Koru (gkoru@umbc.edu )
Date: February 21, 2005
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov .
Further processed by A. Günes Koru to create the ARFF file.
Additional Information

Title/Topic: Class-level data for KC1 (Defective or Not)/Software defect prediction
Donor: A. Günes Koru (gkoru@umbc.edu )
Date: February 21, 2005
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov .
Further processed by A. Günes Koru to create the ARFF file.
Title/Topic: Class-level data for KC1 (Top 5% Defect Count Ranking or Not)/Software defect prediction
Donor: A. Günes Koru (gkoru@umbc.edu )
Date: February 21, 2005
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov .
Further processed by A. Günes Koru to create the ARFF file.
Title: Nickle Repository Transaction Data
Donor: Bart Massey (bart@cs.pdx.edu)
Date: March 31, 2005
Sources:
Creators:
Bart Massey after analyzing the publicly available CVS archives of the Nickle programming language
http://nickle.org .
Title: XFree86 Repository Transaction Data
Donor: Bart Massey (bart@cs.pdx.edu)
Date: March 31, 2005
Sources:
Creators:
Bart Massey after analyzing the publicly available CVS archives of the XFree86 Project
http://xfree86.org .
Title: X.org Repository Transaction Data
Donor: Bart Massey (bart@cs.pdx.edu)
Date: March 31, 2005
Sources:
Creators:
Bart Massey after analyzing the publicly available CVS archives of the X.org Project
http://x.org .
Title/Topic: MODIS/Requirements Tracing
Description File: modis.desc
Donor: Jane Hayes (hayes@cs.uky.edu)
Date: March 31, 2005
Sources:
Creators:
Open source MODIS dataset, NASA.
Jane Hayes and Alex Dekhtyar modified the original dataset and created an answerset with the help of analysts.
Title/Topic: CM1/Requirements Tracing
Description File: cm1.desc
Donor: Jane Hayes (hayes@cs.uky.edu)
Date: March 31, 2005
Sources:
Creators:
NASA, then the NASA Metrics Data Program,
http://mdp.ivv.nasa.gov .
Jane Hayes and Alex Dekhtyar modified the original dataset and created an answerset with the help of analysts.

Anchor
DESHAMAIS
DESHAMAIS
Title/Topic: Desharnais Software Cost Estimation (DESHARNAIS)
Donor: Martin Shepperd (Martin.Shepperd@brunel.ac.uk)
Date: September 29, 2005
Sources:

Creators:
Original data was presented in J. M. Desharnais' Masters Thesis. Martin Shepperd created the ARFF file.
Anchor
NASA93
NASA93
Title/Topic:
COCOMO NASA 2 / Software cost estimation (NASA93)
Donor: Tim Menzies (tim@menzies.us)
Date: April 3, 2006
Sources:
Creators:
Data from different centers for 93 NASA projects between years 1971-1987 was collected by Jairus Hihn, JPL, NASA, Manager SQIP Measurement & Benchmarking Element.
Title/Topic: QoS data for numerical computation library
Donor: Jia Zhou (jxz023100 AT utdallas DOT edu)
Date: September 19, 2006
Sources:
Creators:
Jia Zhou

...

Reference                          Instances      Attributes  
Abran and Robillard [-@Abran_TSE96_FP] 21  31
Albrecht-Gaffney [-@AlbrechtG83]      24  7 
Bailey and Basili [-@Bailey81]  18  9 
Belady and Lehman [-@Belady79]  33    
Boehm (aka COCOMO Dataset) [-@Boehm81] 63   43 
China dataset[^1]  499  18 
Desharnais [-@Desharnais88] 61   10 
Dolado [-@Dolado97] 24  7 
Hastings and Sajeev [-@Hastings01]   8  14 
Heiat and Heiat [@Heiat97] 35  4  
Jeffery and Stathis [-@Jeffery_ESE96] 17  7 
Jorgensen [-@Jorgensen04] 47  4 
Jorgensen et al. [-@Jorgensen2003] 20  4 
Kemerer [-@Kemerer87] 15  5 
Kitchenham (Mermaid 2) [-@Kitchenham2002] 30  5 
Kitchenham et al. (CSC) [-@Kitchenham02_CSC] 145  9  
Kitchenham and Taylor (ICL) [-@Kitchenham85] 10  6 
Kitchenham and Taylor (BT System X) [-@Kitchenham85] 10  3 
Kitchenham and Taylor (BT Software Houses) [-@Kitchenham85] 12  6 
Li et al.(USP05) [-@LiRAR07][^2]  202  16 
MiÅ¡ić and Tevsić [-@Misic19981] 6   16 
Maxwell (Dev Effort) [-@Maxwell02] 63  32 
Maxwell (Maintenance Eff) [-@Maxwell02] 67   28 
Miyazaki et al. [-@Miyazaki94] 47  9 
Moser et al. [-@Moser1999] 37  4 
Shepperd and Cartwright [@Shepperd_TSE01] 39  3 
Shepperd and Schofield (Telecom 1) [-@Shepperd97_Analogy]   18  5 
Schofield (real-time 1) [-@Schofield98PhD,@Shepperd97_Analogy]  21  4 
Schofield (Mermaid) [-@Schofield98PhD] 30  18 
Schofield (Finnish) [-@Schofield98PhD] 39  30 
Schofield (Hughes) [-@Schofield98PhD] 33  14
Woodfield et al. [-@Woodfield81]  63  8 

COPYRIGHT (C) 2014-2022 SECURITY REVIEWER SRL. ALL RIGHTS RESERVED