Table 1 An excerpt of the template survey for software architects to check existing value-driven data in RA projects

Is it possible to access to a code quality management tool (e.g., Sonar) used in the RA project? If not, is it possible to install Sonar to take metrics from the source code of the RA?

Would it be possible to estimate the degree of reuse in each of the modules of the RA with respect to the RM? (optional)

Did the RA stakeholders track the time spent on each task in the development of the RA? If so, with which granularity?

Is there data about personnel and time invested in maintaining the RA? If so, with which granularity?

Would it be possible to give an estimate of the additional training time that an application builder needs to use the RA?

Would it be possible to specify a standard hourly rate of performing tasks on the RA?

How many applications are (or will be) based on the RA? Make a list of the applications with a contact person.

Do you have an overview of the development of applications based on the RA? If so, go on. If not, we will contact the person who you indicated in the previous answer.

For which of the above applications is it possible to know which RA modules have been reused and the degree of reuse?

Is additional effort needed to reuse RA modules?

Can you estimate how long it would take to develop RA modules instead of reusing them?

Is it possible to access to a code quality management tool (e.g., Sonar) used for the RA-based applications? If not, is it possible to install Sonar to take metrics from the source code of the applications?

Please, indicate the generic characteristics (e.g., reuse percentage of RA modules, size of applications) of three ideal types of RA-based applications with low, medium and high complexity.

Did the RA stakeholders track the time spent on each task in the development of the RA-based applications? If so, with which granularity?

Is there data about personnel and time invested in maintaining the RA-based applications? If so, with which granularity?

Would it be possible to specify a standard hourly rate of performing tasks on the RA-based applications?

Have you done any comparison between the costs and the benefits between RA-based applications and ad-hoc applications?

Currently, are there indicators or metrics to evaluate the improvement of the quality attributes in the applications because of the RA usage?

In addition to the information discussed above, do you think that there is other available information to evaluate how the RA affects the applications development?

Do you think that other metric, not mentioned above, could be useful to calculate the ROI of building applications based on the RA?

Our economic model to calculate the ROI of an RA is based on the reuse and maintenance of code. Do you think there are other quality attributes or important factors for evaluating an RA?

Before sending the survey, would you like to add any comments that may help to understand the context of your answers?