Biographies Characteristics Analysis

Assessment of scientific and technical effectiveness of research. Assessing the effectiveness of scientific research

Science is the most effective area of ​​investment. In world practice, it is generally accepted that the profit from investment in science is 100-200%, which is much higher than the profit in any industry. In our country, the effectiveness of science is also quite high.

Science costs more and more every year. In this regard, a second problem arises in the economy - reducing the direct costs of research while increasing the effect of their implementation. Therefore, the effectiveness of scientific research also means conducting research as economically as possible. Increasing the efficiency of scientific research in a team can be achieved in various ways: by improving the planning and organization of research; more efficient use of equipment; rational use of funds; material incentives for scientific work; application of scientific organization of labor; improving the psychological climate in the research team, etc.

Various criteria are used to evaluate the effectiveness of research. Basic research produces an effect only after a significant period after the start of research. The results of fundamental research can only be assessed using qualitative criteria:

– the possibility of applying the results in various industries;

– novelty of phenomena, giving impetus for current research;

– contribution to the country’s defense capability;

– priority of domestic science;

– international recognition of works;

– fundamental monographs;

– citation of works, etc.

Applied research is easier to evaluate; in this case, various quantitative criteria are used. In a market economy, the effectiveness of applied scientific and technical developments is assessed by determining scientific, technical, economic and social effects.

For technological developments, the scientific and technical effect is expressed in an increase in the scientific and technical level and in improving the parameters of technology and technology, which follows from the established new patterns, as well as from the developed new technological methods of production.

The scientific and technical effectiveness of the results of applied research is established in conjunction with the assessment of their economic and social effectiveness using indicators of the scientific and technical level (Table 7.1), which is determined by comparable characteristics.

Table 7.1 – Approximate point scale for comparing the scientific and technical level of research and development work and standard values ​​of weight coefficients

Indicators of scientific and technical level Signs of indicators Number of points Indicator importance coefficient
Scientific and technical level Exceeds the world's best analogues 0,3-0,35
World class 7-9
Below the world's best analogues 5-6
Exceeds the best domestic analogues 3-4
Corresponds to the domestic level 1-2
Below domestic level
Promising The most important 0,35-0,4
Important 5-7
Useful 1-3
Potential scope of practical use World market 0,2
Sectors of the national economy 7-8
Industry (region) 3-5
Separate enterprise (association) 1,2
Probability of obtaining positive results Large (significant) 0,1
Moderate (average) 5-6
Small (weak) 1-3

To assess the scientific and technical level of the results of research and development work, several of the most significant technical parameters are selected, in which, first of all, future consumers of technology, products, services, and methods of performing work are interested. In particular, this may be productivity, operational reliability, energy and material consumption, and environmental friendliness indicators. Other parameters (especially technical) must be within the generally accepted level.

The assessment includes several stages:

– determination of the set of necessary regulatory documents reflecting the requirements for new products, especially in the field of ecology and safety, imposed in the countries of possible sale by competing firms;

– determination of the list of technical and technical-economic indicators necessary to assess the scientific and technical level;

– formation of a group of analogues in the world and domestic markets and establishment of the values ​​of their technical and economic indicators;

– for comparison, it is necessary to take (if we are talking about new models of equipment) such analogues, the production of which has just begun, or (if we are talking about technologies and materials) that have been used in the last 2-3 years;

– for each analogue it is necessary to determine the values ​​of the same evaluation indicators;

– comparison of the parameters of new products that will be obtained as a result of research and development work, with the requirements of regulatory documents and parameters of analogues.

The economic effect consists of obtaining economic results from scientific and technical developments both for the country’s economy as a whole and for individual regions, industries, organizations and enterprises that take part in the implementation of technological innovations.

When calculating economic efficiency, various cases are possible depending on the purpose of the calculation, the type of implementation object and the comparison base. In each specific case, it is necessary to be guided by regulatory materials.

The connection between economic indicators and technical parameters of development is established in each specific case during research work, and in the practice of integrated cost calculations for new equipment, the method of regression analysis has found wide popularity. In general, the regression dependence can be written as

Where at– dependent variable (this or that economic indicator);

– vector of independent variables (technical parameters);

– model coefficients.

To establish a relationship with economic efficiency indicators, regulatory methods can also be used to establish the impact of changes in technical parameters on production line costs, for example, wages, electricity costs, material components of costs, etc.

From the point of view of the developer’s organization, the main criterion for economic efficiency is the ratio:

TO e = E/Z, (7.2)

Where E– economic effect of introducing the topic;

Z– costs of implementation and implementation of the topic.

The effectiveness of the work of a team of scientists is assessed by:

– criterion of labor productivity – TO n = WITH 0 / P, Where WITH 0 – estimated cost of research and development work; R– average number of employees of the department;

– the number of implemented topics over a certain period;

– economic effect from the implementation of research and development work;

– the number of patents received;

– the number of licenses sold or foreign exchange earnings.

The effectiveness of a particular researcher is assessed by the number of publications and citations of his works. Economic evaluation of the work of an individual employee is rarely used.

From the point of view of the consumer of scientific products, the main indicator of the effectiveness of research and development work is the economic effect E from the implementation of the development, so we will dwell in detail on the methodology for its calculation.

Calculation of the economic effect from using the results of research and development work has its own characteristics. Since the scientific process can be divided into three stages (selecting a topic, performing research and development work, and introducing it into production), the calculation of economic efficiency is carried out in stages. In accordance with the three stages of research, three types of effectiveness are distinguished: preliminary, expected, actual.

Preliminary economic efficiency is established when drawing up a feasibility study and including the research topic in the plan. It is calculated based on approximate indicators.

The expected economic efficiency is calculated during the research process and is related to a certain period (year) of introducing the product into production. This is a more accurate criterion, although the volume of implementation can only be determined approximately.

Actual economic efficiency is determined after the implementation of scientific developments in production. It is usually calculated based on actual costs and taking into account specific cost indicators. It is usually somewhat lower than expected and is determined at the enterprise where implementation is carried out.

At the level of enterprises using scientific and technical developments, economic results are determined in the form of revenue from the sale of new products manufactured, or products manufactured using new technology, minus funds spent on their own needs. In the process of determining efficiency, the costs include all one-time capital and production costs of all project participants necessary for implementation. At the same time, the calculation of the economic effect is based on the following costs:

Z pr= WITH+ E n · TO, (7.3)

Where WITH– cost;

TO - capital investments;

E n– standard rate of return on capital expenditures.

Expected or actual economic efficiency E calculated by the difference between the reduced costs of the base (old) and new product variant:

E = Z ave. 1 – Z ave. 2 . (7.4)

Given the known probabilities of various project implementation conditions, the mathematical expression for determining the expected economic effect is written in the following form:

Where E i– effect at і -th condition of implementation;

R i– probability of realization of these conditions.

If additional capital investments are required in the process of implementing research and development work, then, in addition, the actual payback period is calculated:

T f . = , (7.6)

Where TO 1 and TO 2 – specific capital investments for the new and old options;

WITH 1 and WITH 2 – cost per unit of production for the new and old options.

To evaluate cost effectiveness, the indicator T f compared with the standard indicator for this industry:

Tn = T f. (7.7)

If inequality is observed, then investment is effective. To take into account the time factor, if in the process of performing and implementing research work there is a need for capital expenditures in different periods, it is necessary to reduce these costs to a comparable form. To do this, use casting dependencies to:

– future period – K b = K t (1 + E n)T; (7.8)

– present period – K t = , (7.9)

Where T– duration of the period;

K b– equivalent costs through T years;

K t- current expenses.

In a market economy, especially during its formation, investing in science is associated with the risk of not obtaining the expected results within the desired time frame. In this regard, in addition to determining economic efficiency, there is a need to quantify the risk of funds invested in scientific development. This is done so that in advance, even before making capital investments, investors, including the enterprise itself planning construction, can have a clear picture of the real prospects for making a profit and return on investment.

Methodological approaches to assessing the economic efficiency of investment projects should provide for ensuring a minimum guaranteed level of profitability of the project, subject to compensation for inflationary changes in the purchasing power of money during the period of time under review and covering the investor’s risk associated with the implementation of the project. This is achieved by using discounting methods.

The process of discounting the cost of a project consists of bringing to a point in time selected as a base (current or specially determined) a cost estimate of the future values ​​of both the investments themselves, distributed over time, and the proceeds (cash flow) from investments from use.

The relationship between the current and future value of an investment project is as follows:

Where SS– modern cost;

BS– future value;

k d– reduction factor (discounting);

t– the time gap between the current moment and the base year of the investment project.

Taking into account discounting, the amount of accumulated net proceeds from the project is determined by the expression:

, (7.11)

Where State of emergency d– net proceeds from the project, distributed over time.

Net proceeds from the project are calculated as the sum of net profit and accrued depreciation:

Where P H– the amount of net profit of the project;

A- depreciation deductions.

The indicator under consideration allows us to calculate the accumulated current profitability of future income, the volume of which partly depends on the loan interest and inflation rates.

Similarly, the present future value of the project can be calculated, where the numerator of the formula represents capital investments distributed over the years of the future period intended to finance the implementation of the development.

In international practice, the recognized indicators characterizing the benefits from the implementation of scientific and technical developments, and which are used to assess the economic efficiency of investment projects, are criteria based on the time value of money:

NPV (Net Present Value) – net (discounted) income (profit);

PI (Profitability Index) – profitability index;

PBP (Payback Period) – period (term) of payback of investments in project implementation;

IRR (Internal Rate of Return) – internal rate of return (profitability).

For example, the difference between the discounted net proceeds from the project and the initial proceeds determines the amount of net present value:

(7.13)

Where NPV– net present value;

FROM– investment costs, including research costs, working capital and production costs (when determining the actual effectiveness of the project).

Net present value compares the investment that needs to be made with the additional profit that it will provide in the future. If the discounted amount of expected future income from investment is greater than the investment costs, then the project can be considered effective, i.e. Only projects that have a positive impact should be invested in NPV. This indicator is most rationally used for ranking innovative proposals and selecting priority projects in terms of their effectiveness.

The net present value ratio (profitability index) is defined as the ratio NPV and the required discounted value of the investment. This ratio allows us to obtain a discounted rate of return (efficiency ratio), calculated by the formula:

ID = NPV / DSI, (7.14)

Where ID– profitability index or, in other words, efficiency coefficient k e;

DSI– discounted (present) value of investment in innovation.

The internal rate of return (IRR) is defined as the estimated discount rate at which the total net present revenues equal the present (discounted) value of the project costs. The GNI indicator is calculated using the formula:

Where P t – net cash flow for the period t, calculated by solving (7.15) with respect to k d to determine the minimum acceptable efficiency standard at which NPV equals 0, or discounted profits equal to investments. This indicator sets the break-even limit for an investment project.

The payback period of investments is defined as the period for compensation initially invested in the development of funds based on the accumulated net real cash flows due to the implementation of the innovative project, i.e. the ratio of the investment amount to discounted income. The indicator of the payback period of funds invested in innovation allows us to obtain information about the level of riskiness of the project in connection with changes in the relative liquidity of investments.

Indicators of economic efficiency (7.13-7.15) of innovative projects take into account the costs and results associated with their implementation, both of a commercial nature and those that go beyond the direct financial interests of project participants, including the effect of sectors of the national economy, social effect and others components of efficiency determined by the non-market activities of subjects implementing scientific and technical developments.

To satisfy the commercial interests of each of the project participants, it is important to assess the financial results of its implementation or commercial efficiency, which is a component of the integral efficiency of sectors of the national economy. The commercial effectiveness of scientific and technical development projects and their use is defined as the ratio of financial costs and results of scientific and technical developments that provide the required rate of return.

Social, environmental and other results that cannot be assessed in monetary terms are taken into account as additional indicators of the efficiency of sectors of the national economy and are taken into account when making decisions about the priority of the project and its government support. However, in most cases, the social consequences of scientific and technical developments are amenable to valuation and are included in the overall results of the project within the limits of its established effectiveness.

The main types of social results are:

– changes in the structure of production personnel and their qualifications, including changes in the number of workers (primarily women) engaged in hazardous types of labor, as well as requiring advanced training;

– improvement in employee health, measured by the level of losses avoided due to social insurance payments or health care costs.

– environmental changes.

The impact of innovation on changes in the working conditions of workers and the environment is assessed in points corresponding to sanitary and hygienic standards or psychological working conditions, as well as standards for the level of environmental pollution. For this purpose, data from sociological surveys, as well as special measurements in the workplace, can be used.

The probabilistic nature of R&D results complicates the assessment of economic efficiency and leads to their step-by-step determination with an increasing degree of accuracy. At the early stages of design work, calculations are predictive in nature and include:

Technical and economic analysis of expected results; - choosing a base for comparison and bringing options to a comparable form; - calculation of pre-production and capital costs in the field of production and operation; - calculation and analysis of economic efficiency indicators.

Annual economic effect and economic efficiency when operating new products.

Methods for calculating the annual economic effect depend on whether the annual productivity of the products differs in the compared options. If their annual productivity is equal (Q H =Q A), the calculation of the annual economic effect is carried out on the basis of the absolute values ​​of capital investments K and operating costs (expenses) I:

If in the new version the annual productivity of the product is higher than in the analogue, then the annual economic effect Eg is calculated on the basis of specific cost values ​​k, u:

where K is the absolute value of capital investments; I is the absolute value of operating costs; k - specific capital investments; u - specific operating costs; E n - rate of return.

When economically assessing a new product, the payback period for additional capital investments and the return on investment (in our case, capital investments) are also calculated (see Section 4.8 of Topic 4).

Investments (capital investments) are made in order to bring a profit greater than the cost of acquiring capital by an entrepreneur or when an investor invests capital in another business or places capital in a bank at interest. Therefore, to analyze new projects related to the need to make a profit, profitability rates corresponding to different types of capital investments are often used. The use of a particular rate of return in calculations completely depends on the entrepreneur and investor, the goals of the company and the specific market situation. However, we can recommend approximate values ​​of E n depending on the types of capital investments mentioned above (Table 6.5).

Table 6.5

Profitability rates depending on the type of investment

Type of investment

Purpose of investment

Profitability rate (%)

Maintaining market position

Improving product quality, updating fixed assets

Introduction of new technologies

Increasing profits, accumulating financial reserves for innovative projects

Risky innovation projects whose outcome is unclear

Estimated profitability(accounting rate of return) of capital investments are estimated by the ratio

Payback period is calculated as the reciprocal of the calculated profitability (accounting rate of return):

The value of the rate of return E n can also be taken equal to the actual return on investment of the best projects in a similar direction, the real interest rate on the capital market or bank interest. The real interest rate is the nominal interest rate expressed in current prices but adjusted for inflation.

The product being developed is economically efficient in operation if the inequality is observed.

Within the limits of compliance with this inequality, it is possible to change the price level of a new product depending on the goals pursued by entrepreneurs (developer and manufacturer).

If the strategy of capital owners is the “cream skimming” strategy, that is, extracting maximum profit during the billing period, then the most likely decision will be to set the maximum price for a new product that the market can withstand (the product will remain competitive and will be successfully sold during the billing period ).

With the strategy of “deep market penetration” (gaining market share), prices can be reduced to the minimum level at which the manufacturer maintains inequality.

If during the operation of a new development (new product) there is an increase in profit and a decrease in the cost of manufactured products or work (in an organization using the new development), the annual economic effect can be calculated using the formula

where P a is the annual profit from the operation of an analog product (machine, device, etc.) available at the enterprise; Q - volume of production (work); Q n - when operating a new product development; Q a - when operating the product development available at the enterprise); Z n, Z a - the cost of manufactured products, respectively, when operating a new product and an analogue product; K - additional capital investments for new product development; E n - rate of return.

When determining the annual economic effect, it is necessary to ensure the comparability of the compared versions of a new product and an analogue product in terms of such indicators as:

The volume of products (work) produced using a new product; - quality parameters; - time factor; - social factors of production and use of products.

Comparability in terms of the volume of products produced using a new product and an analogue product was discussed earlier.

It is also necessary to take into account that the transition from single to serial and mass production significantly reduces the cost per unit of production by reducing the share of semi-fixed costs and increasing the level of mechanization of processes.

The analogue product and the newly developed product must be qualitatively comparable. Depending on the purpose and conditions of its operation, qualitative indicators of comparability can be, for example, reliability, durability, maintainability, power consumption, weight, dimensions, accuracy, speed, degree of automation, etc.

If an analogue product does not provide the performance of any function that is present in the new product, then it should be provided with additional means necessary to bring this indicator to the level of the new product.

In designed products, there may be several indicators that must be taken into account when determining the overall quality indicator. Usually, the relative importance of each indicator in the overall characteristics of a new development is determined. They are then assessed using a point system (for example, ten points). The scoring is carried out by experts (Table 6.6).

The integral indicator (coefficient) of quality (K and) of a new product is determined by the formula

where n is the number of product parameters; a i is the weighting coefficient of the importance of the i-th parameter; b iн, b ia - the values ​​of this parameter, respectively, of a new product and an analogue product, assessed by experts in points.

Calculation of the annual economic effect in the production of new products

Annual economic effect in the production (development) of new products E g

where P h is profit from the sale of new products after paying taxes and interest on loans; K - capital investments.

In the case when a new product is introduced to replace an analogue product,

where is, respectively, the economic effect in the production of a new product and an analogue product.

If capital investments are associated with the introduction of fixed assets, depreciation charges (A g) can be taken into account when calculating the annual economic effect, then

In this case, the annual profitability of capital investments for the development of new products is estimated by the ratio

The criterion for making a decision on the development of new products in production is

where and are, respectively, the payback period of investments: calculated and standard.

The indicator of economic effect from the production of new products must be a positive value, which means that the return on investment (capital investment) exceeds the standard E n.

When calculating when bringing income and costs to one point in time (t 0), you need to solve the following problem. Find the value at which the integral economic effect for the calculation period (economic life of the investment) Ei would be equal to zero:

where - profit from the sale of new products in the t-th year; - capital investments in the t-th year; T is the number of years of the investment life cycle; J q - discount factor.

This calculation method is discussed in detail in the course “Analysis of Economic Activity”.

Taking into account the time factor when assessing the economic efficiency of research and development work

When performing economic calculations at the stages of research and development, it is necessary to take into account that capital investments, as a rule, are made in the years preceding the start of production of new products from the manufacturer and preceding the start of operation of these systems. Therefore, all indicators of income and costs are considered to be based on one point in time - the first year of the billing period (the start of production or operation of new products). If necessary, such a reduction is made by dividing the indicators of a given year by the discount factor Jq:

where t is the number of years between year t to which this indicator relates and year “0” - the first year of the calculation period.

In economic calculations of indicators after the accounting year, they are brought to the accounting year “0” by multiplying by the discount factor.

Determination of product production costs at the stages of research and development

At the stages of research and development there is still no data on the manufacturing technology of a new product, its labor intensity and material intensity, therefore, determining production costs at these stages presents certain difficulties. At the same time, comprehensive economic analysis in both production and operation is necessary to make decisions about the feasibility of new developments.

Approximate cost calculations in these cases are carried out by establishing analogies between the product being created and the previously created one based on an analysis of its parameters, elements and functions. Most often, the cost is calculated using one of the following methods:

According to specific indicators; - according to specific weight costs; - points; - correlation; - standard calculation.

Specific indicator method

When calculating using this method, it is assumed that costs change in proportion to changes in the defining parameter of the product (for example, power consumption, productivity, speed, etc.).

Usually such indicators as the cost per unit of weight, the cost per unit of power, speed, the cost of one function, etc. are used.

The specific cost of the selected parameter is determined in aggregate on the basis of statistical data of the analogue product.

The cost price of a new product Zn is defined as the product of the unit cost Zp by the value of the main parameter of the new product X n:

Calculations of this type can be clarified using differentiated specific indicators, such as the cost of materials Z m.sp and labor intensity tsp per unit of the main parameter. Then

where C t is the hourly wage rate of a piece worker (or the hourly rate of a time worker); - coefficients taking into account shop, factory and non-production costs, respectively.

Unit weight cost method

This method is based on calculating one of the items for calculating the cost of a new product in a direct way, for example, the costs of basic materials and components, and determining the cost of a new product, based on the assumption that the share of this item in the cost structure of the new product will be equal to the share of this item in the cost structure of an analogue product:

Point method

The point method is based on the assessment of the main technical and operational characteristics of products by conditional points, for example, according to a ten-point system.

The scoring procedure is performed using line graphs (Fig. 6.8) or tables (Table 6.6).

Rice. 6.8 Graph of scoring parameters A and B for two types of materials M c and M d (n - new product; a - analogue product)

Table 6.6

Table of scoring parameters X i of a new product (N) and an analogue product (a)

Parameters Xi

Weight coefficient importance a i

New product (N)

Analogue product(s)

Numeric value

Number of points b in

Significance

Numeric value

Number of points

Significance

Parameter X 1

Parameter X 2

Parameter Xn

The points established for each parameter by expert means are summed up for the new product and the analogue product separately.

The cost of a new product Zn is calculated using the formula

where is the value multiplier obtained by dividing the actual cost of the analogue product Za by the sum of points corresponding to its technical characteristics:

where a i is the weighting coefficient of the importance of the i-th product parameter.

The point method is applicable in the early stages of design for approximate cost calculations only if the principle of proportional dependence of costs on parameters is preserved.

Correlation method

The method is based on the correlation between the cost and any parameters of the product.

This relationship can be expressed either as a linear equation

or in the form of a power-law dependence (with a curvilinear form of the correlation field)

When i=1, ..., n,

where Zn is the cost; x i - parameter taken into account; - constants, characterizing the degree of influence of the parameter taken into account on the cost.

Based on statistical data for 3-5 years on the production of analogous products, it is possible to determine trends in changes in cost and, if the results of research work do not radically change the structure and value of cost, determine the coefficients of the equation (by the least squares method).

So, for example, the equation for the relationship between the cost of Z n (for a group of semiconductor devices) with the labor intensity of manufacturing tpcs, the yield coefficient K v.g, the production volume Q and the year of manufacture T has the following form:

The process of establishing correlation dependencies is very labor-intensive and requires the selection of large statistical material on analogous products, but the accuracy of determining the cost of expenses in the early stages of design increases.

Standard calculation method

The standard costing method (see Topic 4, Section 4.3) is the most accurate method for determining the cost of products, but the lack of reliable standard data on actual production costs makes it impossible in the early stages of design.

Method of average cost of functional elements

The method is based on the limited set of functional elements in the manufacture of a product and is used mainly in instrument making. The average cost of some classes of functional elements varies slightly. The average costs of phase detectors, modulators, UPT triggers and other elements are almost the same for all radio equipment. This allows you to determine the cost of a product (device) by summing the costs of functional elements taking into account their class:

where n is the number of different classes in a given device; N i - number of elements of one class; S i - average cost of a functional element; Z sb - costs for general layout and adjustment.

The values ​​of n and N i are most often known or can be determined at the preliminary design stage. The average cost of a functional element is determined by dividing the cost of a block of the same i-th class of an analogue device by the number of functional elements in the device. The costs associated with the general layout, setup and adjustment of the device are determined by any known methods for determining cost. The total error in the deviation of the actual cost from the calculated one is no more than 10%, which is quite acceptable for economic calculations at the early stages of design.

Taking into account price changes when determining costs (cost indexation)

To determine the general level of increase in costs, it is necessary to determine private indices of price changes for individual components and take into account the share of these costs in total costs. The summary index of changes in cost I can be determined by the formula

where n is the number of individual components; - the share of material, labor costs and (or) costs of selling products and other costs; - index of changes in prices for materials, consumer prices, average wages, prices for selling products, etc.

When determining changes in cost, it is advisable to take into account only the main cost items, that is, those costs that are directly related to ensuring product output.

Calculation and comparison of capital investments for new products of compared options

The calculation of consumer capital investments was given earlier (Section 4.5 of Topic 4).

Calculation and comparison of specific capital investments

In cases where the annual productivity of new products (for example, devices) in the compared options is not the same, it is necessary to compare not absolute, but specific values ​​of capital investments:

where k - specific capital investments in the new (k n) and previous (k a) version; K is the absolute value of capital investments in the new (K n) and previous (K a) options; Q - annual productivity of the product (Q n - new; Q a - analogue).

The result of research is the achievement of a scientific, scientific-technical, economic or social effect. The scientific effect characterizes the acquisition of new scientific knowledge and reflects the increase in information intended for internal scientific consumption. The scientific and technical effect characterizes the possibility of using the results of ongoing research in other research or development work and ensures the receipt of information necessary for the creation of new technology. The economic effect is characterized by the value expressed in terms of living and embodied labor in social production, obtained by using the results of applied research. The social effect is manifested in improved working conditions, increased environmental performance, development of healthcare, culture, science, education and so on.

The assessment of the social effect of research work should be made on the basis of a long-term forecast.

When performing technical and economic calculations in this section, a quantitative assessment can be made, or a qualitative analysis can be carried out. It is advisable to make a quantitative assessment of the scientific effect by calculating scientific effectiveness, scientific and technical effect - scientific and technical effectiveness. A qualitative analysis of possible types of research effects consists of comparing the advantages and disadvantages of the results obtained based on assessments of “higher-lower,” “better-worse,” “more-less,” and so on.

Assessment of scientific and scientific-technical effectiveness is carried out using coefficients calculated using the formulas:

Significance coefficient of the i-th factor used for evaluation;

Coefficient of the achieved level of the i -th factor;

n, m - number of factors.

The following factors can be taken into account when assessing scientific productivity: the novelty of the obtained or expected results; depth of scientific study; degree of probability of success (if the work is not completed). The following factors can be used when assessing scientific and technical effectiveness: prospects for use; scale of implementation; completeness of the results obtained. For each factor, the numerical value of the significance coefficient is established by expert means. In this case, the sum of the significance coefficients for all factors should be equal to one. The coefficient of the achieved factor level is also established by expert means, and its numerical value is determined taking into account the quality of the factor attribute and its characteristics. In this case, the value k j - i 1. The maximum possible value of kn.r. and kn.t.r is equal to unity. The closer the value of kn.r. and kn.t.r to one, the higher the scientific and scientific-technical effectiveness of the ongoing research work. Factors influencing the quantitative assessment of scientific and scientific-technical productivity are summarized in Tables 7.10 and 7.11.

Table 7.10

Scientific productivity factor

Factor significance coefficient

Quality factor

Characteristic

Achieved level coefficient

Novelty of the results obtained

Some patterns have been established that make it possible to create fundamentally new types of technology

Depth of scientific study

The complexity of theoretical calculations is low, the results are verified on a limited number of experiments

Probability of success

Success is very possible, there is a high probability of a positive solution to the assigned tasks

Table 7.11

Characteristics of factors and signs of scientific productivity of ongoing research work

We obtain the coefficients of scientific productivity factors:

Novelty of the expected results k zn1 =0.5, k dn1 =0.7;

Depth of scientific study k zn2 = 0.35, k dn2 = 0.6;

Degree of success probability k zn3 = 0.15, k dn3 = 1.0;

As a result, the scientific productivity coefficient:

k n.r. = 0.5·0.7+0.35·0.6+0.15·1.0 =0.71;

Coefficients of factors of scientific productivity:

Prospects for using the results k ntr1 =0.5, k d.u1 =0.8

The scale of possible implementation of the results k ntr2 = 0.3, k d.y2 = 0.8

Completeness of the results obtained k ntr3 = 0.2, k d.u3 = 0.6

As a result, the coefficient of scientific and technical effectiveness:

k n.t.r = 0.5 0.8+0.3 0.8+0.2 0.6 = 0.76

Some social results achieved on the basis of research and development work can be quantified in the appropriate units adopted to measure this result. These results include: cleanliness of the atmosphere in a populated area and industrial zone, cleanliness of air in a production area; characteristics of industrial waste; noise level, lighting and so on. The magnitude of the social result in these cases is determined by the change in the quantitative characteristics achieved on the basis of research work.

The social effect of this research and development work includes the absence of environmental pollution, simplicity and ease of use. When implementing the results of research aimed at solving social problems, along with the main social result, an accompanying economic effect is often achieved - an increase in labor productivity, saving labor resources.

conclusions

As a result of the research, we can conclude that further implementation of the designed milling cutter into production will significantly reduce energy costs for milling coatings, and we will obtain a road milling machine with higher productivity, low unit costs and capital investments. Increased productivity reduces the toxicity of milling, working time is used more efficiently, and the level of environmental pollution is reduced. Based on the technical and economic indicators of the cutter, we can safely say that the equipment being developed not only can, but should also be implemented in public utilities.

The result of research is the achievement of scientific, scientific-technical, economic, and social effects.

Scientific effect characterizes the acquisition of new scientific knowledge and reflects the increase in information intended for intrascientific consumption. Scientific and technical effect characterizes the possibility of using the results of ongoing research in other research or development work and provides the information necessary to create new technology. Economic effect characterized by savings in living and embodied labor expressed in cost terms in social production, obtained by using the results of applied research. Social effect manifests itself in improving working conditions, increasing environmental performance, developing healthcare, culture, science, education, etc.

Quantitative assessment scientific effect it is advisable to carry out by calculating the coefficients of scientific and scientific-technical effectiveness. A qualitative analysis of possible types of research effects consists of comparing the advantages and disadvantages of the results obtained in the form of “higher - lower”, “better - worse”, “more - less”.

The assessment of the scientific and scientific-technical effectiveness of theoretical research is carried out using coefficients calculated using the formulas:

Knr = ∑ m Kzni * Kdui (3.1)

Cntr = ∑ n Kzni * Kdui (3.2)

where Knr, Kntr are the coefficients of scientific and scientific-technical effectiveness, respectively;

Kzni – significance coefficient of the i-th factor used for assessment;

Kdui – coefficient of the achieved level of the i-th factor;

m and n – respectively, the number of factors of scientific and scientific-technical effectiveness.

The novelty of the results obtained, the depth of scientific elaboration, the degree of probability of success, etc. can be taken as factors when assessing scientific productivity; when assessing scientific and technical effectiveness - the prospects for use, the scale of implementation, the completeness of the results obtained, etc. (Tables 3.1 and 3.2 ).



Table 3.1 – Characteristics of factors and signs of scientific productivity of research work

Scientific productivity factor Factor significance coefficient, KZN Quality factor of scientific novelty Characteristics of the factor
Novelty of the obtained or expected results 0,5 Novelty high Fundamentally new results were obtained, previously unknown to science, a new technology was created, a new pattern was discovered 1,0
Novelty average Some general patterns, methods, and methods have been established that make it possible to create fundamentally new types of technology 0,7
Novelty is insufficient Positive solutions to assigned tasks based on simple messages, analysis of connections between facts. Extension of unknown scientific principles to scientific objects 0,3
The novelty is trivial Description of individual elementary facts, transfer and dissemination of previously obtained results, abstract reviews 0,1
Depth of scientific study 0,35 The depth of scientific research is high Complex theoretical calculations were performed, the results were verified on a large amount of experimental data 1,0
Depth of scientific research is average The complexity of theoretical calculations is not high; results are verified on a limited amount of experimental data 0,6
The depth of scientific research is insufficient Theoretical calculations are simple, no experimental verification has been carried out 0,1
Probability of success 0,15 The probability of success is high Success is very possible, there is a high probability of a positive solution to the assigned tasks 1,0
Success rate is moderate The tasks set are theoretically and technically feasible, success is possible 0,6
The probability of success is low Theoretically feasible, but the idea is risky, success is highly doubtful 0,1

For each of the factors, the values ​​of the significance coefficients and the achieved level for this factor are established by expert means. The sum of the significance coefficients must be equal to 1.0. The coefficients of the achieved level of each factor are less than 1.0, and the closer they are to 1.0, the higher the scientific and scientific-technical productivity of research work.

Table 3.2 – Characteristics of factors and signs of scientific and technical effectiveness of the diploma project

Factor of scientific and technical effectiveness Factor significance coefficient, KZN Quality factor Characteristics of the factor Achieved level coefficient, Kdu
Prospects for using the results 0,5 Primary importance The results can be used in many scientific areas and are important for the development of related sciences 1,0
Important The results will be used in a specific scientific direction in the development of new technical solutions aimed at significantly increasing the productivity of social labor in the national economy 0,8
Useful The results will be used in a specific sector of the national economy 0,5
Scope of possible implementation of results 0,3 National economic scale 0.5 0.6 0.8 1.0
Industry scale Implementation time, years: Up to 3 up to 5 up to 10 over 10 0.8 0.7 0.5 0.3
Individual organizations and enterprises Implementation time, years: Up to 3 up to 5 up to 10 over 10 0,4 0,3 0,2 0,1
Completeness of the results obtained 0,2 Completeness is high Methodology instructions, guidelines, classifier, standards 1,0
Completion is average Technical specifications for applied research or development work 0,8
Sufficient completeness Recommendations, detailed analysis, suggestions 0,6
Completeness is insufficient Review, information collection 0,4

In the case of assessing the effectiveness of applied research, if there is a basis for comparison, the calculation is based on a comparison of the achieved technical parameters with the basic ones.

The coefficient of scientific and technical productivity is determined in this case by the formula:

Cntr = ∑Kvli * Kppi (3.3)

where n is the number of parameters used for evaluation;

Kvli – coefficient of influence of the i-th parameter on scientific and technical productivity;

Kppi – relative coefficient of increase of the i-th parameter.

The relative coefficient of increase in parameters is determined by the formula:

Kppi = Wdi / Wbi (3.4)

where Wдi is the value of the achieved parameter;

Wbi – value of the basic parameter.

The coefficients are determined by experts, the assessment is carried out in table. 3.3.

Table 3.3 – Characteristics of factors and signs of scientific and technical effectiveness of research work

Along with the assessment of scientific and technical effectiveness, for applied research projects, calculations of economic efficiency are carried out, taking into account the features of research work, first of all, that research work is the initial stage of creating new technology, therefore calculations of expected economic efficiency are probabilistic, predictive in nature. Essentially, this is an economic potential that can be realized in the future as commercial results of innovations are obtained.

The assessment of the social effect of research work is also predictive in nature; social results may include: increasing the level of safety precautions, eliminating heavy physical labor, improving working conditions, eliminating industrial injuries and occupational diseases, reducing air pollution in production premises, reducing harmful emissions into the external environment, noise level, etc.

Research planning

Approximate stages of research work and their relationship to each other in terms of volume and execution time are given in Table. 4.1.

Table 4.1 – Approximate stages of the research plan

Stages Ud. weight of each stage in the total amount of work, % Contents of work
1. Preparatory stage Selection and study of scientific and technical literature and other materials, generalization of experience, analysis of the state of the issue, preparation, coordination and approval of T3 and a work schedule on the topic.
2. Theoretical development of the topic Development of schemes and theoretical justifications, preparation of calculations and projects, search for new materials and production methods, systematization of theoretical developments.
3. Design and manufacture of mock-ups and testing equipment Development and production of mock-ups, stands, installations, equipment and other testing equipment, their installation and debugging
4. Experimental work and tests Conducting experimental work, laboratory tests on theoretical developments.
5. Refinement and adjustment of the theoretical development of the topic based on test results Making corrections to developed schemes, calculations and projects based on the results of tests.
6. Generalizations, conclusions and suggestions on the topic, technical report, final stage. Summarizing the results of the work and determining the feasibility of further continuation of work in the main direction of the topic. Drawing up a technical report defining economic efficiency. Registration and approval of research results.

Carrying out research usually includes a large number of works at the specified stages, which must be linked to each other in a certain sequence in terms of timing, resources and information flows. In order to achieve such coordination of the entire complex of research work, it is recommended to use network planning and management methods.

The first stage of developing a network model is to determine the types of work and the time spent on carrying out this work, as well as determining the number of participants in the work and their qualifications.

The methodology for developing a network model and examples of using network planning models for research are given in the appendix.

10. Organization and procedure for carrying out research work

10.3. Methods for assessing the scientific and technical effectiveness of research work

The result of research is the achievement of scientific, scientific-technical, economic and social effects. The scientific effect is characterized by the acquisition of new scientific knowledge and reflects the increase in information intended for “internal scientific” consumption. The scientific and technical effect characterizes the possibility of using the results of ongoing research in other research and development projects and provides the information necessary to create new products. The economic effect characterizes the commercial effect obtained from using the results of applied research. The social effect is manifested in improved working conditions, increased economic characteristics, development of culture, healthcare, science, and education. Scientific activity is multifaceted. Its results, as a rule, can be used in many areas of the economy for a long time.

The scientific and scientific-technical effectiveness of research work is assessed using a weighted scoring system. For fundamental research work, only the scientific productivity coefficient is calculated (Table 10.3), and for exploratory work, the scientific and technical productivity coefficient is also calculated (Table 10.4). Estimates of coefficients can only be established on the basis of the experience and knowledge of scientific workers, who are used as experts. The assessment of the scientific and technical effectiveness of applied research is carried out on the basis of a comparison of the technical parameters achieved as a result of the research with the basic ones (which could have been implemented before the research was carried out).

Table 10.3

Characteristics of factors and signs of scientific research productivity

Scientific productivity factor

Coef. factor significance

Quality factor

Characteristics of the factor

Coef. reached level

Novelty of the results obtained

Fundamentally new results, a new theory, the discovery of a new pattern

Some general principles, methods, methods that allow you to create fundamentally new products

Insufficient

Positive decision based on simple generalizations, analysis of relationships between factors, extension of known principles to new objects

Trivial

Description of individual factors, dissemination of previously obtained results, abstract reviews

Depth of scientific study

Performing complex theoretical calculations, testing on a large volume of experimental data

Low complexity of calculations, verification on a small amount of experimental data

Insufficient

Theoretical calculations are simple, no experiment has been carried out

Probability of success

Moderate

Table 10.4

Characteristics of factors and signs of scientific and technical effectiveness of research work

Factor of scientific and technical effectiveness

Coef. significance of the factor

Quality factor

Characteristics of the factor

Coef. reached level

Prospects for using the results

Primary

The results can find application in many scientific fields

The results will be used to develop new technical solutions

Useful

The results will be used in subsequent research and development

Scale of implementation of results

National economy

Implementation time:

over 10 years

Implementation time:

over 10 years

Individual firms and enterprises

Implementation time:

over 10 years

Completeness of results

Technical specifications for R&D

Insufficient

Review, information

In this case, the coefficient of scientific and technical productivity is determined by the formula

where k is the number of parameters being estimated; - coefficient of influence of the i-th parameter on scientific and technical performance; - coefficient of relative increase in the i-th parameter compared to the base value.

For ease of calculations, the data are summarized in table. 10.5.

Table 10.5

Assessment of scientific and technical effectiveness of applied research

Parameter

Unit

Parameter values

achieved

Previous