Methodology of Transparency Ranking of Ukrainian Universities 2016

Authors of the research aim to bring public attention to the communication issue of Ukrainian universities’ with entrants and students, as well as to encourage HEIs to implement more effective and transparent information policy, in particular on their official websites.

Target audience of this study consists of university representatives (first of all administration), journalists, entrants, and their parents.

Diversity. We are fully aware of universities’ diversity and we support uniqueness of their information policy. Simultaneously, the diversity of chosen universities does not influence transparency requirements for their activities. It is worth noting that Ranking does not include institutions under the regulation of security government agencies because of the specific mode of access to the information about them.

Sources of information. Ranking uses websites of HEIs as the main source of information and evaluates the fact of presence or absence of certain information on them. The fact of satisfaction or unsatisfaction of public information request was also considered as source of information.

Monitoring has covered all state and public HEIs, except for those that are on the occupied territories and have not been moved to secure territory, as well as those of security bodies mentioned above. The monitoring also did not include branches campuses of universities (campuses in other cities).

In total 186 HEIs are represented in Ranking.

Ranking is based on 6 indicators:

Financial transparency (10 points) Administrative transparency (24 points) Presence of a strategic development plan (10 points) Information on HEI’s website about the content of a study program (40 points) Information on HEI’s website on employment opportunities (8 points) Information on HEI’s website about academic mobility programs (8 points)

Indicators are divided into 45 parameters. For fulfillment of each universities received certain points.

Financial transparency (10%)

Results

The indicator mainly demonstrates to which extent universities meet certain requirements of Act on Higher Education and Act on Access to Public Information about the publication of their financial documents in open access or on demand.

Information that should be present on HEI’s website:

The monitoring for this indicator was conducted during January, 2016. If university’s website contained mentioned information, HEI was given corresponding points.

Administrative transparency (24%)

Results

The indicator demonstrates to which extent universities meet the requirements of Act on Higher Education about the access to theses, main regulatory documents of HEIs, information about their governing bodies, as well as to which extent universities comply with transparency in their personnel policy, in particular when announcing vacancies.

Information that should be present on HEI’s website:

The monitoring of websites for this indicator was conducted from January till April of 2016. If during this period the mentioned information was found on HEI’s website, the university received corresponding points.

Points for vacancy announcement depended on whether HEIs responded on CEDOS’ request about their presence. If a university did not have any vacancies during stated period, it received a maximum possible score with adjustment factor of ratio between total scored points and maximum possible points for all other parameters (except for the presence of theses, theses’ abstracts and reviews). If the university did not satisfy the request and the announcements were not placed on website – the HEI received 0 points for the parameter.

The amount of published documents was taken into account during the monitoring of presence on websites of theses, theses’ abstracts and reviews in e-versions. Each maximum point we divided in accordance with the number of theses, theses’ abstracts and reviews that should have been placed on HEI’s website. For example, if 4 theses were supposed to be published in e-version on university’s website, the presence of each of them would grant the HEI: 4 maximum points/4 theses=1 point.

If HEI did not have rights to hold theses defense or during December 2015 – April 2016 the specialized academic councils did not conduct any defenses, the maximum 8 points with adjustment factor were assigned for the publication of theses, theses’ abstracts and reviews. The points were given with adjustment factor of ratio between scored points and maximum possible points for the indicator Administrative transparency.

Presence of a strategic development plan (10%)

Results

The indicator demonstrates whether the university conducts strategic planning and illustrates the presence of main components in a strategy.

Coverage of such topics in a strategic development plan:

The presence of following components in a strategic plan:

The monitoring of HEIs’ websites for this indicator was conducted during February 2016. If university’s website contained mentioned information, HEI was given corresponding points. The score also depended on whether the published strategic plan was relevant for 2016.

Information on HEI’s website about the content of a study program (40%)

Results

The indicator demonstrates to which extent universities use their websites to inform about the content of their study programs, teachers capacity and evaluation system.

Information that should be present on HEI’s website:

The monitoring of HEI’s websites for this indicator have been conducted during February to June 2016. If during this period the mentioned information was found on HEI’s website, the university received corresponding points.

The monitoring covered full time undergraduate programs, an exception was National Academy of Management, Diplomatic Academy of Ukraine (postgraduate programs). 14 medical institutions were excluded from monitoring due to the specificity of their structure.

Evaluation of programs’ descriptions was carried out for each department/program. First the maximum score for each parameter was divided by the number of departments (sometimes - of programs) at each faculty. The result was multiplied by the number of departments (programs) that have fulfilled the parameter that is evaluated. The same procedure was repeated for each parameter.

Afterwards all points gained by the faculty were summed up. Then scores of each faculty were added and divided by the number of faculties.

The same principle was applied to calculate points for parameters on information about internships (practicums). However, there was a difference: the maximum score for parameter was reduced if the information was published for the entire faculty or university.

If websites of art institutions missed information about internships (practicums), they received a maximum possible score with adjustment factor of ratio between total scored points and maximum possible points for parameter on description of a study program.

Monitoring also did not include departments of so called obligatory for each program disciplines, and military departments, branch campuses and departments for foreign students (except for English versions of ECTS information packages). The departments which provided obligatory discipline only for one faculty were considered during monitoring.

If university published the monitored information only for the HEI’s intranet (access through login and password), it was not taken into account as interested applicants did not have access to it.

If ECTS information package contained monitored information about study program, it was considered as it was published at faculty’s or department’s page.

Information about internships (practicums) was taken into account only if specific enterprises and institutions for its basis were mentioned.

ECTS information package was taken into account provided that it (or university website) contained at least 60% of the following information:

Information on HEI’s website on employment opportunities (8%)

Results

The indicator demonstrates whether university is ready to assist its students in acquirement of practical skills and further employment.

Information that should be present on HEI’s website:

The monitoring for this indicator was conducted during February, 2016. If university’s website contained mentioned information, HEI was given corresponding points.

Information on HEI’s website about academic mobility programs (8%)

Results

The indicator illustrates to which extent university assists its students in academic mobility.

Information that should be present on HEI’s website:

Матеріал є об'єктом інтелектуальної власності.
Копіювання та поширення дозволяється тільки зі згадкою першоджерела не нижче другого абзацу, без зміни змісту публікації, видалення авторства та логотипу CEDOS
Детальніше Сховати