Friday, February 09, 2007

Oxford's Tardis

Walking around Oxford, it is difficult to get a sense of the scale of the collegiate university. This was brought home to me a couple of weeks ago when I visited Worcester College at the invitation of Jane Gover, who amongst her many other roles serves as the College's admissions tutor.

I had walked past the entry to Worcester dozens of times on my way to and from the railway station, and like many Oxford Colleges, the impression that you receive from the front is of a reasonably imposing façade, but no real sense of the size of the operation behind the walls.

It was a very bright and crisp January morning when I reported to the porter's lodge. Jane showed me the main quad, with the medieval cottages that originally formed part of Gloucester College, a training seminary for Benedictine monks (which had occupied the site until the Dissolution of the Monasteries) and the dining hall, libraries and chapel, all of which conformed to my image of the usual Oxford college.I had assumed that we would then be heading indoors for a cup of coffee but she then led me through a short passage, and we emerged into a huge open space. It was at least half an hour later that we concluded the tour, and I felt justified in having the chocolate biscuit I was offered having walked for what seemed like miles.

Worcester College is vast (26 acres in fact) and the grounds include not only a lake, but sports pitches, tennis courts and a multi-gym. The College is engaged on a major building programme, and should be able to provide accommodation for all undergraduate students for the full duration of their degree course. Because of the screening however, a casual passer-by has no idea of any of this, nor can a website, prospectus or leaflet really capture how an individual college is as a place to live and study.

Worcester is not alone in concealing itself behind high walls, and all of the Colleges I have visited to date have much to recommend them that is not immediately obvious when you quickly peek through the gate at the lodge.

So - if you have an intention to apply to the University, a visit would be a very helpful part of the process. Fortunately there are plenty of opportunities to come to Oxford, and the programme of 2007 open days and college and departmental visits has just gone live on the University website. Full details can be found at www.admissions.ox.ac.uk/opendays.

Hope to see you soon!

Friday, December 15, 2006

Making a list, and checking it twice.

So - two weeks in and several thousand interviews later, where are we at with admissions to Oxford for October 2007 entry? To answer this question, I took a trip to one of the Colleges I had visited last week to talk to one of the (many) unsung heroes of the admissions activity, a College Admissions Secretary.

When I arrived (late on Thursday morning) she was in the process of printing out several hundred letters that were due to be sent by first class post on Friday of this week, indicating which candidates had received an offer, and which were unsuccessful. Prior to the start of the print-run, the various subject boards and interview tutors had met to compile a final list of those which they wished to admit. All of the results from the interviews, along with the marks from the tests and practical exercises that the candidates had taken had been fed into the discussion, and in each case a group of those to whom an offer would be made had been identified.

One of the particular facets of the Oxford (and Cambridge) admissions systems is that it is the individual colleges that are responsible for their admissions decisions, not the University.

The University of Oxford is responsible for the award of the degree - the Colleges were established (from 1249 onwards) to provide the tutoring (and also accommodation) to enable students to then take the examinations that led to the award of the University qualification. It is therefore critically important that candidates receive the appropriate letter indicating the decision of the College relating to their individual application.

In this College the letter of admission, which also sets down any conditions that the student still needs to meet to be fully accepted (typically three A-grades at A-level, or equivalent) also includes a great deal of supplementary information.

The Admissions Secretary believed that much of the content (on issues such as when student accommodation would be allocated, costs, and recommended reading lists) would be more likely read by the candidate's parents or guardians, but she felt it important that the initial letter contained as much detailed information as possible, and also set out for candidates the calendar of future contact that would occur between the student and the College up until October 2007. (For example the College organises a weekend visit for the new intake in February 2007 to allow them to meet with existing students and begin the process of familiarising them with the College environment). Every year she reviews all of the information and amends it in the light of the queries that she received from the previous admissions cycle.

Typically one in four of those students who apply each year to Oxford receive an offer of admission. For those who are not successful, they will also receive written confirmation of their situation from the College, usually prior to the end of December. For many applicants (who are usually academically very capable, and have a wide range of interests, often exhibiting significant responsibility in roles that they have within their school, colleges and/or local community) receiving a letter from the University that indicates that they have not obtained an offer can be the first point in their life that they have experienced a significant setback.

To attempt to provide some useful feedback, each candidate's school or college will (where requested) be sent a letter from the College (usually between January and late February) which provides feedback upon the candidate's performance and indentifies their strengths and weaknesses. It is also for this reason that the national admissions system co-ordinated by the Universities' and Colleges' Admissions Service (UCAS) allows an applicant up to five other choices (four additional choices from 2008 entry) to provide alternative options.

The Admissions Secretary was very concerned to ensure that the material was accurate, so two colleagues, including the College's Senior Tutor, were checking each individual letter before they were sealed in the envelope prior to being posted.

By the time you read this, those of you who have applied to Oxford this year may already have learned of the outcome. For anyone applying this year (whether to Oxford or elsewhere) I wish you every success in your future studies.

Mike Nicholson

p.s. I hope that you have found this set of entries to be illuminating, interesting and possibly even entertaining. Those of you who pay particular attention to the time of posting will note that as the weeks have progressed the time that the blog has appeared has got progressively later, as I have struggled to find the time to fit this into my daily routine. For that reason, I feel that it would be difficult for me to continue with a daily blog. It is clear from some your posts that the content, and possibly the perspective that I can bring because of my role at Oxford, has added some value to the activity however, and I therefore intend to have a break for the next few weeks, but return in the New Year with a weekly blog that will pick up either on an Oxford or national admissions topic. Expect the first post of 2007 sometime around the 12th January.

Thursday, December 14, 2006

Practice makes perfect - Physics interviews

Since 2001 the Institute of Physics report that 30% Physics Departments in higher education in the UK have either merged or closed. The University of Reading's recent announcement that it intends to stop recruiting students from October 2007 onwards is the latest in a line of decisions to downscale student admissions in this subject. The reasons why Physics appears to be in decline are many - one of the most commonly voiced arguments is that it is seen as a "difficult" course amongst applicants, who would prefer to take other, less-demanding, disciplines.

The need for applicants to have a strong background in Mathematics also can create difficulties, not least because students with ability and aptitude in Mathematics and Physics have a wealth of additional options available in higher education (e.g. pretty much any branch of engineering, as well as some less well trodden routes such as meteorology, oceanography and sport technology).

Applications to study Physics at Oxford remain buoyant, so partly in response to a posting to the site requesting that the blog also cover more traditional science and/or engineering disciplines, and also to provide a sense of why Oxford may still be attracting strong applicants in what appears to be a diminishing pool, I arranged to attend some Physics interviews.

Unfortunately, because of a last-minute alteration to my diary commitments I had to pass on attending in person, but rather than lose the opportunity I was able to provide an alternate observer from the access and widening participation team to go in my place. Emma at least had the benefit of taking Physics and Mathematics at A-level herself, and the report she provided was therefore more informed than anything that I would have written.

Emma attended seven Physics interviews (all at the same College). Each was conducted by two interviewers, who aimed to provide twenty minutes with each candidate - the candidates all had three interviews in total at the College, focusing on the applicant's ability in Mathematics, in Physics, and their practical and laboratory skills. She found the atmosphere relaxed and congenial, with none of the formality that she had anticipated. With only twenty minutes the interviewers cut straight to the chase; the questions were heavily focused on academic topics - no time was spent on personal statement data indicating a candidate's social or extra-curricular activities. In discussion after the interviews the tutors commented that they found the personal statements frequently concentrated on "popular" areas of Physics such a quantum theory, but when questioned on these issues applicants tended to have a fairly superficial grasp of the subject.

In each case Emma felt that even with her "rusty" recollection of Physics and Mathematics (she studied chemistry at university), the questions were fair and realistic; the questions did not have simple right or wrong answers, but required knowledge and understanding of mathematics, physics and general knowledge to resolve successfully. All of the students were able to answer the questions asked of them, but the tutors provided advice or information to a greater or lesser extent depending on how capable the candidate was in tackling the question. This was not an exercise in intellectual humiliation, but a genuine attempt to identify which candidates had an aptitude and interest in Physics. After the interview the candidate's performance was discussed and the tutors agreed a score using a standardised report form.

At the post-interview selection meeting, which involved all six tutors at the College who had been involved in the Physics interviews, what came across was their strong interest in identifying mathematically capable students. One of the tutors commented that weaknesses in practical experience or physics knowledge could be compensated for through the tutorial, but a strong mathematics foundation was critical to the study of Physics at Oxford.

Candidates who had not studied A-level Further Mathematics were initially at a disadvantage in the opinion of the tutor, but where only A-level Mathematics had been available at the applicant's previous school or college, experience had shown that those candidates who were admitted had a tougher first year than their further mathematics-equipped fellow students, with a slightly heavier workload, but they were frequently more highly motivated than their further-mathematics peers.

The selection process also took into account the candidates' performances in the practical skills interview. The interviewers were concerned that this seems to be an area of decline, with many applicants demonstrating limited first-hand experience and knowledge of lab work. In at least one case the candidate had indicated that because of staff illness and shortages they had no physics practicals since returning from the summer vacation into year 13 (upper sixth).

Finally, this year the Physics applicants to Oxford had to sit an aptitude test devised by the department but taken at the applicant's school in early November. The two-part test, covering mathematics and physics, provided the interviewers with additional evidence of the candidate's ability, and assisted in deciding the final ranking of the candidates.

The College had selected 19 applicants to attend for interview this year - seven eventually received offers, with several more recommended to the pool that would be considered by other Colleges looking to supplement their own Physics candidates.

Physics is a demanding subject at University but the variety of opportunities that it provides make it an interesting and attractive degree for suitably motivated students.

Further details of Physics at Oxford can be found at http://www.physics.ox.ac.uk/ - the admissions material on the site includes sample versions of the aptitude tests for anyone who wants to get a feel of the style and level of the questions. For those who are interested in finding out about Physics in a broader perspective, the Institute of Physics website has a great deal to offer.

Wednesday, December 13, 2006

Got any silver bullets?

I will spend most of today away from the University, attending a meeting of the Data Advisory Group in London. This is a working party that runs under the auspices of the Universities and Colleges Admissions Service (UCAS), to try and ensure that the collection of data for the admissions process occurs in a sensible and timely fashion. I can already feel many of you reaching for the mouse in order to click away from the page, so before I lose you, let me explain why this is important and relevant.

For several years now, people who work in admissions to higher education have been trying to assess whether there are things that we can identify in the admissions process that will give clear indications of an applicant's ability and potential. This "contextual data", should it exist, needs to be based on solid, verifiable evidence that can have a statistical base proving that it can positively identify and predict the potential an applicant may have for future study.

For instance, if we could be certain that everyone who had fair hair, was the second child in their family, spent at least two hours each day on MSN messenger and was named Florence was guaranteed to end up with a fantastic degree in Fine Art irrespective of whatever university or college they attended, then we would have some data that may assist in the admissions process.

Now obviously that is a clearly unprovable or even verifiable statement, so it wouldn't help with the process of admitting students. But there are perhaps more relevant issues that could help identify potential and ability, and the Data Advisory Group is today (amongst other things) looking at the first interim report on the work that has happened to date by the imaginatively titled Contextual Data Sub Group.

For the broader admissions process the final outcomes could be very useful. There is already a lot of debate as to whether aptitude tests or modular unit grades from A-level qualifications can accurately predict applicant potential.

There is regular discussion as to whether GCSE qualifications that UK students take at the age of sixteen years are a better indicator of final degree performance than A-levels that are taken at eighteen years.

Where does this then lead when universities are assessing the qualifications that are attained outside the UK, or where an applicant may have significant relevant employment or life experience but no evidence of recent study?

As the posts that I have provided to date indicate, the admissions process at Oxford (and at every other university or college) is seeking to identify the most appropriate students for the course and institution. The admissions tutors at Oxford consider all sorts of evidence, including looking at prior educational attainment, predicted performance, references, personal statements, interviews, test results and aptitude scores, and examples of submitted work. How that information and evidence is weighted and measured is a source of constant and frequent discussion and analysis, and I expect that it will commence once again in January, when the dust from this admissions round begins to settle.

Is there therefore a "silver bullet", a piece of contextual information that will make this activity more certain and effective? Unless we ask the question then we will never stand any chance of finding out. For applicants (and those who advise them) it is however comforting to know that the higher education sector in the UK isn't making the assumption that there is not, and is doing what it can to try and find out if there is.

Tuesday, December 12, 2006

A ghost in the machine - observing computer science interviews

Upon leaving my previous role at the University of Essex the very generous leaving present was a palm-pilot. Whilst this was a very useful and appropriate gift, it also played to my rather irrational fear of technology. My age is such that I was one of the last school year groups not to receive computing lessons. At University, it was anticipated that, excluding the final year project, all essays would be handwritten. (The exception to this was my year spent attending college in the USA, when I had to master an electric typewriter). For most of my first job at Newcastle University access to a desktop computer was something that was seen as a rare and beautiful thing, whilst at Essex I resisted getting a laptop and using e-mail until more or less forced at gunpoint. I only started using text messaging about three months ago. One of my resolutions when starting the new post at Oxford was to try and conquer this apathy towards IT, and this blog is in part a result of my new-found interest in technological solutions to problems.

Thus my delight in going to sit in on some interviews for Computer science. Now, bearing in mind yesterday's advice on knowing what factors are significant about the subject discipline at Oxford I discover in the 2007 entry prospectus (page 36) that Computer Science requires

"a sound understanding of mathematical ideas is needed...both for potential applications such as scientific computation, and for reasoning rigorously about the specification and behaviour of programs. Practical skills must also be developed.."

In addition the tutors will

"want to see how you tackle problems and respond to new ideas; they will be more interested in the problem solving process.."

The two tutors had allocated thirty minutes to each interview. The candidates had already taken a two and a half hour written test covering mathematical and analytical skills on the previous Sunday afternoon, although the tutors were not aware of the individual scores that the candidates had achieved at the point that they were interviewed. Prior to each interview the tutors discussed material on the application that related to the candidate's interest in computer science, and this formed the first set of questions when the candidate was seated at the interview table. As has been the case in every set of interviews to date, the focus was on teasing out the applicant's enthusiasm and motivation for their subject. Some obviously had extensive programming experience, whilst others talked about their interest in the impact of computers in society, and the pace of technological change. The interviewers then asked more penetrating questions, for example, in the case of students who had experience of programming, they were asked to identify how they had applied that knowledge.

Following on from this initial area of activity, the candidates were presented with a series of graphs which they had to discuss. The questions and graphs were progressively more difficult to assess and interpret, with the interviewers asking the candidate to explain their reasoning and approach to resolving each problem, eventually (for the last couple of graphs) to use notation to explain why they had reached their conclusions. The candidates were then asked to draw a number of graphs (this is why the interview was conducted at a table!) using information provided by the interviewers - again the construction of the graphs became progressively more demanding. All the candidates were given the same exercises to work on.

The final exercise required the applicant to stand at a whiteboard and resolve a mathematical problem using algorithms. Oxford requires Computer science students to have studied A-level mathematics, and the knowledge required to successfully complete this exercise was pitched at that level.

Throughout the interview the interviewers were happy to clarify any points that the candidate found ambiguous, and this was not held against an applicant in the subsequent discussion of their performance when the interviewers were marking the interview. With each of the exercises, one of the pair of interviewers took the lead in describing the problem and asking the follow-up questions, which allowed the other interviewer to closely observe and note the candidate's responses.

I was surprised to find that the interviewers did not give the applicant a chance to ask any questions - when I queried this it was clear that this was deliberate - with only half an hour available the interviewers were keen to maximise the time to use for assessing the candidate's aptitude and suitability. They did however check that all candidates were aware of the time and place of their second interview, and recommended that they talked through any queries they had with the student runners who were available to assist after the interview had concluded.

I was also surprised that the interview did not have a practical computing element. Again the interviewers were clear that they were not using the interview to assess an applicant's programming skills, in part because this differed so radically between applicants, but primarily because it was not something that was central to their suitability for the degree as taught at Oxford. Instead the focus was very much on testing and assessing a candidate's problem solving and reasoning ability and potential, which were viewed as much more fundamental than whether an applicant could demonstrate their ability at Pascal or C++.

After the candidate had left the room the interviewers discussed their performance and reached an agreed mark (out of ten) on a range of criteria using a report form in common use across the Department.

It was helpful for me to have had the chance to observe such a very different type of subject discipline from the humanities courses that interviewed last week. The approach used was clearly designed to assess the qualities required for the degree as it is taught at Oxford, with an emphasis on mathematical ability, application of theoretical principles and problem solving.

As a postscript, my immediate work colleagues at Essex bought me a separate gift. It was a battery operated watch. They had a very clear understanding of my potential and ability in mastering technology.

Monday, December 11, 2006

How ducks, elephants and space-hoppers changed my life

At my previous University there was a great deal made of the undergraduate prospectus, the annually produced document that indicated all of the courses that were on offer, and provided all sorts of useful information about the institution. Part of the reason for the excitement was that the front cover had, for a number of years, used a visually stunning image which always attracted comment, but had almost nothing ever to do with higher education. Covers have shown cakes, elephants, plastic ducks, frogs and most recently space-hoppers - they were carefully selected to appeal and act as a visual stimulus to potential applicants, with the intention being that they would at least glance at the publication because the front cover challenged their perceptions (or intrigued them). There was definitely an attempt at creating a "wow" factor, aside from providing a functional and useful document, and it was perceived as being a successful (if initially a risky) strategy, not least because the applications doubled during the eight year period that the approach was used.

Today I have been reading through some of the text intended for the 2008 entry University of Oxford undergraduate prospectus. Oxford has a rather more traditional approach to its publications than the University of Essex, where I used to work (so don't expect any space-hoppers soon, or even ever!) but the value and use of the prospectus to an applicant remains the same irrespective of the institution. In the context of preparing for admissions interviews, it can be an important (and frequently overlooked) tool to assist a candidate.

In pretty much every interview I have observed so far (it was Computer Science today; more on this later in the week) there has been a strong emphasis, usually in the initial questions, on a candidate's motivation and reasons for selecting that subject. Now in pretty much every case the applicant has identified what has led them to the point of wishing to study their chosen academic discipline, some with more feeling and enthusiasm than others.

I have yet however to see any candidate then go on to explain what it is about the course at Oxford that makes their heart sing and their pulse race. Not only does the undergraduate prospectus provide some information about this very topic, all subject entries also provide (in some cases in a fair amount of detail) a section on what the admissions tutors are looking for at interview, and what qualities they will be trying to identify (and also sometimes how they will be doing that). All of this is very much in the public domain, and I would strongly recommend that any candidate coming to Oxford re-reads the subject entry just prior to the interview so as to prepare themselves for the format and style of the experience.

The other handy publication that will probably assist applicants as they prepare for their big day is the section on the undergraduate admissions office pages on interviews, with advice on what to wear, how to approach the actual interview, suggestions on what to do whilst waiting for the interview to happen, and attitudes to extra-curricular activities. All of this can be viewed at http://www.admissions.ox.ac.uk/interviews/ and can also be downloaded as a pdf (with lots of nice pictures and some case studies) from the same location.

The interview is only part of the selection criteria used, but it obviously for many candidates becomes a major part of their memory of the process. I am delighted to see that some of those who are commenting on the blog have chosen to record their own experiences. If you have an observation please feel free to add it to this post.

Thursday, December 07, 2006

A legal challenge - Law interviews at Oxford

What do Tony Blair, Fidel Castro, Lenin, Gandhi, and John Buchan (the author of the Thirty Nine Steps) have in common? The answer of course is that they all studied Law (in at least two cases at Oxford).

Law at Oxford this year attracted 959 applicants, with a further 277 applying for Law with Law Studies in Europe. There will be offers made to approximately 250 students in total.

On a rather wet and blustery evening I made my way over to the College where I had been invited to sit in on some Law interviews. Unfortunately I had not been able to attend the introductory meeting and briefing session for all of the College's law candidates, which had taken place earlier in the afternoon, and had identified the format for the interview procedure, as well as explaining how the admissions process for Law operated.

I arrived slightly ahead of schedule for the interviews, and had the opportunity to make small talk to the candidate who was waiting to go in front of the Law tutors. We stayed on fairly safe (i.e. not interview-related) topics, a position made much easier when it turned out he was a Newcastle United fan.

My expectation on the venue for the interview matched up to my prejudices (see yesterday's blog) so after I was briefed by the three-person interview panel and sat at the interview table, the first candidate was brought in.

The initial questions were focused solely on information provided from the UCAS form - personal statement and reference. In every case they were trying to identify the candidate's motivation and reason for selecting Law as a degree - in the case of those applicants for the four year degree that involves a period of international study, there was also interest in what the applicant hoped to gain from the year abroad experience. These are, to my mind, fairly basic and obvious queries, which should not give an applicant too many problems, but I was surprised that there was, in some cases, a rather lacklustre response to this fairly important and central set of questions.

Having assessed a candidate's rationale for applying, the applicant was then posed a hypothetical question which had a range of moral, ethical, and ultimately legal implications. The question required no prior legal knowledge in order to answer, but would probably cause a real dilemma and problem for the applicant who thought with their heart rather than their head and gave an off-the-cuff or ill-considered respond.

The interviewers had arranged in advance which of them would lead on the question, which enabled the other two to focus on the applicant and their replies, making notes as they went. After hearing the candidate's reply the lead interviewer asked a range of supplementary questions designed to broaden the candidate's answer, and appreciate in any moral or legal dilemma there are multiple viewpoints, responsibilities and reactions to factor into a decision.

Candidates who made very firm and definite initial responses were therefore being faced with increasingly difficult positions to justify, whilst those who had taken the time to consider the wider implications before they replied, and had perhaps been more circumspect in their reply had slightly more room for manoeuvre. Whilst the candidates were stretched in making their responses, they were not in any sense belittled or humiliated for expressing their views; those that took the time to stop and evaluate the position they had talked themselves into, but then explained why they might want to reconsider their initial thoughts were encouraged to develop their ideas, and alter their views accordingly.

After an opportunity for either of the other two panel members to ask supplementary questions, the applicant was given the chance to have any of their questions answered. My only comment is that a candidate should think carefully about who they are addressing their questions to - in at least one instance this week I have seen the interviewers valiantly attempting to answer a query about University-level sports teams which probably would have been better (and more successfully) answered if it had been directed at one of the student helpers.

The interview format for Law (at least at this College) had a slightly different approach than that I had observed for the previous interviews I had witnessed this week. Rather than expect all candidates to undergo two interviews, each candidate had only one interview lasting twenty five minutes on average which each of the three Law tutors on the interview panel scoring the candidates independently on a variety of criteria that had been agreed in advance. Details of the Law selection criteria can be accessed at the Law Faculty website.

By using three interviewers, but only giving one interview, it allowed all twenty two candidates for Law at the College to be seen and considered by the same three academics, which provided a continuity and consistency in the interview panel's decisions, and would allow the three law tutors to assess the pool of applicants based upon the same evidence. After awarding the individual marks, the three tutors then discussed the candidates performance to come up with a composite score. It was at this point that the advantage of having three interviewers became apparent. In at least one case there had been very different opinions formed of a candidate, with two of the interviewers scoring at opposite ends of the scale. The third view therefore acted as a moderating influence, which drew the overall mark much more in one (in this instance, positive) direction, compared to the likely outcome if there had been two interviewers, which would probably have resulted in a middle-ranking score overall.

At the end of the process the interview panel then reviewed their thoughts on the entire field of twenty-two, before putting them in a rank order. In the case of this particular College, their intention was to identify a maximum of nine applicants which they intended to make offers to.

They were very clear in their view however that the interview was only one aspect of the overall decision process. The Law Faculty uses a variety of tools to make a judgement on which candidates are made offers; I plan to look at some of these next week. Overall however I was left feeling that a candidate had the opportunity to plead their case for admission and the jury of tutors weighed all the evidence (showing due process and diligence), before they delivered a fair and just verdict.