We use Google Analytics to see which pages are read and how the site is used, so we know what to improve. This only runs if you accept. See our privacy notice for details.

JOINT COMMITTEE ON EDUCATION AND SKILLS

Ireland’s Ranking on PISA: Discussion

Contributions 128–263 of 263. This sitting's record is too long for one page, so it is split into 2 parts.

Ms Brigid McManus

That is not the big issue.

Comment on this
Mr. Harold Hislop

It is not the big issue for the principal. This process would allow the principal to be the person in the school who would step back and analyse how the school is doing, where the priorities should be and what should be changed in terms of the techniques used to teach, assess and track pupils. Those are the valuable questions a principal can ask.

Comment on this
Ms Brigid McManus

I wish to mention the DEIS results in that regard.

Comment on this

A member has not spoken at all and when he makes his comments we can return to Deputy O'Dowd's point.

Comment on this
John O'Mahony Deputy John O’Mahony Fine Gael

I apologise for having to leave to go to the Chamber. I have a comment and question. I saw in the presentation that texting was mentioned. Has any research been done into the damage done to literacy by texting? It is relevant. With regard to the description of the difference between boys and girls, with girls creating long texts and boys creating short texts, is it being suggested that the boys read tabloids and the girls read broadsheets?

Comment on this
Ms Brigid McManus

The boys would be more useful to economic society as they read facts.

Comment on this

Mr. Murtagh seems very keen to answer the question on texting.

Comment on this
Mr. Eamon Murtagh

I am not aware of any research done on texting and I doubt the commonly held view that texting does any damage to literacy. People who are texting are engaging with literacy practices that they may not engage in otherwise. My own bet is that when we research students who text the most, we will also find they are the best readers.

Comment on this

That is interesting.

Comment on this
Dr. Jude Cosgrove

The committee might be interested to note that Ireland is one of 19 countries which participated in an optional electronic reading assessment. It consisted of a 40-minute test done after the paper-based assessment. Informally, from observations of student participation in the paper-based assessment and computer-based assessment, we believe students to be much more engaged in the computer-based assessment. We strongly suspect our score on the electronic assessment will be higher than the paper-based assessment. It is a point of general interest.

Comment on this

I believe it is called the "Kindle factor".

Comment on this
Dr. Jude Cosgrove

In conjunction with those results we will have data on students' electronic reading activities. It will not necessarily take in texting but there will be a digital context for the results. We strongly suspect that the results of this assessment will be better than those of the paper-based assessment. I will mention one point - I do not know whether it is relevant to what is being talked about now but it strikes me as relevant to points made earlier. We think it is important to make the distinction between proficiency - or ability - and engagement. A student might skip questions on a test because he or she cannot do them or because he or she could not be bothered to answer them. We suspect that students are engaged to different levels in the electronic assessment and the paper-based assessment, and this is one of the reasons we are urging caution in interpreting the changes in achievement scores, particularly for reading.

Comment on this
Ms Brigid McManus

Was there not some evidence that boys were not answering the survey?

Comment on this
Dr. Jude Cosgrove

Yes. The disengagement of boys in the paper-based assessment seems to be greater than for girls. The boys seem to be more engaged in the electronic reading assessment, for some reason.

Comment on this

That is what Mr. Murtagh said, in a slightly different way. It is the same sort of message.

Comment on this
Dr. Peter Archer

That is what we are proposing. We are in the process of examining those issues and we are awaiting the results in June 2011. What has been described is our current hunch about what is going to happen.

Comment on this
Ms Brigid McManus

We were asked what we thought had happened. If members were to ask me for my best guess - having tossed it around, this is our best guess - I would say there has been some decline. The Educational Research Centre will tell one there is no basis for that. The PISA shows, despite all its limitations, that there has been some decline. The population factor is one issue, but it does not explain anything like the full scale of the decline. Underperforming schools are also an issue. However, the decline has probably been more than that allowed for by the various factors. What do we need to do about it? There is the question of data and the use of data. There is the question of radical reform of education, in terms of both pre-school teachers and continuous professional development. We must also make sure we continue measures in disadvantaged communities. There was some misrepresentation in the newspapers of what Mr. Hislop had said about it, which was that some DEIS schools were getting very good results while others with the same population and resources were not getting good results. It is a question of ensuring good practice everywhere.

There is also the issue for us, as a wider society and community, of how to encourage early reading and support at home. There was some mention in the national assessment of a lack of reading books. The correlation between reading skill and the number of books in a child's house has been consistently striking over the years. We have had some brief discussions on this issue, but we will have to find some way of tackling this. Successful work has been done by the National Adult Literacy Agency, for example, with sponsorship from An Post, in targeting people through advertising and increasing awareness. We should not allow ourselves to be influenced by our own experiences or by anecdotes told to us, but I personally feel that even for well educated and motivated parents it is hard to support their children in terms of numeracy. It is important to provide information for parents. The NCA did work on the primary curriculum and what one's child should be learning, but it might be useful to provide even simple aids for parents. For example, they could be provided with numeracy exercises to carry out when bringing their pre-school child to the supermarket. It is much easier for a well motivated and engaged parents to sit down with the kids and read them a story.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

In that regard, I came across a website called mathletics.ie.

Comment on this
Ms Brigid McManus

That is right.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

Unfortunately, to join one had to pay something like €100. The future is computers and online learning. That is where it starts with most families. The number of people on Facebook, as we know, is amazing. The key point is that we must change the way we do things. We must make resources available. I do not know whether one can have an equivalent to competitive mathletics in Ireland - why not? According to one figure, high-speed broadband is available in 2% of schools, although that number may have increased.

We must look at technology, including computers, and think outside the box. I understand that some schools are good and some are not so good. What access do we have through the Department's website to the schools that are performing exceptionally? I do not know what the Department does in this regard; it is something I must examine. What about promoting the best schools so that parents and people such as I can read about them? We must find out what works.

The question I was going to ask earlier is simple and relates to the acquisition of reading skill. I do not know the policy with regard to phonic analysis and so on. What is the current state of play? Years ago, phonic analysis was not done in Irish schools, although I presume it is done now. It is a question of how we learn. A teacher in the UK told me that the whole primary school experience, for the first two or three years, consists of learning through play. It is as though the children think they are actually playing. It is all computer-based, interactive education, and it is all fun. The school is an exceptional one and the experience is fantastic.

I recently attended a conference held by Apple in Dundalk about the use of cloud computing in schools. One does not need 20, 30 or 40 technicians; using cloud computing, all one needs is a computer and access to the Internet. That is probably a discussion for another day, but it is a question of changing the way we teach our children.

Comment on this
Ms Brigid McManus

On the question of phonics, Mr. Alan Wall, who is with us, is our ICT policy person as well as being responsible for curriculum and teachers' education. If the Deputy wishes, he can talk about that.

Comment on this
Mr. Harold Hislop

I will respond to the questions on the practice of teaching and encouraging good practice. Recognising good practice and encouraging it when we see it is an important part of the work that we as an inspectorate do in schools. We must say to the school community: "This is something good and it is what you need to build on". We must also tell them to do less of other things that do not represent such good practice. We do this at school level and it is in the published report and whole school evaluation. This is something we do also in our incidental inspections, when we go in for a short inspection visit. It is an important part of it.

We also take lessons from a range of inspections. For primary schools and for individual subjects at post-primary level, every so often we take a sample of reports from 60 to 80 schools, determine the best things we have seen in those schools and then publish these online and in publications. Recently, we went into disadvantaged schools. Teaching literacy and numeracy in a disadvantaged context is one of the hardest nuts for teachers to crack. We deliberately set out to find a small number of really well-performing disadvantaged schools in the worst possible circumstances. We decided on eight of those and we have published their stories. It is not an inspection report; it is a set of narratives about eight school communities. We thought teachers would read these more widely.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

Could we get a copy, perhaps by e-mail?

Comment on this
Ms Brigid McManus

Perhaps we could get the committee a set. There are a lot of those thematic reviews.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

I am pleased to hear this, it is what we need to be doing.

Comment on this
Mr. Harold Hislop

It is called "Effective literacy and numeracy practices in DEIS schools."

Comment on this

We can get copies of that?

Comment on this
Mr. Harold Hislop

Absolutely. We will supply copies to the committee.

Comment on this

That would be terrific. Thank you.

Comment on this
Mr. Harold Hislop

We supplied copies to all DEIS schools when it was published in 2009. It is part of the ongoing work we do in individual subjects and also for the curriculum in general. The report we published in November on the results of short inspections in schools indicated the nature of the lessons going on in English and mathematics in schools. It included the things teachers are doing well, where the preparation is good, where they are combining the right type of methodology for a given group of children and where they are using assessment well. It further indicates what is being done less well or not being done at all. It includes a checklist for the principal and school staff which asks what they are doing. This is what we encourage people to do. We have now built this into our inspections at whole school level, at post-primary level and we will build it into primary level soon.

Part of the inspection process is to inform the school community that one of the things we will examine is how well they look at the lessons and what can they learn from their own practice. It also deals with how well they look at their own practice, how they assess it in a form of self-evaluation, how well have they looked at previous inspection reports that we have carried out with them and whether they have implemented or followed on from the inspections. Unless we get to this loop of continuous questioning of how can we do the job better-----

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

We call them elections.

Comment on this
Mr. Harold Hislop

Yes.

Comment on this
Ms Brigid McManus

That is more like league tables.

Comment on this
Mr. Harold Hislop

Yes it is. Deputy O'Dowd made a point about play, which is important. It is built into the Siolta and Aistear frameworks for preschools. It is more strongly in place there. The national plan for literacy and numeracy is relevant as well. Aistear and Siolta were developed ten years after the introduction of the primary school curriculum. Knowledge of practices have moved on considerably during the past ten years. The view now is that for the preschool and infant child we should replicate Aistear in the first two years of school.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

Is that during junior and senior infants or first and second class?

Comment on this
Mr. Harold Hislop

Junior and senior infants.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

This is what I was referring to. Apparently children go in and they believe they are killing spiders but they are actually manipulating computers, working out angles and so on without knowing what they are doing. I asked a question on information technology as well.

Comment on this
Mr. Eamon Murtagh

A question was asked about phonics. I had a discussion recently with a taxi driver who informed me his children are being taught differently to the way he was taught and that he and his wife had to learn phonics to teach their children. This is a prominent part of the primary curriculum, introduced in 2000, and it is something we expect to be taught in all schools.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

What about the information technology question?

Comment on this
Mr. Alan Wall

The Deputy is correct. There is a variability of connectivity throughout the school system. This is a function of where the market was when the contracts were placed in 2009. It is an ongoing developmental process. We will go back to the market later this year. We expect to see an improvement in the degree of connectivity, especially with schools currently on satellite, which is a poor service. It has connectivity but it is slow. We expect to see this improve because the market has improved and this gives us the opportunity to take advantage.

The issue of the cloud computing piece was raised. It is something the National Centre for Technology in Education has been considering. It has held discussions with several industry players on this issue to determine how cloud computing can benefit the school and learning community. There are certain benefits, including cost benefits. The availability of up-to-date software and various applications is relevant as well and it is something of which we are conscious. The National Centre for Technology in Education continues to explore the issue with some of the major multinationals here which are players in the cloud industry.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

I have spoken to some of them. They have informed me that for €10 they can provide a copy of a particular word processing package to every student.

Comment on this
Mr. Alan Wall

Yes, there is a utility issue whereby one can buy it and it is available as a service.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

What interaction takes place? I suppose there is plenty. We looked at an example of what is taking place in this area in the Isle of Man. We were shown 4,000 students linked in through the web to schools using cloud computing. The whole school was involved in the activity, which was great because their homework was being done and the parents could link in. It seems to be a great way of doing business. How near are we to examining these issues? How much progress are we making?

Comment on this
Mr. Alan Wall

As the Deputy is aware, the steering committee was involved in the Smart Schools = Smart Economy report. It is considering these issues. On the other side is the cloud, connectivity issues, the basic equipment in schools, digital resources and how they are used. We are trying to push out these four areas. The recent money that went into schools was to foster the basic equipment in schools. This is one part of the puzzle. At the other end is the digital issue. If one gets to the cloud what does one do then? This is the issue of digital materials and how they are used. Teacher training is relevant, as well and bringing this into the classroom. It is ongoing work.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

Is there a published plan?

Comment on this
Mr. Alan Wall

Yes. The Smart Schools = Smart Economy plan relates to these issues. It refers to digital publishing.

Comment on this
Ms Brigid McManus

We could provide a note and a progress report on the position in this area, if that would be useful.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

This is the future as I see it. If we get this right we are flying.

Comment on this
Ms Brigid McManus

I wish to clarify a point on data protection. One of my colleagues has checked the matter. There is no difficulty with data protection on the report card.

Comment on this

There is or there is not?

Comment on this
Ms Brigid McManus

There is not because of several legislative provisions. The Education Act requires schools to report. The Data Protection Act entitles parents to regular information on progress of children in manual or electronic form. I realise that is a separate issue. A regulation under the Education Welfare Act protects and allows one to send report and assessment information, when requested, to other teachers, schools, children, individuals and agencies involved in children's education. I realise issues have arisen. What can be requested? It could be a report on a given history, monitoring progress or attendance history. The Minister, the National Educational Psychological Service, NEPS, the National Council for Special Education, the National Educational Welfare Board, any recognised school, any designated centre for education, such as Youthreach, and certain other bodies can request it.

This is not to say there have not been issues. Data protection sometimes relates to proportionality with regard to some of the cases we have encountered in the Department. There was an issue of our using data to be collected for other purposes. Sometimes, there may be issues if one has not thought through what one wishes to use the data for. I am not saying there are no data protection issues.

Another question concerned the parents piece and the boys in DEIS schools. We can provide the committee with more. The school completion programmes are experimenting with gender differentiated activities and this relates to the retention piece. We are trying to capture information on the inspection piece as well. We have just rolled out parental questionnaires to capture what parents and students beyond a certain age think of the school. This is part of the whole school evaluation, WSE, process. I am unsure who asked me about that.

Comment on this

It is fine to say you are responding to a Member's question.

Comment on this
Ms Brigid McManus

There are a range of issues. Someone, perhaps Deputy Clune, asked about the economic issue. We spoke about the prioritisation. There is an issue. Fundamentally, this is about policy and political choices as much as it is about operational matters. Sometimes we get into a debate about the frontline versus back-room, which may not be the most helpful with regard to enhancing quality outcomes. In some ways, we have found it is just as important in terms of delivery to spend money on continuous professional development or on enabling schools to carry out data collection, as it is on the teacher in the classroom. For understandable reasons during the past, even at a time when resources were increasing and improving-----

Comment on this

I wish to make a specific intervention on the Department's response to the Croke Park agreement on productivity. Has enhanced hours for continuous professional development, CPD, been part of the management's suggestion?

Comment on this
Ms Brigid McManus

It is fair to say that. A whole set of other issues link into quality outcomes and what makes good performing systems. While we are probably comparable with other countries on the contact hours in schools - I am not saying that an awful lot is not done by teachers outside of those hours - unlike other countries we do not have a body of time outside teaching contact hours that can be directed by school management for professional development, meeting with parents, planning for children with special needs or a host of other things.

Comment on this

Are the great contact hours teachers have not, to a certain extent, a bit of an urban myth? Deputy O'Mahony would have been one of them. Not all or even 50% of teachers work those house. The contribution they give is extraordinary but it is not uniform across the entire body of teaching. Is that a fair observation?

Comment on this
Ms Brigid McManus

There are two issues. In all organisations there are people who go the extra mile, those who do the bare minimum and those in between. There is another issue. Huge commitment is made by some and others may not be doing enough. When we had these discussions some years ago, management bodies expressed a concern that if we tried to be overly prescriptive, people who are doing a lot more work would be encouraged to reduce it to a minimum. Another issue for schools is having control over that time. I do not say that as a Stalinist bureaucrat or whatever.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

We would never think that.

Comment on this
Ms Brigid McManus

A board of management would have control over that time. Many schools manage to deal with it informally. One wants the teacher who does the school play, is wonderful with the teams and takes children on trips. My experience as a parent when my children were in primary school was that teachers involved them in primary science. Some teachers will do such things but the school needs a bank of time where if it wants to take a half day to talk about literacy and numeracy or plan, it can do so. In some ways our system-----

Comment on this

Or they want time after the children have gone home. If both parents are working they could work until 7 p.m. to talk about literacy.

Comment on this
Ms Brigid McManus

An extra day could be allocated. While the flexibility involves an extra hour a week, flexibility is needed to aggregate that in order that a half day could be used to do X or Y. The Teaching Council is dealing with an issue the committee has discussed and which is part of our plan, namely, continuous professional development that teachers would do themselves. There is also an issue for us in terms of the cost of providing some of that. Whatever about expecting them to do it in their own time, there is an issue which was raised in the take-up of project maths online and evening courses. We also took teachers out of the classroom.

They were faced with a new curriculum and a new way of doing things. While one wants it to be compulsory, people have an appetite for it and the question is how we direct it into priority areas. There is a challenge for us in terms of ensuring there is good quality provision which matches the CPD. We did things in project maths and there were good practices.

I have heard the ERC argue passionately about it. Apart from statistics, if a teacher is willing to study numeracy professionally where does he or she go? It is something of which we need to do more.

Comment on this

Before I go to Dr. Archer for closing comments, I wish to ask Ms McManus about project maths. We debated literacy at length today. The report was a huge shock for her. I presume she was aware that project maths was a response to problems with numeracy. I wish to ask Ms McManus a question which she may not be able to answer today but she can revert to the committee. I have been a first-hand witness of project maths for the past three years and I am concerned about its materials. They are excellent and working very well. It is the way to go and I am 100% behind project maths.

The young people who are studying junior certificate project maths this year do not have backup material to show what type of question they might expect in the paper. They do not have past papers because there are none. In the classrooms there is a focus on paper 1 and half of paper 2 which contain no project maths. A good amount of work is done on project maths on the board but there is no real information on how it will be tested. I was concerned last year when I saw what happened in the pilot schools and I am concerned how the teachers and pupils, especially those in the pilot schools, are managing the issue.

I would like the question to be dealt with at departmental level because I am worried about it. I have asked several parents and teachers how the programme is playing out. I know the Department cannot produce ten past papers for the past ten years when it does not have them. I am not so foolish as to think we can manufacture them overnight. When the issue was first raised with me I wondered why it was such a big deal but as I examined it more closely, including discussing last year's leaving certificate with pupils, I found there was a difficulty in the pilot schools. It is a wonderful curriculum but there was a worry about how it is playing out in the early years.

Comment on this
Ms Brigid McManus

Perhaps I could make a comment and ask other delegates to speak. I smile slightly. I have a personal as much as departmental observation to make. We have had many debates on the junior certificate and trying to make schools and teachers autonomous in their curricula and give them freedom. Project Maths is a hugely exciting and essential project. Apart from the huge drive to pull all the elements together and managing the project, an official in our Department chairs a group to try to make all the elements work. The implementation of such a scheme is a huge management and process project to deliver in the very short and difficult timeframe we have for curriculum reform.

The theory was to work with project schools - I am a not an expert and will let the experts comment - and get them to help to design the curriculum. It is very important to test things but it is fair to say that in the roll-out of the pilot schools and the reports we received, the major concern was that the curriculum would be written down and the sample questions given to teachers. The State Examinations Commission had a significant involvement in helping to design and implement project maths.

Apart from the importance of project maths for mathematics, the process will probably create issues on which we have to reflect that will be essential to the kind of project we are embarking upon in junior cycle reform. It might be easier to do it where the stakes are not as high. The exams are high stakes and teachers are concerned about their pupils not being disadvantaged in the competitive system of entry to higher education.

We produced sample papers for the pilot schools. They are not produced by the State Examinations Commission but they are equivalent to its standards.

Comment on this

Was that for the leaving certificate?

Comment on this
Ms Brigid McManus

Yes. The pilot schools were involved in designing the curriculum and the sample papers for them arrived at a certain point in time. In the roll-out for schools there are not just last year's paper but also others. A large amount of material is available on websites and in hardback copies. Unfortunately, there is a cohort who might find it more comfortable physically. One of the major processes in teacher education is to pull together supports for pilot schools and to design materials showing up the issues and how they feedback, allowing us to make amendments as we went along. One question proved problematic, the optional choice, even though the basic philosophy of Project Maths was to cover everything.

Comment on this

I am a bit concerned about the material. The maths textbooks for leaving certificate and junior certificate do not include Project Maths, the teacher must go elsewhere for the material and, unless students are misguiding me, they are unaware of sample papers.

Comment on this
Ms Brigid McManus

That is a bigger pilot. The pilot ones arise because the curriculum is developing so it is only a certain point. For the 24 schools this is almost a live experiment.

Comment on this

I know that but the stakes were high for the students who did their leaving certificate last year. There was a high failure rate in the mock exams last year among those students and there was a lot of worry as a result. If we can avoid those problems this year, it would be better. Are there sample papers for the 24 schools?

Comment on this
Ms Brigid McManus

Each year we add more. The concern relates not to those areas being examined generally but the second phase.

Comment on this

I am concerned about the students in the 24 schools who are taking part in the pilot scheme. Do they have any idea how the project will be examined?

Comment on this
Mr. Eamon Murtagh

The availability of sample questions was one of the concerns that was raised by the project schools. Project Maths is being rolled out in three phases, with the first phase being the examination of the first cohort last year and sample papers were available to them. The support team is now producing additional exemplar material for schools. They are being provided electronically and in hard copy to teachers attending support seminars.

Comment on this

Does Mr. Murtagh know when they will be available? We are late in the year now.

Comment on this
Mr. Eamon Murtagh

I will have to check but it was my understanding they were to be made available early this year.

Comment on this

We are three weeks away from the mock exams and they have no sample papers. That is my worry.

Comment on this
Mr. Eamon Murtagh

I can check but I am almost sure they have sample papers at this stage. I will confirm that later today.

Comment on this

We dedicated most of the meeting to literacy but we are aware of the wonderful work being done with maths. Project Maths is wonderful but for the 24 schools it is a challenge.

Comment on this
Ms Brigid McManus

We are very conscious of that.

Comment on this

On the first page of the presentation there was a reference to science that stated some students who take the PISA science test do not study science in school.

Comment on this
Ms Brigid McManus

There would be a percentage of students who do not study science for the junior certificate who would be included. PISA is done using a sample of all students in a school so the student is examined on literacy, maths and science knowledge whether or not he or she studies science. In spite of the population factors that would have pulled down science in a similar fashion, it remained the same. It is the first time students have come the full way through the new primary school curriculum in science and reached junior certificate.

Comment on this

I thought science was mandatory up to junior certificate level.

Comment on this
Ms Brigid McManus

No, it is not. In practice, because of school logistics, it is mandatory.

Comment on this
Mr. Harold Hislop

About 87% of students take science in the junior cycle but it is not mandatory. We introduced it as a component part of the primary school curriculum in the 1999 primary school revisions so this is the first cohort of students to have benefited from curriculum changes at primary level, the intensive in-service teacher training in science and the introduction of a revised syllabus for junior cycle science.

Comment on this
Ms Brigid McManus

If one looks at the junior certificate results last summer, science results indicated signs of improved standards. It shows that it is possible through a mix of teacher training and curriculum reform to make a difference. The junior certificate was more hands on. Project Maths gave rise to the same issue that we came to when looking at the revised junior and leaving certificate science curricula, where we changed to a more hands-on approach, of how this would be examined. It was only when the pilot schools saw the sample papers last year that they accepted assessment would also be done differently.

Comment on this

The witnesses referred to the new draft plan for literacy and I would like to take part in the planning for that. We need not have a committee meeting but we could arrange something in-house.

Comment on this

I would also be happy to be involved in that. We will open it to members to become involved if we arrange something like that on an informal basis.

Comment on this

It is too important an opportunity to miss so perhaps the secretariat could organise it.

Comment on this
Ms Brigid McManus

We will organise a presentation on the contents of the plan. We will be doing workshops at the end of January for stakeholders and if any committee members would like to attend, they would be very welcome.

Comment on this

Is it best to do that before the closing date for submissions?

Comment on this
Mr. Harold Hislop

We can do it at the convenience of the committee but we hoped most of the workshops will happen in February and March.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

We should not do it in March.

Comment on this

We might lose some members so the earlier the better.

Comment on this

We should do in the next ten days subject to everyone's availability.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

The earlier the better. About 8 a.m. would suit me.

Comment on this

Will this be a presentation followed by input from committee members?

Comment on this

They may offer us an observation. An early morning session on a Wednesday or a Thursday would suit. The Senators are here on a Tuesday night. A meeting at 8.30 a.m. for an hour and a half, finishing at 10 a.m. would be suitable.

Comment on this
Mr. Harold Hislop

We will certainly be able to do that.

Comment on this

It will be a presentation or a sharing of information.

Comment on this
Ms Brigid McManus

It can be the start of a process, following which people may want to go away and think about it and they may wish to feed into it or come back to us.

Comment on this

I thank the delegation.

Comment on this

The literacy draft plan has a closing date of 30 January. It was interesting to hear members sharing their views. Senator Fidelma Healy Eames and I would have thought science was mandatory in every school. We all have different views on issues. Earlier the Secretary General referred to junior cycle as having ten subjects. I said I know of a school which has 11 subjects. Perhaps there are some schools that have nine subjects. The only reason that is important is that if we are talking about making more time available for literacy and numeracy there may be scope within the number of subjects being studied in different schools. That issue needs to be addressed.

Comment on this
Dr. Peter Archer

Before we conclude I issue one general clarification and will address two or three specific questions that were raised and not answered. The general clarification is on the work we have been doing in the centre on PISA, since the PISA results became available a few months ago. We are trying to understand what we see as a very surprising set of results. We are not in the business of explaining away the findings, which is a phrase that was used by one member. It is an independent research institute which approaches all the issues we investigate without an agenda.

Comment on this

On that point, my colleague, Senator Brendan Ryan, used to head up the Coco-Cola plant in Ireland and was being constantly measured and assessed. That is why he responded in the way he did.

Comment on this
Dr. Peter Archer

Absolutely. I understand that. Deputy Ruairí Quinn asked about the role of Statistics Canada and the work it did recently. It was given two aspects of PISA to look at, one of which was sampling. We had a concern, and the Department may have had a concern, that some of the decisions we had to make in regard to sampling for 2009 might have affected the comparison with 2000.

Comment on this
Ms Brigid McManus

A civic survey was taking place at the same time. The sample was not a factor but we had taken the sample from only half the schools for technical reasons.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

Was that due to sampling fatigue?

Comment on this
Dr. Peter Archer

Most large scale surveys would require a sample of approximately 120 to 160 schools which is a large percentage of the post-primary schools in Ireland; there are only 740. Some schools, particularly the large ones, end up being selected for many surveys, so that survey fatigue becomes an issue. It came in and looked at the sampling and was able to reassure us that the findings were unlikely to be the result of any work we had done in that regard. It then went on to look at the very technical aspects of scaling and how change is measured over time. It was there it gave us reasons to be particularly cautious about interpreting the results. By any standard, the work is of a high standard but it is not completely out of the blue. What it says about scaling and the measure of change in PISA reflects growing concerns within the research and measurement community generally, not about PISA in general or much of what PISA does extremely well but concerns about its capacity to measure change.

Comment on this

My experience of statistics over the past 15 years or so has been predominantly opinion polls in regard to politics. Whatever about the sample, the base and the distortion - this is a view shared by people like me - the underlying trend is what one should seek.

Comment on this
Dr. Peter Archer

Yes.

Comment on this

Notwithstanding all those qualifications - I did not know they were undertaken from a professional point of view because it was a surprise result - the underlying trend is the one for which we must have regard. That seems to be a wake-up call to use the phrase we used earlier.

Comment on this
Dr. Peter Archer

That is the reason that at the end of our presentation we referred to the results of the forthcoming electronic survey. In 2012 the results of the PIRLS and TIMSS - the primary school equivalent of the PISA - will be available. Deputy Quinn raised a question about the high percentage of immigrants in the US and Israeli populations. That is true. Dr. Jude Cosgrove gave me figures indicating that 25% of the sample in the United States is Hispanic and they take the reading test in English. That is the kind of factor which leads us as researchers to wish the league table aspect of PISA was not the one that got all the attention. Because countries vary so much in so many important ways, such as the homogeneity of their population, the league tables can be extremely deceptive in this area.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

On that point, I am not an academic, I have the reference here to PISA studies. Hanushek and Woessmann claim that a country's comparative economic performance is directly correlated through a proportion of high achievers in the cognitive skill test for 15 to 16 year olds. Is that a racket or not?

Comment on this
Dr. Peter Archer

I would be very surprised if it was not. I do not see the need-----

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

That applies to our results as well.

Comment on this
Ms Brigid McManus

Not the PISA but the research on the achievement.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

This is done on the PISA studies. I am trying to make the point that there is an elephant out there called PISA.

Comment on this
Ms Brigid McManus

No.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

It is still there no matter what colour we paint it. It is the elephant in some respects.

Comment on this
Dr. Peter Archer

One must be careful. We look at the underlying trend and we look for corroborative evidence. We like to think this is science but it is not precise science. There are variables. Senator Healy Eames referred to the changing face of the classroom in Ireland and the growing number of immigrants. In a subsequent question, Deputy Clune rightly pointed out the proportion of children who-----

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

-----have some other language.

Comment on this
Dr. Peter Archer

That is the vast majority. That is something that needs to be borne in mind as we look at these and subsequent findings.

Comment on this
Dr. Jude Cosgrove

Deputy O'Dowd referred to the relationship between economic success and achievement. We need to be careful about ecological fallacy. It is a phenomenon whereby, depending on the level at which one looks at relationships between X and Y, one can point out different patterns of relationships. That said, there is a very interesting Canadian longitudinal study, results of the latest wave of which will be available later this year, entitled the Youth and Transition survey. It tracked children who did PISA in 2000 every two years or so. I understand that last year it gave them the PISA test a second time, so that it has a huge amount of data on these children. There are about seven countries that are adding a longitudinal component to PISA. The point I am trying to make is that PISA in and of itself does not have predictability. It cannot say with any certainty that a high achieving-----

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

The inverse is not-----

Comment on this
Dr. Jude Cosgrove

One could not say the inverse either.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

I accept these as a benchmark in time of what happened in Ireland.

Comment on this
Dr. Jude Cosgrove

But the Canadian-----

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

The results are not good enough and there are all sorts of reasons for it. I think you are tacking the change in significant ways. That is the way I am trying to look at it.

Comment on this
Dr. Jude Cosgrove

The Canadian study is very interesting because it shows, even after adjusting for a multitude of economic educational factors, that children who do better on PISA are more likely to go to university. That might be worth bearing in mind.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

It is not the number of years in education but the cognitive skills of students that is the measure.

Comment on this
Ms Brigid McManus

In response to Deputy O'Dowd, and it will be of interest to Deputy Quinn, there was very interesting research conducted in the University of Limerick in 2009, where they had tested all entrants on maths and correlated the data over a decade with the leaving certificate maths standard. They were considering the question of grade inflation. They looked at the students' capacity on a different test to maths and over a period they looked at whether performance on that test matched. We did not reference this in the document, but we will provide the Deputy with the reference.

Comment on this
Mr. Harold Hislop

It is footnoted in the main submission.

Comment on this
Ms Brigid McManus

What they found was that the performance of students with a lower attainment in maths correlated with the performance in a different maths competency examination. Over the decade there was a decline in the standard of the entrants and some of that may reflect the fact that the points went down for computing and such courses, when they were seen as less economically attractive. I mention that research because it is an independent look at the topic of grade drift, but it has only been in place for a decade.

Comment on this

We are back to where we started: Lies, damned lies and statistics. All of this comes with a health warning but in the absence of any other reliable quasi objective system of measurement, it is the only measure we have and we must accept the trend.

Comment on this
Mr. Harold Hislop

It also makes the point of the importance of good quality national data and collecting it systematically. That comes with a cost and requires investment.

We have national assessments at primary level which are tracking that progress for us. We need a similar collection and analysis of data at the post-primary level as well and it would reap rewards to have that because one is then in a much better position to make judgments on the validity of international surveys.

Comment on this

On that very point, if on future birth certificates, there was not only the current level of data but the educational level of parents, whether primary, secondary or tertiary, that would be a fair indication of predictive possibilities.

Comment on this
Fergus O'Dowd Deputy Fergus O’Dowd Fine Gael

That would take years.

Comment on this

I thank the Secretary General and her officials from the Department of Education and Skills and Dr. Peter Archer and his colleagues for attending this meeting. There has been a good exchange of views and we will follow up next week by looking at the plan in detail. I hope we will meet the Minister very shortly thereafter. This is a very serious issue and one of the key points made by the Secretary General is that the Department will have to consider that more departmental time will be given to this issue and more time will be allocated to aspects of literacy and numeracy in teacher training colleges. The committee would welcome progress on this very important issue.

Comment on this