Friday, October 23, 2009

Entrance Exams Elsewhere - 3


South Korea (It's not quite about the exam takers, however. It's about a company that offers coaching -- online):

... In this country, where people’s status and income at 60 are largely determined by which college they entered at 18, South Korean parents’ all-consuming task is to ensure that their children enter an elite university. And that requires a high score on the college entrance exam.

By tapping into those anxieties, which deepen during recessions, Megastudy has become South Korea’s fastest-growing technology company, with sales expected to grow 22.5 percent this year, to 245 billion won ($195 million), even as the country’s economy is projected to contract.

About 2.8 million students, including approximately half of all college-bound high school seniors, are members of Megastudy, which allows them access to some of the country’s most celebrated exam tutors. For a fraction of what they would pay at traditional private “cram schools,” students can watch video-on-demand tutorials on home computers or download them into hand-held devices for viewing in the subway or parks. They can skip or fast-forward through some parts of a lecture and bookmark or repeat the rest.

Entrance Exams Elsewhere -- 2


Turkey:

The Student Selection Exam (ÖSS), required for acceptance into universities throughout Turkey, was held yesterday for the final time in its current format. A total of 1,349,423 students left home early in the morning on Sunday to take the ÖSS, which began at 9:30 a.m. throughout the country as well as in the Turkish Republic of Northern Cyprus (KKTC).

The exam lasted for 195 minutes, with the candidates trying to answer a total of 180 questions. This year's exam was made up of eight tests, each with 30 questions. For students applying to programs with no graduate level, the first four tests were sufficient. Students applying to programs that do have graduate levels, on the other hand, had to take the first four tests and an additional two tests in the fields they were applying to.

Parents began a tense wait after the students were taken into the exam rooms. Some parents could be seen reading the Quran and praying, perhaps that their children successfully pass the exam and have a chance to study at their preferred universities.

Hatice Güllüce, one of the mothers whose daughter took the exam in the eastern province of Erzurum, said her daughter studied for the exam for a whole year and now it was time to support her daughter through her prayers. She said she also prayed for all the other students to perform well in the exam.

Entrance exams elsewhere


China:

For the past year, Liu Qichao has focused on one thing, and only one thing: the gao kao, or the high test.

Fourteen to 16 hours a day, he studied for the college entrance examination, which this year will determine the fate of more than 10 million Chinese students. He took one day off every three weeks.

He was still carrying his textbook from room to room last Sunday morning before leaving for the exam site, still reviewing materials during the lunch break, still hard at work Sunday night, preparing for Part 2 of the exam that Monday.

“I want to study until the last minute,” he said. “I really hope to be successful.”

GRE physics


Over at Cosmic Variance, John Convey gives us a rare glimpse into the way the GRE exams are put together.

Firstly, there’s the format. The exam is 100 questions long, and you have 170 minutes to do it. This is, therefore, different from just about every other physics exam you have had in college, where you have, say, four to six problems in an hour-long exam. The GRE Physics problems (or “items” in assessment world jargon) are short, to-the-point questions, and just about all of them are short calculations, if any, and take little time once you see what to do. Writing such questions is a difficult thing to do, let me tell you. We are continually amazed how, after about six levels of review, we can find issues of clarity, reasoning, and even sometimes basic physics correctness in the items submitted to the pool. All the committee members spend a lot of time each year reviewing hundreds of problems, looking for flaws, but more often than you would think the face-to-face meeting in Princeton with the ETS folks reveals something previously overlooked. It’s a really interesting process.

For each new exam form we eventually arrive at 100 items that test mastery of a clear physics concept or idea, and there is, yes, a certain amount of memorization required in terms of the basic equations learned in undergraduate physics. But there are many problems that can be done using just concepts, and many that can be done with simple dimensional analysis. When there are numerical solutions (and many if not most are in that category) the numbers are chosen so as to allow easy arithmetic – no calculators are allowed.

He also offers quite a few tips for how to prepare for the GRE subject test in physics.

My first piece of advice to students studying for this exam is to focus on reviewing the textbook from your freshman introductory physics course. In my years on the GRE committee, when I have needed to consult a text, it is that text at least 80% of the time. If you master every example in there and review the basic equations, you will do really well on the GRE. I have found that only a small fraction of the items on the GRE are actually from upper-level topics like stat mech, quantum, and special topics (solid state, nuclear, particle, cosmology, etc.) And presumably you have been studying the advanced topics more recently anyway. I think the single biggest mistake students make in studying for the GRE is to focus on too-advanced subjects.

There's a lot in Conway's post. Go read all of it.

Initiatives from the IIT Council meeting -- Some clarifications ...


In this post (which was based on news reports on HRD Minister Kapil Sibal's version of the deliberations of the IIT Council meeting) , I had asked folks from IITs to tell us if they "had any inkling at all about" the kinds of initiatives announced that day. While the HRD Minister himself has clarified that JEE reforms were entirely up to the IITs, we have some clarifications on some of the other issues -- thanks to Prof. Gautam Barua (who left a comment) and to a friend (who e-mailed me).

.

Here is Barua's comment (with just a bit of formatting added by me):

Please note the following:

  1. As per the Act and the Statutes, the Senate of an IIT handles academic matters. The same Act states that the Council will "advise on matters relating to the duration of courses, the degrees and other academic distinctions to be conferred by the Institutes, admission standards, and other academic matters".

  2. So, if the Council forms a committee to look at the PG programmes (and not UG, and not curriculum as wrongly reported), what is wrong?

  3. A Committe formed by the IITs is considering the JEE reforms issue. There was no decision in the Council meeting yesterday. What the Minister stated is the general principle, and ONE possible way of handling things. See what ignorant reporters have done with it.

  4. A Committee headed by Dr. Kakodkar will also look into autonomy issues that are in front of the IITs. These were discussed in the meeting and the committee will examine all issues. There is hope that changes will be brought about in the way IITs and the Govt. interact.

In another comment, he recommends this IE report as "the most accurate on what transpired in the IIT Council meeting."

An IIT friend responded by e-mail:

The reform in JEE they talked about was in the pipeline for few years now. [...] Its just the media savvy minister who used the opportunity to grad some attention.

Also regarding the research orientation in line with the country's needs, it was also in pipe line. [It was brought up in a convocation address by a high level technology manager in the country].

So in conclusion, we knew it was all coming and is in line with we were expecting.

Thursday, October 22, 2009

Is JEE rank a prize?


It's fair to say that JEE has strayed too far from what most of us would agree should be its real mandate: standardization across the large number of Class XII boards. If it is not a standardizing exam, then what is it?

I want to consider the possibility that the JEE is actually a contest. That would make JEE rank (or, a seat at an IIT) a prize -- it's prestigious, it's highly coveted, it's scarce.

JEE, in other words, is a process very much like that used for selecting people to to represent India in the math, physics, or chemistry Olympiads. Only the numbers are different -- Indian Olympiads probably select a few tens, while the JEE selects a few thousands.

[JEE certainly has features that resemble the Olympiads: tough questions that require you to think creatively, questions that go beyond Class XII (even though the syllabus is nominally the same), questions that test your agility, time pressure, the need for intense preparation, etc.]

If this premise is accepted, then it is better to organize JEE like the national sports championships are organized, or like the Olympiads are organized. Lots of local events, which escalate to higher levels -- district, state and national level championships (and rankings).

This has the desirable property of selecting those who are 'good', 'motivated', 'hard working', 'persistent'.

It has the even more desirable property of eliminating a large number of people along the way, and fairly early in the process. We are talking about more than 90 or 95 percent of the students, who really have no business taking the JEE, who end up taking it because they think -- or their parents think -- the Prize is worth their blood, sweat and adolescent years.

People will say that there will still be coaching. Yes, there will be; but it will not be the dysfunctional, monomaniacal, it's-okay-to-neglect-school kind.

It will be small, sharp and focused. And it will help the right sort of people (willing victims, if you will!) : those who really have a flair for science, and enjoy doing intellectually challenging work.

If IITs want JEE to be a Prize exam, they are better off treating it as such, and take the necessary steps -- organize it like the Olympiads. Have multiple elimination rounds.

Wednesday, October 21, 2009

Kota opposes the proposal to increase Class XII marks


What a surprise!

Let's look at some of the arguments and counterproposals:

Argument 1:

They claimed that raising the cutoff from the current 60 per cent would not reduce the craze for coaching — as the government hopes — and that the institutes would start preparing students for both their IIT and board exams.

Argument 2:

However, they argued, rural students would be hit hard because they are disadvantaged in the board exams — often lacking good laboratories or teachers at their schools — but face a level-playing field in the IIT entrance tests.

IITs are sitting on mountains of data that can clear this up. But we live in an absurd society in which coaching schools make a shameless claim that they are the ones that help level the field for rural students -- even though coaching schools are all located in cities and towns.

I wonder what'll come next: that coaching schools are the poor people's best friends?

Argument 3:

Some coaching centres also argued that a higher board cutoff would raise tricky problems since different boards marked students differently — for instance, the CBSE awarded marks more generously than the Bengal board.

This is not a serious problem. IITs can use a percentile cut-off as a minimum requirement -- and this cut-off can be uniform across boards. A possible objection is to suggest / claim that people in Sate A are inherently inferior to people in State B. This would be an extraordinary (and potentially explosive) claim, and so would also require an extraordinary 'proof'.

This is not quite an argument for anything, but something for the IITs to ponder about:

He said the IITs had been changing the pattern of their entrance exam every year to try and reduce the influence of coaching, but the institutes had survived through research and innovation, evolving strategies that benefited their students.

And, finally, this counter-proposal gives a whole new meaning to chutzpah:

Pramod Bansal of Bansal Classes agreed: “They should retain the Class X exam where a student is free to concentrate only on his school subjects, and not burden them with high scoring in their Class XII boards when their focus is on entrance exams and their future career.”

This too should worry the IITs. The JEE is being framed here -- and I would say, with some justification -- as something that has little to do with school subjects. As something uncorrelated with Class XII performance. As something that takes primacy over board exams.

This is a pretty amazing transformation of an exam whose primary role should have been one of standardization across boards -- just as the role of board exams is to standardize across schools of different kinds (rural, urban, public, private, corporate, franchisee ...)

Tuesday, October 20, 2009

Well, that was fast!


Pallavi Singh in Mint: No Govt. Interference in IIT eligibility criteria, says Sibal.

Well, that was that! That 80 percent score in Class XII exams was just a trial balloon from HRD Minister Kapil Sibal. Now that it has backfired badly, he has also backtracked by saying this is the IITs' call.

What is really interesting is the alacrity with which some politicians reacted to Sibal's trial balloon.

  1. Bihar CM Nitish Kumar; in response to his letter, Sibal said "the alleged proposal" is "non-existent."

  2. Lok Jan Shakti leader Ram Vilas Paswan

  3. UP CM Mayawati

  4. JMM General Secretary Ramesh Hansda

  5. BJP spokesperson Ravi Shankar Prasad

* * *

The best comment I have read so far is from one Aakash Chaudhry, who runs a coaching school. He seems to think that the following line of reasoning supports coaching schools:

"Coaching cannot be eliminated. As long as the IIT-JEE exam exists, there will be need for coaching. Learning in schools alone is insufficient to crack the IIT-JEE. They focus on all-round development and extra-curricular activities, and not just academics. We focus only on academics." [Bold emphasis added].

Monday, October 19, 2009

Sibal exercises his autonomy to announce new initiatives -- for the IITs


I'll let our IIT friends tell us if they had any inkling at all about any of the following issues (especially the first and the last) that the IIT Council appears to have discussed in today's meeting.

  1. Opening a new front, HRD Minister Kapil Sibal on Monday wanted more weightage to be given to Class 12 Board exam for IIT entrance and proposed raising the required minimum of 60 per cent marks to at least 80 per cent. [Hindustan Times]

  2. To bring research to the forefront in the IITs and increase its role in national development projects, the government today set up a committee which will suggest a broad roadmap for the institutes for next ten years. [PTI]

  3. "The present criteria is that students need to secure 60 per cent at class XII for appearing in IIT-JEE. This is not acceptable. The minimum marks required for IIT-JEE could be raised up to 80 to 85 per cent," Sibal told reporters after a meeting of the IIT Council, the apex decision making body for the elite institutes, in New Delhi. [Indian Express]

  4. Sibal said a three-member committee has been set up to look into the curriculum and submit its report within three months, suggesting required changes.

    The committee comprises Science and Technology Secretary T Ramasami, Secretary Department of Biotechnology M K Bhan and CSIR Director General Samir Brahmachari.

    The committee will deliberate on new age courses to be started by the IITs. Sibal has been insisting that the IITs could explore starting courses in Humanities and Medicine also. The committee will give its report by January. [Indian Express]

IIT-Patna seems to be at the leading edge of autonomy


From the faculty recruitment ad (Update: the ad has been corrected sometime after this post went up this afternoon -- see below) for IIT-Patna [link via Kaushal's comment]:

Pay Scales:

Assistant Professor (on contract): To be appointed in PB-3 (Rs.15,600-39,100) with AGP of Rs. 6,000/- p.m. with seven non-compounded advance increments. After 1 year, the AGP will be Rs. 7,000/-

Assistant Professor: To be appointed in PB-4 (Rs.37,400-67,000) with AGP of Rs. 9,000/- p.m.

Associate Professor: To be appointed in PB-4 (Rs.37,400-67,000) with AGP of Rs. 9,500/- p.m.

Professor: To be appointed in PB-4 (Rs.37,400-67,000) with AGP of Rs. 10,500/- p.m.

According to our understanding, APs start at Rs. 38,000 (PB-3 pay of Rs. 30,000 and AGP of Rs. 8,000) and move to Rs. 46,400 (PB-4 pay of Rs. 37,400 + AGP of Rs. 9,000) only after three years of PB-3 penance.

[Update: Okay, the ad has now been corrected. Our understanding remains intact. The latest version reads:

Assistant Professor: To be appointed in PB-3 (Rs.15,600-39,100) with AGP of Rs. 8,000/- p.m. For direct recruits, minimum pay in the Pay Band to be fixed at Rs. 30,000/-

Assistant Professors in IITs, IISc Bangalore, IIMs, NITIE Mumbai and IISERs, on completion of three years of service shall move to Pay Band 4 (Rs.37,400-67,000) with AGP of Rs. 9,000/- and will, however, continue to be designated as Assistant Professor.

End of Update.]

But the IIT-P ad appears to suggest that APs will be placed directly at PB-4 with Rs. 9000 of AGP.

Either the recruitment ad has wrong information about the AP salary, or IIT-P is getting far ahead of the pack in exercising its autonomy.

Sunday, October 18, 2009

Superfreakonomics


From the way the chapter in Superfreakonomics dealing with global warming is being fisked, Steven Levitt's reputation as an academic appears headed for a steep fall. Levitt has promised a detailed defence, so we'll wait to see how this one plays itself out. In the meantime, here are some links:

[Update: Extended excerpts from that chapter may be found here, while a low-quality pdf of that entire chapter is here. This post has lots more links.]

  1. Paul Krugman: Superfreakonomics on Climate: Part 1, Weitzman in Context. From the second post:

    Levitt now says that the chapter wasn’t meant to lend credibility to global warming denial — but when you open your chapter by giving major play to the false claim that scientists used to predict global cooling, you have in effect taken the denier side. The only way I can reconcile what Levitt says now with that reality is that he and Dubner didn’t do their homework — not only that they didn’t check out the global cooling stuff, the stuff about solar panels, and all the other errors people have been pointing out, but that they didn’t even look into the debate sufficiently to realize what company they were placing themselves in.

    And that’s not acceptable. This is a serious issue. We’re not talking about the ethics of sumo wrestling here; we’re talking, quite possibly, about the fate of civilization. It’s not a place to play snarky, contrarian games.

  2. Climate Progress: Error-riddled Superfreaknomics -- Part 1, Part 2, Part 3, Part 4

  3. William Connolley stops after finding the first 10 errors in the chapter.

  4. Tim Lambert: Why everything in Superfreakonomics about global warming is wrong.

  5. Matt Yglesias: Journalistic malpractice from Levitt and Dubner, Dubner digs the hole deeper.

  6. Ezra Klein: The shoddy statistics of Superfreakonomics.

See also Felix Salmon who uses an example from the first book to suggest that "the Freakonomists have a history of misrepresenting environmental science."

Saturday, October 17, 2009

IIMs get more autonomy?


HRD Minister Kapil Sibal met IIM directors yesterday, and has announced a bunch of initiatives he claims will give more autonomy to these premier B-schools. A new, Pan-IIM 'collegium,' which will choose IIMs' Board members as well as their directors, is being projected by both the minister and the IIM directors as an important part of the package.

Most of what has been reported is from what the participants have said; but the devil is in the details, and they are usually found in some document. So, let's wait for a document to emerge; the wait may not be long, since the IIMs have been given three months to prepare a 5-year plan.

In the meantime, here are the news reports:

  1. Charu Sudan Kasturi, in The Telegraph, cuts to the chase right in his opening paragraph:

    The Centre will stop directly appointing members of IIM governing boards, creating a selection mechanism that may grant the institutes greater autonomy from the government but could curb their independence from each other. [Bold emphasis added].

  2. Pallavi Singh, in Mint, gets Bhargava to say that the proposed 'collegium' doesn't look all that different from the pan-IIM board recommended by a committee headed by him:

    “A collegium sounds very similar (to a pan-IIM board) to me. The purpose of the board was also to help in running the IIMs and the constitution of the collegium is also the same as proposed by our panel. It’s a good decision in the sense that at least there will be a collegium now,’’ Bhargava said.

In a news report before the meeting, director of IIM-B, Prof. Pankaj Chandra was quoted as saying this:

"The more important issue is the government's inability to make the IITs and IIMs truly world-class institutions and to let go of control," said Pankaj Chandra, Director, IIM Bangalore.

"Look at the way governments in other countries support and enable their government institutions. The government of Singapore has made NUS (National University of Singapore) fantastic, and the Chinese government has enabled Beijing University and Hong Kong University of Science and Technology. Should Indian government not do the same for its institutions?" asked Chandra, a PhD from the Wharton School of the University of Pennsylvania, who taught for 10 years at IIM Ahmedabad (IIM-A) before moving to IIM-B.

"Once the budget for the IIMs is decided, all decisions should be left to the Board of Governors. The selection of the director was done by the respective Boards before M.M. Joshi (former HRD Minister) brought it under the preview of the ministry," said Chandra.

Devesh Kapur on a goals-driven strategy for India's higher ed


On this Deepavali day, here's something to light up the debate on India's higher education priorities.

In his ToI column, Starting Point of Higher Education, Devesh Kapur focuses on "the lack of clarity in thinking about the fundamental underlying question: What are the goals of Indian higher education?". He then goes on to pose a bunch of questions in order to clarify where India's higher ed priorities should be.

The most discernible instrumental outcome of higher education is its links with and impact on labour markets. Let us say one of its key goals is to provide skills to a very large number of new entrants to the labour force. But then, should one invest in IITs or ITIs? Suppose we want to leverage the human capital resulting from investments in higher education to improve Indian health care. A supply chain of health care would require doctors, nurses and paramedics, pharmacists and lab technicians, hospital administrators and even accountants. If the goal then is better societal health outcomes, where should resources be directed? In India, investment in the human capital of nurses and paramedics might matter much more than specialist physicians, and in civil and environmental engineers who can ensure clean water and sanitation much more than the high-tech engineering behind MRIs. But what do we do? When we think of skills we are obsessed with IITs; when we think of health care we can scarcely think beyond doctors.

Friday, October 16, 2009

The first Polymath project-- A thriller!


The working record of the Polymath Project is a remarkable resource for students of mathematics and for historians and philosophers of science. For the first time one can see on full display a complete account of how a serious mathematical result was discovered. It shows vividly how ideas grow, change, improve and are discarded, and how advances in understanding may come not in a single giant leap, but through the aggregation and refinement of many smaller insights. It shows the persistence required to solve a difficult problem, often in the face of considerable uncertainty, and how even the best mathematicians can make basic mistakes and pursue many failed ideas. There are ups, downs and real tension as the participants close in on a solution. Who would have guessed that the working record of a mathematical project would read like a thriller? [Bold emphasis added]

That's from Tim Gowers and Michael Nielsen, writing in Nature about the first Polymath project that Gowers started on his blog.

Blogging: "Any idiot can do it, and many do."


John Baez on what mathematicians need to know about blogging:

[...] I could describe how to set up a blog, but that would make it seem harder than it is. Any idiot can do it, and many do. Websites like Wordpress and Blogger will lead you through the process step by step— and they’re free.

And he comes back to this remark a little later:

Should you blog about mathematics? ... Some mathematicians are too worried about making a fool of themselves in public to enjoy blogging. Others are too afraid of offending people. And if my joke about ‘idiots’ upset you, blogging may be too hard-knuckled for you.