Wednesday, November 14, 2007

Qualifying and Quantifying the Physical Sciences

It's nice to know that it is not only in social sciences such as sociology and linguistics where there seems to be a qualitative/quantitative divide -- today, Female Science Professor, an anonymous female professor in the physical sciences, also discusses the debate between quantitative and non-quantitative methods in her field and the gendering that is associated with the assumptions of who is a qualitative and who is quantitative methodologist.

Her basic message, and one I hear often repeated by people who glorify statistics[1], is twofold. First, there is an assumption that quantitative methods arrive at some "true" answer. Now, this is, of course, true. Most statistics will give you a true answer in the sense that the computer program will give you a number best fit to the data of a given sample that is the most accurate answer to that problem. But, what is particularly important in what she says is where this runs into problems:


You can always get a number, but even if it means something.. what does it mean? (i.e., the number itself is not an end in itself, you have to think about it).

Just because one can get a number means that one has to be able to articulate A) what that number is, what it means, how it should be interpreted, etc. and B) what assumptions were used to produce that number. Now, those who glorify statistics, will indicate that this is the true number for which we should base all of our knowledge. The problem is that there are statistical assumptions made about the derivation of that number (i.e. sampling error and modeling error), not to mention the methodological concern over how the question was worded asked, primed by previous questions, etc. (i.e. measurement error; see my earlier post on that topic). Qualitative researchers often challenge quantitative researchers on what that number means and, in my experience, quantitative researchers often overly exaggerate the meaning of the number, particularly if it revolves around something like culture, attitudes or beliefs—things that are often complicated and nuanced.

On the other hand, I have seen qualitative researchers argue that, because of the assumptions required for quantitative methods, all of the findings are invalid. The problem here is that all analysis, by definition, requires that assumptions be made. Just because one has a more nuanced version of reality in qualitative methodology does not mean that it is not prone to errors as well. The sample might not be representative, informants might have the desire to be friends and not discuss difficult topics with the analyst, processes might be true for this subset, but it might be because of that subset's particular social position.

Although this is at this point dogma in sociology, the only way to appropriately address many questions is by some combination of quantitative and qualitative methods. But, here is where I see FSP's second issue arising: quantitative methods are seen as particularly rigorous because they require an understanding of math, equations, and statistics. These are also areas that are traditionally dominated by men. Qualitative methods are seen as feminine and not very difficult. The theory goes that anyone can talk to someone, where's the difficulty in that?[2] These comments, I find, often come from people—particularly when they find people in the media—who have a severe lack of understanding of statistics and don't realize the assumptions inherent in statistically analyses and blindly trust the all-holy "Number."

While there is beginning to be an appreciation of such topics, the understanding of statistics and math to be "difficult" (and, thus, by extension professors who are able to use that methodology indispensable) and qualitative methods "easy", that this is going to do a great disservice to both sociology as a whole. A large part of the problem, as I see it is the lack of cooperation between qualitative and quantitative sociologists. Grants are so scarce as it is, we are afraid to try and write anything beyond the proscribed standards to work with teams that might look at problems in both directions. Or, alternatively, individual researchers try and take on both components themselves many with great success. The problem I have found with this goal in my own development is that it is very difficult to be on top of methods in two very different methodological traditions and to produce anything that can pass muster in both qualitative and quantitative fields. I don't have enough time in my graduate career to do both well - maybe it might come when I have my first job or a postdoc, but it seems a severe disservice to the pursuit of knowledge to maintain these divisions. This division seems particularly severe for people associated with qualitative methods - particularly when that assumption (as is the case with FSP) is wrong and based solely upon one's gender!

[1] I am not positive that she is discussing statistics, this is the world in which I live, so I will go on that for my purposes.
[2] This is where I am sure that there is some difference in what FSP does and what qualitative sociologists do; unless there is some branch of the physical sciences wildly different than what I thought of the physical sciences -- talking to particles and all.

Friday, November 9, 2007

Academic Freedom is Us

I feel very good to have finally fulfilled a long-standing promise to start posting away from my home here at Free Exchange on Campus. The blog is one of the major components of the work being done by the Fre Exchange Coalition. The Coalition was set up in order to counter the kinds of outlandish and false attacks by David Horowitz and others on true academic freedom in our nation's colleges and universities[1].

The problem with these people is that, in the cloak of arguing that they are attempting to "eliminate liberal bias" in the classroom, they are arguing that there should be a kind of litmus test applied by the states in order to make sure that classes being taught are "fair and balanced" (in the FOX News sense of the term). Seriously, they have proposed legislation on the issue and even acquired floor votes in some state legislators. The goal is not to increase diversity, but to go back to the standard "Great Man" theory of teaching (specifically using Universities to teach how great America is because of the work of now-dead old-white-men).

The problem with all of this is that, just like the media being attacked for a liberal bias, Universities are overly conscious of something that is probably not a wide-spread problem and it stifles debate on campuses around the country. Although this is not the only problem facing academic freedom (lack of tenured faculty lines would be a good example of another), the fact that true academic freedom is under attack at all is very disconcerting and something that needs to be addressed. Hopefully this effort will be one part of that.

Anyway, you should check out the blog and my first post.

[1] For a great example of the kinds of things that they propose, check out Islamo-Fascism Awareness Week. Of course, don't take everything there at face value, check out TPM's coverage on Horowitz's inaccuracies and exaggerations.

Tuesday, November 6, 2007

I'm Feeling Alright

About the prospects of Democrats in my new home state given that both Clinton and Obama would beat Giuliani in a state-wide general election right now. Clinton by 15 points and Obama by 5 points. Although early polls don't necessarily mean that much, it is nice to know that Rudy's megalomaniacal delusions aren't even working in his home state.

Now, granted that I am not positive that Clinton would be the best candidate for the job of President, or even that she would be the best Democrat currently running for the position. On the other hand, I do know that she will be better than race-baiting, police-state advocate Giuliani.

Saturday, November 3, 2007

Roundup

Because my efforts to get back the bloggy back after being on vacation have been stalled by a trip to Ann Arbor to work on my work (that sounds funny, but is actually true) so that I might be able to forgo the "graduate student" title and move onto "professor" or "Dr.", I thought that I would just do a roundup for the time being and hopefully move onto more productive blogging in the future.


  • Speaking of becoming "Dr." as opposed to a lowly graduate student, the future Dr. Warner moved to a new site that she hopes to keep going after she is a grad student. I hope she does, because her posts are always fascinating for anyone in grad school, but particularly those in sociology programs. Check out her new site. I'm not sure if there is an appropriate web version of the housewarming present - any suggestions are welcome.

  • On the other hand, Jeremy Freese has declared a hiatus because he is afraid of becoming "some kind of peculiar jester-statesman for my discipline." While I certainly do not believe this to be true and respect Jeremy for the decision, it is sad to see such a great voice leaving the blogosphere; and, it appears that most people who took the poll agree with me. But, it was good to see that he did have a brief post titled "entr'acte" today, hopefully this means that there will be more to come.

  • Speaking of being between acts, I will hopefully be in that state soon as my advisors told me that they think that I should be able to send out my paper which means I will be on to my dissertation.

  • Which reminds me that Dave ran away from Big Purple, but at least his Ducks are ranked number 5 in the BCS which I hope helps. Given his frustration with the labor movement's lack of appreciation for young people--a topic on which I completely agree (and, agree is a problem on the left more generally)--I hope that it is for the best for him.

  • Another cool kid from the GTFF wrote a great post about why economic rationality and "just-in-time" professorships are bad for academic freedom.

  • Oh yeah, you should also check out another great rant about the ages.

  • Is it just me, or do other people not care about the presidential primary anymore, particularly whether Clinton is "playing the female card" a) because she's not; b) because if she were, why is it a bad thing to point out that she is the only woman in the field; and c) because it is really hard to take Matt Lauer seriously.

  • But, all is not glory in the Clinton camp, either. I seem to remember some saying about foxes and hen houses. Not only does the company that Mark Penn, Clinton's pollster and a top advisor, serves as the CEO defend Cintas, a notoriously anti-union company that broke OSHA standards so badly that the administration fined them for killing an employee, his company also works to improve Blackwater's image. His excuse on the first account, he doesn't personal work on that campaign (though, presumably he makes money from it). On the second--get this--they outsource the work for Blackwater. That's priceless.

  • And, while I'm on the topic of pollsters and the campaign, I should mention a great initiative by another pollster (on the other side of the spectrum from Penn), Mark Blumenthal from Pollster.com is undertaking what they he is calling the Disclosure Project to get polling companies to release the details of their methodology.

Off to bed with me now so that I can work on getting my own survey results written up tomorrow. I am sure that there is much more that I missed, but I hope to maybe start catching up on my bloggy activities, maybe even post something substantive. I know, shock!

Friday, October 26, 2007

Productive no more

Necessary work productivity has trumped blog productivity this week and it was going great until today. I was moving on a project that I have been really excited about, but has been on the back-burner for the past several months. Instead of just admitting that this project has taken the position next to the tea kettle that is never used in the summer months and writing my more senior collaborators on the project to this effect, I continued to delude myself into thinking that I was going to get it done. Of course, this meant long periods with little work and great disappointment or other periods where I would get such minimal work done on the project that it was laughable that I would even send it to the other collaborators.

Anyway, this week, I made huge strides forward towards accomplishing the basic analysis of this project. I either obtained or created all of the variables necessary to replicate a previous analysis, completed all of the data management tasks to line up the proper hierarchical structure and even conquered Stata's best attempts to get me to give up on using Sean Reardon's Stata interface for HLM[1]. Anyway, I got all of the analysis complete and then I tried to figure out how to run spatial analysis in Stata. Needless to say, it doesn't come with a built-in package and my old process has been to use a separate program, GeoDa, to do all of it.

I am, however, quickly getting tired of having to use three or four separate software packages to work on a single problem. Therefore, I again invested the time in attempting to figure out how to use a spatial analysis package built for Stata. That is where the "things were productive until today" part enters. I could not, for the life of me, figure out why I could not get this to work. First of all, the package requires four separate utilities just to get the data formatted properly for analysis and each step compounds any problems created in the previous steps. Anyway, I finally figured out that I had a single missing value in a single observation which was holding the whole thing up. Then, when I finally got the proper data form to get the program to run, it didn't agree with the values that I got in the other program, making me wonder why they come up with different results which means more time trying to figure out the shady underbelly of programming even though any programming knowledge I do have is self-taught meaning that it is both laborious and probably wrong meaning more potential delays in this project.

Therefore, following ash's excellent example to productively (hopefully) blowing off steam, I dedicate this entire day to hating a) Stata programs that are difficult to figure out; b) Stata programs that don't work and c) loss of productivity to said problems.

And now, I am sure that you are hating me now for writing such a boring post. G'day.

[1]For anyone who uses both Stata and HLM, it is worth the time investment to get this program set up and learn how to use it. No more switching back and forth between data management in Stata and analysis in HLM. Of course, I guess you could also just use SAS, but learning a whole new programming language is not an investment I want to make right now...

Wednesday, October 24, 2007

Home Again, Home Again, Jiggity Jig

In order to appease dr and thank everyone for their well wishes and congratulations, I want to keep this post short to do that.

E. and I don't have any pictures in digital format, yet, but I will definitely post some when we figure out how to get them onto my computer (and by "we", I mean "I" because E. is very good at doing this. Somehow every time I try to get pictures off of the camera I manage to either a) freeze my computer, b) freeze the camera, or c) both. Therefore, I will let E. figure out how to get them on her computer and I will get the files from her). And let me just say that Italy has to be one of the most romantic places in the world - it was so incredible to finally go. We had such a good time that we already want to go back! A full run-down of the amazingness of Italy to follow when I am at least a little caught up with work.

Wednesday, October 3, 2007

Farewell for Now


Although I am sure that there will not be much difference from my relative lack of posting recently, but tonight I am off to Maryland for the last preparations for getting hitched so there will be no posts until my return. There are three more days to the wedding and I am hoping that the weather holds out for the ceremony. I can feel the butterflies in my stomach already. Then, it is off to Italia, where I am sure that I will find much to report and maybe some pictures to share when I get back. In the meantime, here is one to tide you over (link) to tide you over.

I hope everyone has a great couple of weeks!!!