[RD] Conducting a Survey for my Political Science Class

If it's a class exercise, the point is just going to be showing that you know how to construct a survey and analyse the data. The sample isn't really important, because the conclusions you're drawing will refer exclusively to the sample. The topic is going to be down to a matter of personal preference, whatever helps the student construct a coherent survey.

This. The assignment is more on me able to know how to conduct a valid survey and how to interpet the collected data, rather than being able to do methodologically create an unbiased sample (as someone else asked me on IOTchat) or to make any grand statement on the matter. We had free range to choose whatever topic we wanted, and, if ask a trans is any indicator, you should really know I am into trans activism. Hence making trans civil and legal rights the topic of my survey.

I am also pleased to announce that I got way more than I needed in terms of responses. I am going to be doing the rest of the assignment tonight. I am not going to be posting my entire analysis here, but I am willing to give a short tl;dr on any interesting information I find.
 
did you get an A

I got a perfect 10/10. She even approached me after class to say she really loved my topic and novel approach to the problem. Did get chastised for especially poor sampling, but I was self-aware in the paper to realize that this was not really a good idea for a scientific survey, and even included a tentative plan to do random sampling on online communities if I ever tried this again.

As I promised, general conclusions from the data:

Firstly, the sample size wasn't large enough that SPSS, the program I was using for interpretation, was not confident in its calculations. Therefore, with one notable exception, I got relatively low lambda scores. For people not in social sciences, the lambda score is the value of correlation between two nominal values (aka, values with no inherient numerical value, which is what all my values were), or a nominal and an ordinal (which does have a numerical value, but is not a raw number with clearly defined values. Basically, ranges or abstract comparisions like "rate from 1-10 how likely you support something"). It can range from 0 to 1; the closer it is to 1, the stronger the relationship is. The actual calculations is pretty blackboxed to me (this is why I am in political science and not math lol), so not going to bother explaining how it works. But theoretically, a lambda score of about .1 should be about enough to prove something is going on between the varibles, albeit weak.

Secondly, all you idiots are way too homogenous when it comes to demographics. 93% of all responses were cismales, and 72.7% were the same political affiliation. I had to scrap my demographical analysis because there was no way I was going to get any meaningful data from it* >:c

As for what I was looking for, my working hypothesis was "[People] with empathy towards trans people are more likely to support pro-trans public policy". Empathy is a bit hard to operationalize, so that was kind of the point of the first part of questions. I asked basic questions which measured if you were trans (because everyone is empathic to themselves!), if you knew a trans person, and two questions which exposed hidden biases towards trans people. So...

I'm not actually endorsing any position on this, but "cultural drivers" and "chemical environments" are both excluded by the "is it innate or a personal choice" question, both of which my bias tells me seems more likely than the answers provided.
I know it isn't really a meaningful option as it doesn't answer the question, but I'd love if I could've answered "It really doesn't matter, people should be allowed to choose or be as they choose or are" or something similar under the "innate or personal choice" question.

That is why I asked the questions the way I did. Because those who believe transgender identification is a choice were operationalized as being less empathic compared to people who said it was innate. Likewise, those who refused to date trans people were also considered to be less empathic as well. I know some of you are going to complain to me that just because they wouldn't date me or think I chose to be trans doesn't make them less empathic to me and that they aren't transphobes. I promise in advance I will only respond with sarcastic gifs involving the letter K to such complaints.

So, in order to make sure I wasn't writing a 40 page paper, I only looked at what I thought were the most contentious questions of both section II and III. That ended up being Tertiary Operations and Birth Certificates, respectively. I then measured each intake question (with the exception of if you personally identified as trans, because it was so lopsided in favor of cis people that I wouldn't get anything meaningful out of it) as the independent variable, with those two as the dependent.

Firstly, knowing a trans person had basically no effect at all how you responded to either question. The lambda score for knowledge of trans people versus support of tertiary surgeries was a clean .000, in fact. Simply knowing a trans person did not make you more empathic.

However, the relationships for the hidden biases did give middling support for a weak relationship to both questions. They ranged around .1, with two tied at the highest being .148. Again, that's enough to say that there is a weak relationship between my variables, but it's not that predictive. Having only 45 respondents was a big problem in that regard, unfortunately. If I had more cases, it might have spit out more favorable numbers towards me.

Interestingly enough, in some cases, I actually got unusually high lambda scores if I swapped what was the independent and the dependent variables. For example, if I made support of changing trans birth certificate my independent varible, and knowing trans people my dependent variable, the lambda score rises to the high .409. That's a huge correlation, considering my lack of reponses. That also doesn't make any logical sense, because knowledge of trans people clearly does not rely on your convictions of trans public policy. SPSS will calculate illogical things if its theoretically possible; part of good interpretation is knowing what outputs are illogical horsecrap :p

In general, I concluded that there was a promising start to my hypothesis, but there was too much sampling error and lack of responses in teneral to make any of it significant.

*Theoretically I got enough varied responses for age and country that I could have tried to use them, but my report was already long enough that I decided to not bother with demographics at all.
 
Last edited:
That is why I asked the questions the way I did. Because those who believe transgender identification is a choice were operationalized as being less empathic compared to people who said it was innate. Likewise, those who refused to date trans people were also considered to be less empathic as well. I know some of you are going to complain to me that just because they wouldn't date me or think I chose to be trans doesn't make them less empathic to me and that they aren't transphobes. I promise in advance I will only respond with sarcastic gifs involving the letter K to such complaints.
Do I really have to complain about this to find out what those K-gifs are about, or would you be willing to post a few samples?
 
Secondly, all you idiots are way too homogenous
You should have included a question on what games we play, and if we still play Civ! :D

Likewise, those who refused to date trans people were also considered to be less empathic as well.
Out of curiosity, was it possible to get a statistically valid correlation between that question and the other indicators you used for measuring empathy towards trans-people?

*Theoretically I got enough varied responses for age and country that I could have tried to use them, but my report was already long enough that I decided to not bother with demographics at all.
But that could be the most fun to know!

Oh, and finally: What was the general support for tertiary surgery and birth certificates?
 
You should have included a question on what games we play, and if we still play Civ! :D

I highly, highly doubt that would be useful infomation. :p

Out of curiosity, was it possible to get a statistically valid correlation between that question and the other indicators you used for measuring empathy towards trans-people?

Actually, the dating question got me the strongest relationships of all the values I tested, with the correct independent variables. Your williningness to date a trans person was the best indicator on how supportive you were with trans rights, with the more willing you are, the more likely you are to support trans rights. Again, only a week relationship, but also only 45 responses.

But that could be the most fun to know!

I can see if I can pull that up next time I am on a computer.

Oh, and finally: What was the general support for tertiary surgery and birth certificates?

On tert surgeries:

53.3% supported single payer coverage
8.9% supported a private mandate
22.2% aupported neither while not being opposed to single payer
0.0% did not support single payer system at all*
15.6% were unsure

On changing birth certificates:

66.7% said yes in some degree:
60% of yes responses (40% overall) were ok with choice straight after diagnoses
23.4% of yes responses (15.6% overall) wanted an indertiminate time of living as their perferred gender before being allowed to change, with no requirement if SRS
16.7% of yes responses (11.1% overall) only agreed to change after SRS
20% were completely opposed
13.3% were unsure

*Interestingly, people did awnser this response on the other two, which is odd.
 
Last edited:
If that really was just CFC members taking part, then I find it weird that more than half of the 45 correspondents were in the 19-24 age group.
 
Just a nitpick: I've known transpeople, but I'm not currently around or in contact with any.
 
The google account requirement may also effect the age profile.
 
Just a nitpick: I've known transpeople, but I'm not currently around or in contact with any.

Eh, that would count as a yes to me. :dunno:

The google account requirement may also effect the age profile.

I mean, perhaps, but I needed a way to verify that people werent stuffing the ballots. We are all tech savvy here; I figure anyone who wasnt against Google as a concept could have just made a throwaway google account.
 
I do not have a google account and do not know how to open one.
I assume it is easy to open one but why should I and other people go to the trouble of opening one.
I have done other surveys on CFC but they did not require this effort, little as it probably is.
So you are selecting people who already have a google account or are willing to open one.
This will skew the results towards younger responders.
 
I do not have a google account and do not know how to open one.
I assume it is easy to open one but why should I and other people go to the trouble of opening one.
I have done other surveys on CFC but they did not require this effort, little as it probably is.
So you are selecting people who already have a google account or are willing to open one.
This will skew the results towards younger responders.

I'm pretty sure if you have Gmail then you also have a Google account. I just sign in with my email address.
 
What shadowplay says is true; if you have a gmail, that is a google account. I use the term google account because its more than just gmail; my school email with the domain brockport.edu counts as one too because of a partnership my school has with google.
 
It may well be but i did not know that. I had no idea what a google account was.

I have just googled google account it asks for a mobile number and e-mail address.
Why would I want to give them to google.
 
Google already has that information, I guarantee it.
 
Most likely does but that again selects for people who already know that who are likely to be younger.
 
Eh, I think this is a you problem, not an age problem. I got plently of people across the spectrum in terms of age. I think the "I encouraged a lot of people on IOT to take the survey, who most of you don't directly interact with and are on the younger scale", is a much more sound theroy.
 
If you wanted a more diverse data set you shouldn't have asked on CivFanatics. We are all pretty much clones of the same person here in terms of our demographics if you ignore age and ethnicity for a second.

It's like going out to a pasture with cows in it and then being surprised that all the cows are female, produce milk, and dislike coyotes, whether they are 4 years old or 12 or however old cows get.
 
Back
Top Bottom