Don't be discouraged. Scientifically, it doesn't seem to be true that some languages are objectively harder than others, with a few exceptions: http://www.economist.com/blogs/economist-explains/2013/08/economist-explains-19
If you speak English, French is very attainable. The vocabulary overlap is tremendous.
It's true that the French spelling system takes some getting used to, but the reality is that the hardest part about speaking French is just learning a huge vocabulary and getting used to the "sound" of it, which is the hardest part about every language. The spelling-to-pronunciation rules are a little unpredictable and weird, but once you learn about 20-30 rules, there are very few exceptional spellings to learn.
In fact, French verb conjugations are not so bad, if you're willing to spell things wrong but pronounce things right. Even if you get it wrong, the subject pronoun is mandatory, so you won't have problems being understood or understanding people once you learn the tense endings. Contrast Spanish, where mastering conjugation is essential to even basic conversation.
In my opinion, the classification of verbs into three categories is a little obsolete -- it may be useful to native speakers or people interested in the history of the language, but to learners, I'd make three non-conventional categories:
1) regular -er verbs. "one radical" 2) otherwise-regular verbs where plural present does not sound like singular present 3) highly irregular verbs.
Then category 3) is a short-list (10 or so verbs that you really use in everyday life), category 2) is a long list but completely robotic once you get the pattern, (including the type II -ir verbs but also a lot of verbs that are classified as type III currently) and category 1) is easy.