You can try DeepMiner. It is good for scrapping, rank position, generating long tails and keyword suggestions. You can export the data to document for later analytics. You can find popular keywords that people are searching for. 7 major engines are supported, Google, Yahoo, AOL, Amazon, YouTube, Ask, Bing. It supports multi-threading so it is very very fast scrapper. BTW you must use proxy list if you plan to scrap thousands and thousands of keywords.
So whilst Long Tail Pro has just continued to grow in revenue every single year and comes highly recommended, you may want to check if all the important features are fully functioning before signing up. Especially the KC feature (keyword competitiveness) as it is so fundamental to keyword research and making an informed choice on whether or not to go into a particular niche.
2) SpyFu: I suggest to have paid account on SpyFu. I just need to find my competitors who using Adwords and review them using this tool. It will show me what ads and keywords they are using. Note that my competitor who paid for that particular keyword knows exactly that it is important for his business including recent trends. Also using SEO feature you can input any URL and find our which keywords they are ranking for.
Curious if you’ve found a way to efficiently find underperforming keywords? Currently I have to manually click on each and every keyword to calculate it’s Keyword Competitiveness. Frustrating clicking it hundreds or even a thousand + times. I’d rather just add it as one of the scan settings and wait 8 hours for it to run all 1000 than having to manually click them for an hour and then waiting…
This makes Google Suggest a relevant source for keyword research, it contains a large amount of organic keywords very closely related to a full or partial keyword and can be used to find additional most searched appending keywords that make the whole keyword less competitive. Google Suggest can be researched through the Google Search website or through a compatible browser for a small amount of keywords but also in large scale using free scraper tools.
Finding the best keyword research tool also depends on your own experience with SEO subjects such as buying keywords, long tail content, long tail SEO and using low competition keywords. For instance, a newbie looking to use long tail marketing may find something like Long Tail Pro V3 a little too confusing and a bit expensive as it’s a monthly fee and has a confusing interface.
We’re not here to dwell on the good and the bad of Google’s decision. I personally am elated that this debate has brought the crucial SEO function of Keyword Research into the limelight once again. There’s more to it than taking the first 10 results from the Google Keyword Tool and scattering them left, right and center in your content. Savvy keyword research is what separates strategists from headless chickens.
The limit on manual keywords could be higher. I personally wish we could input 10,000 keywords at a time, instead of 200. However, I understand the costs that Long Tail Pro has to maintain each time a new manual keyword is input. Not a deal breaker, I just wish the limit was higher. (To be fair, I don't think most keyword tools have a bulk manual option at all).