Finding Data Using HapPhi Super Search is sexy

Image Source: FreeImages

‍

Finding data is an important part of being a data scientist. The more interesting and novel your data, the better. But finding good datasets can be challenging. There’re a lot of databases out there, but most of them are boring: for example, standard lists of company records or statistics about some business process. If you want to find something more interesting, you’re probably going to have to work for it. Here are the best ways we’ve found to track down datasets that aren’t just light reading.

Datasets in Public Domains

If you’re looking for a standard business dataset, you’re going to have to dig a bit deeper. We’ve found that most standard databases (e.g. public sector databases, industry statistics) are published by government organizations, NGOs, or standard publications. The best way to find these types of datasets is through Google. Simply search for the type of data you’re looking for and the name of the industry you’re interested in, and see what comes up. For example, if you want to find a dataset on the retail industry, you could search Google for “retail sales statistics”, or “retail industry data”.

Finding data in industry publications

If you want to find a unique dataset, you’ll need to look outside the standard publication databases. Here are some places you could try: - Trade publications - Many industries have publications that discuss trends and product reviews. Find out who writes these publications and see if they’re willing to sell you the data they used to write their articles. - Conferences - Conferences are great places to find interesting data. Presenters usually publish their slides online, and sometimes they even publish the data they used to create the slides. - Internal company reports - If you’re working at a company, you can often find internal reports that discuss the company’s strategy for a particular product line or market. - Internal company data - If you work for a company, you may have access to internal data. You may even be able to publish that data externally.

Finding data on Hacker News

Hacker News is a news aggregator site popular with developers. If you’re trying to find interesting data, this is a great place to look. Hacker News has a “top” section that lists the most popular stories of the day. You can see a sample of the data published to Hacker News by clicking the “top” link for any given day. You can also use HapPhi Super Search to find datasets published to Hacker News. Simply enter the keywords you’re interested in (e.g. “meteorites”, “gender gap”), select “Hacker News” as your search engine, and click “search”. HapPhi will show you a list of all the recent stories that have been published to Hacker News. You can click on any story to see the article, comments, and relevant datasets.

Finding datasets in Academic Research Papers

Academic research papers are great places to find data. Papers are published by researchers at universities around the world, and many of those researchers publish their data along with the paper. You can find academic papers on a variety of topics, like business, marketing, social issues, science, and more. You can also search for papers using Google, or you can use HapPhi Super Search. To find datasets in academic papers, simply enter the keywords you’re interested in (e.g. “influencer marketing”, “gender gap”), select “Google Scholar” as your search engine, and click “search”. HapPhi will show you a list of all the recent articles published with those keywords. You can click on any article to see the paper, comments, and relevant datasets.

Finding data on Reddit

Reddit is a social networking site that’s very popular with data scientists. The site has thousands of active communities, each with their own topics and interests. If you can find a relevant community, you can find data published there. You can find topics on Reddit by searching for keywords, or you can use HapPhi Super Search. To find datasets published to Reddit, enter your keywords (e.g. “influencer marketing”, “gender gap”), select “Reddit” as your search engine, and click “search”. HapPhi will show you a list of all the recent articles published with your keywords. You can click on any article to see the article, comments, and relevant datasets.

Finding data at conferences

Conferences are also great places to find data. Most conferences publish their datasets along with their papers, and many conferences also publish their data online as standalone articles. You can find conferences by searching for them using Google, or you can use HapPhi Super Search. To find conferences that publish data, simply enter the keywords you’re interested in (e.g. “influencer marketing”, “gender gap”), select “Google Conferences” as your search engine, and click “search”. HapPhi will show you a list of all the recent conferences published with those keywords. You can click on any article to see the conference, articles, and relevant datasets.

Summary

The best part about finding datasets is that you never know what you’ll find. You can find something truly unique and interesting, or you can end up finding nothing. You have to be willing to spend the time searching, but the rewards can be worth it. Finding data is an important part of the data science process, and finding good datasets can be challenging. If you want to find something more interesting, you’re probably going to have to work for it. Click here

‍