Information Discovery on Big Data, from Document Search to Entity Search

Dr. Yi Chen
School of Management, NJIT


With data volume ever growing, information discovery becomes increasingly challenging in the big data era. While Web Search Engines have been successful in finding relevant documents among trillions or quadrillions of documents on the Web, they are insufficient to satisfy the needs of web users for entity searchers, such as products, bibliographies, and social networks. The information discovery processes are further complicated by the prevalence of uncertain data, diverse interests of users and profit consideration from publishers. In this talk, I will discuss the challenges and some of the solutions that we have developed for entity search, and then discuss open questions and ongoing efforts supported by a recent Google Research Award.