An architecture for non-linear discovery of aggregated multimedia document web search results

• Published in: PeerJ. Computer science 2021-04, Vol.7, p.e449-e449, Article e449
• Main Authors: Khan, Abdur Rehman, Rashid, Umer, Saleem, Khalid, Ahmed, Adeel
• Format: Article
• Language: English
• Subjects: Agglomeration; Architecture; Data Science; Database searching; Exploration; Exploratory search; Information discovery; Information retrieval; Information services; Internet service providers; Internet/Web search services; Multimedia; Navigation; Online information services; Online searching; Online services; Queries; Relational aggregated search; Relevance; Search engine; Search engines; Semantics; User behavior; User interface; User needs; Web; Web sites; World Wide Web and Web Science
• ISSN: 2376-5992; 2376-5992
• DOI: 10.7717/peerj-cs.449

The recent proliferation of multimedia information on the web enhances user information need from simple textual lookup to multi-modal exploration activities. The current search engines act as major gateways to access the immense amount of multimedia data. However, access to the multimedia content is provided by aggregating disjoint multimedia search verticals. The aggregation of the multimedia search results cannot consider relationships in them and are partially blended. Additionally, the search results' presentation is via linear lists, which cannot support the users' non-linear navigation patterns to explore the multimedia search results. Contrarily, users' are demanding more services from search engines. It includes adequate access to navigate, explore, and discover multimedia information. Our discovery approach allow users to explore and discover multimedia information by semantically aggregating disjoint verticals using sentence embeddings and transforming snippets into conceptually similar multimedia document groups. The proposed aggregation approach retains the relationship in the retrieved multimedia search results. A non-linear graph is instantiated to augment the users' non-linear information navigation and exploration patterns, which leads to discovering new and interesting search results at various aggregated granularity levels. Our method's empirical evaluation results achieve 99% accuracy in the aggregation of disjoint search results at different aggregated search granularity levels. Our approach provides a standard baseline for the exploration of multimedia aggregation search results.