Impressions from Findability Day 2013

We at Findwise host Findability Day to raise awareness of the importance of enterprise search and search in business, big data and to share best practices in implementation and management as well as inform about technology developments. Attending and being part of Findability Day this year was a real energy boost for all of us at Findwise. We were about 200 attendants all with focus on search and big data.

On stage, we had some very inspiring presentations. Martin White explaining the journey of search and pointing out its future direction showed how the principles of search have been around for decades. What we use it for and how we approach it is key along with enabling technology. Martin has also written a blog post about his impressions from the event, read it here.

Ravi Mynampaty of Harvard Business School showed how the search journey has evolved within Harvard Business School. One take away was the importance of step by step implementation and ensuring satisfied stakeholders along the way. Christian Finstad of Meltwater explained how they connected business values with technology to convince their clients. I think an internal decision within an organization needs similar argumentation in order to win acceptance.

Johan Johansson gave a thorough presentation about the search project at the Municipality of Norrköping. This was a tight budget project with strong deliverables. One thing to remember from Johan was his talk about “you need to try it out yourself – do the most common searches and experience it”.

DJ Skillman from Splunk, Troels Walsted Hansen from Microsoft and Daniel Bergqvist from Google gave some interesting insights into new technologies. How Splunk can be used to just harvest every imaginable data type, just bring it in and worry about using it later. How Google want to align enterprise search with consumer search and Microsofts Facebook inspired developments within graph search.

We also had some great breakout sessions with Jonas Berg, Svensk Byggtjänst who showed us their partner search application, Martin Öhléen, SKF who talked about mobility, Sebastian Forseland, Husqvarna who gave an expert lecture on master data management and Niclas Lillman&Nicklas Eriksson, Scania who talked about their journey towards a common search solution for all their knowledge workers.

If you weren’t there or if you just want to see it again we have posted videos of the presentations and most of the slides here.

We would like to thank everybody who came to the event – you made it a real success. A big thanks also goes out to our sponsors Google and Splunk who made this event possible.

The networking possibilities at the location were great and really demonstrated how the Search industry is growing.  We are very happy with the event but there is of course always room for improvement for next year. Make sure to be there!

Big data and cloud solutions at Atea Bootcamp

After attending the very well organized and inspiring event Atea Bootcamp 2013 I want to share some of what was said about big data and about the cloud.

Data is the new oil

On the topic of big data Atea had several speakers, one of which was Niklas Andersson, the Swedish CEO of Cisco who talked about the internet of everything. With more and more devices connected to the Internet the modern world produces massive amounts of data that, to a large extent, is unstructured and transient. It comes from a variety of sources and types – as text, video, geospatial data, information captured by a sensor in a plant or a vehicle, or from social interaction via the web. One might argue that big data is nothing new, that it is just a buzz word summarizing what has been going on for many years. However, even though we already have a perception of Big data and ideas about how to handle it and use it, we are still just scraping at the surface of what will come. According to Mr Andersson 99 percent of what could be connected to the Internet still remains to be connected. What happens when we start connecting all those things? A mind blowing perspective that makes a good case for IBMs statement that data is the new oil. For us at Findwise this is of course a highly interesting field where our knowledge can be put to good use. We recently joined Spotify among others in a big data analytics research project led by SICS. Read more about it here.

Findability in the cloud

Steve Dietch, Vice president of HP Worldwide Cloud, gave an insight into the developments of cloud services and the driving forces that control IT decision makers. According to him their customers usually have two main concerns about moving into the cloud; security and choice. Security is an obvious issue and for some organizations there are regulatory aspects to it as well. The aspect of choice has to do with the pace of development and uncertainty about which vendors will dominate the field in the future and what will become industry standards. IT departments everywhere are afraid of vendor lock in. Putting all your data in the hands of an external supplier is understandably a scary concept. What happens if you want to move it? What about how it is organized? I see an obvious case for state of the art search solutions to help handling some of these issues and to relieve some of the worries from IT departments that their data will get lost. With good findability it will not matter where it is stored or which vendor provides the cloud solution.

In conclusion, big data is big business and even though different aspects of it make for different definitions of the concept it is undeniably going to have a huge impact on all of us.

Update on Findability Day 2013

Findability Day 2013 is just a few weeks away and the agenda is now finalized. We will have great keynote speakers and cases for inspiration and of course the approximately 200 attendees will create a valuable networking opportunity.

The event takes place in Stockholm on May 30th and as organizers of the event we are proud to present the following list of speakers and topics:

Martin White – The future of search

Daniel Bergqvist, Google – The Star Trek Computer

Bjørn Olstad, Microsoft – Unveil the hidden values in your organization

Ravi Mynampaty, Harvard Business School – Developing a Search & Findability Practice for the Enterprise 

Kristian Norling, Findwise – The 2013 Findability Survey

Sebastian Forseland, Husqvarna – Master Data management + Enterprise Search = User Satisfaction

Christian Finstad, Meltwater – Big data for online insight

Martin Öhléen, SKF – Search as a driver in Mobile applications

Jonas Berg, Svensk Byggtjänst – The next generation business search engine

Johan Johansson, Municipality of Norrköping – Governance and the role of search in user satisfaction

Niclas Lillman, Scania – Search as a service

DJ Skillman, Senior Director Technical Services, Splunk – Big data

Check out the agenda here for more details and for registration. There are just a few seats left so make sure to register today!

It promises to be a great event and a day full of inspiration, knowledge sharing and networking opportunities to help develop your business, personal skills and professional network.

Hope to see you there!

Event related data – the buzz word at ECIR 2013

One of the major trends at the 35th annual European Conference on Information Retrieval was event related data. The conference took place between the 24th and 27th of March this year in a snowy Moscow, Russia. It attracted around 300 participants from all over the globe, 3 of them findwizards. While ECIR 2013 provided talks on a large variety of topics from across the field, event related data was definitely a buzz word.

The keynote speaker opening the second day of conference was Rutgers University assistant professor and Mahaya inc. CTO Mor Naaman. In his talk, Mr Naaman let the following image explain why Mahaya inc. are in business.

 rome-then-and-now

The past two papal elections.

The image above clearly shows that the way people act at events has changed considerably in the past few years, nowadays everyone is a reporter and their stories can be found on social media. Using platforms such as Twitter, Facebook and YouTube as data sources Naaman’s company creates products which not only extracts, but also synchronizes event coverage. One interesting feature in their latest product is the synchronization of video clips, making it possible for a user to easily switch view when watching video footage of for example a concert.  An arguably even stronger feature of this use of social media is the fact that news and event footage can reach the world even if no press is present at the scene. Slides from this inspiring talk can be found here.

Another presentation the same day displayed promising results in the task of automatic event detection. Using machine learning algorithms a team of researchers from Hanover, Germany have designed a system for detecting and summarizing entity related events from Wikipedia edit history data. Basically the idea is that when a Wikipedia article is edited by a large amount of users in a short period of time that can mark an important event considering the subject of the article. More information about this research can be found here.

The last day of the conference opened with a presentation from Jimmy Lin of Twitter. His talk centered on the importance of fast real-time indexing in social media platform architecture. One of the strengths of Twitter is presenting the users with information about events as they happen. As an example of this he used the event of an earthquake hitting eastern USA in 2011. Tweets from locations closer to the epicenter of the earthquake reached Twitter users in New York City before the actual quake did. I have to admit “Twitter, faster than earthquakes” is a pretty good slogan.

So whether it’s using social media data to let people (re)visit events, automatic event detection in open source dictionaries, making sure your indexing is fast enough to let your users cover events as they happen or something else, event based data seems to be one of the driving forces in the field of IR at the moment.

Big Data is a Big Challenge

Big Data is also a Big Challenge for a number of companies that would like to be ahead of the competition. I think Findwise can help a lot with both technical expertise in text analytics and search technology but also with how to put Big Data to use in a business.

During the last days of February I had the pleasure to attend IDG Big Data conference in Warsaw, Poland. It brought plenty of people from both vendors and industry that shared interesting insights on the topic. In general, big vendors that try to be associated with Big Data dominated the conference. IBM, SAS, SAP, Teradata has provided massive marketing information on software products and capabilities around Big Data. Interestingly every single presentation had its own definition on what Big Data is. This is probably caused by the fact that everybody tries to find the best definitions for fitting own products into it.

From my perspective it was very nice to hear that everyone agrees text analytics and search components are of big importance in any Big Data solution. In multiple applications analysis (both predictive and deductive) and for mass social media one must use advanced linguistic techniques for retrieving and structuring the data streams. This sounded especially strong in IBM and SAS presentations.

A couple of companies revealed what they have already achieved in so called Big Data. Orange and T-Mobile presented their approach of extending traditional business intelligence to harness Big Data. They want to go beyond standard data collected in transaction databases and open up for all the information they have from calls (picked and non-answered), SMS, data transmission logs, etc. Telecom companies consider this kind of information to be a good source for data about their clients.

But the most interesting sessions were held by companies that openly shared their experience about evolution of their Big Data solutions based mainly on open source software. In this way Adam Kawa from Spotify showed how they based their platform on Hadoop cluster starting from a single server to a few hundreds nowadays. To me that seems like a good way to grow and adapt easily to changing business needs and altering external conditions.

Nasza Klasa – a Polish Facebook competitor had a very good presentation on several dimensions connected to challenges in Big Data solutions that might be used for summarisation of this post:

  1. Lack of legal regulations – Currently there are no clear regulations on how the data might be used and how to make money out of it. It is especially important for social portals where all our personal information might be used for different kinds of analysis and sold in aggregated or non-aggregated form. But the laws might be changed soon, thus changing the business too.
  2. Big Data is a bit like research – it is hard to predict return on investment on Big Data as it is a novelty but also a very powerful tool. For many who are looking into this the challenge is internal, to convince executives to invest in something that is still rather vague.
  3. Lack of data scientists – even if there are tools for operating on Big Data, there is a huge lack of skilled people – Big Data operators. These are not IT people nor developers but rather open-minded people with a good mathematical background able to understand and find patterns in a constantly growing stream of various structured and unstructured information.

As I stated at the beginning of this post, Big Data is also a Big Challenge for a number of companies that would like to be ahead of the competition. I truly believe we at Findwise can help a lot within this area, we have both the technical expertise and experience on how to put Big Data to use in a business.

Welcome to Findability Day 2013

Don’t miss the opportunity to visit the biggest search event in Northern Europe focusing entirely on how to find and display corporate information.

Last year we took the first steps towards creating a new industry event for everyone interested in search and findability. This year we are taking it to the next level!

The agenda is work in progress but we can promise a day full of inspiration, knowledge sharing and networking opportunities to help develop your business, personal skills and professional network.

The event takes place in Stockholm on May 30th. For more details check out the event here.

Hope to see you there!

Graph Search from Down Under

We’ve already written about the new concept called Graph Search, which is being popularized by Facebook. Wouldn’t it be cool if we applied this to the enterprise as well, as I wrote in an earlier blog post on Enterprise Graph Search? That’s what Australian startup company Lumanetix thinks, when they created the SPAR-K graph search engine for the enterprise.

Applied graph search

As seen in the screenshots of the product, the product do queries against relational databases with linked data objects such as Movies linked to People in Casts, or Managers of Departments in an organization. One difference to Facebook graph search is the more Google-like query syntax which is keyword-based where Facebook uses natural language processing to describe specific queries.Graph search applied to the enterprise

It’s exciting to see that the market is picking up speed with new innovations in the enterprise search field, as Lumanetix SPAR-K is an example of.

 

/Christian Ubbesen

Speaking about Search as a Service @ PROMISE Technology Transfer day, want to meet up?

Tomorrow morning I leave Gothenburg to attend the PROMISE Technology Transfer day @ CeBIT 2013 in Hanover, Germany.

The event is a workshop introducing its participants to methodologies for the systematic evaluation and monitoring of search engines, and for discussing future trends and requirements for the next generation of information access systems. In other words, it is right up our alley at Findwise.

As Director of Research at Findwise I will speak about Search as a Service. If you are at the event or just nearby I would be happy to meet up and have a chat.  I will be around from Tuesday March 5 until Thursday March 7. Feel free to email me, henrik.strindberg@findwise.com or give me a call at +46709443905.

Hope to see you there!

Query Rules in SharePoint 2013

Leaving both the SharePoint Conference in Las Vegas and the recent European SharePoint Conference in Copenhagen behind, Findwise continues sharing impressions about the new search in SharePoint 2013! We have previously given an overview of what is new in search in SharePoint 2013 and discussed Microsoft’s focus areas for the release. In this post, we focus more on the ranking of the search results using the query rules.

Understanding user intent in search is one of the key developments in the new release. The screenshots below, showing out-of-the-box functionality on some sample content, exemplify how the search engine adapts to the user query. Keywords such as ‘deck’, ‘expert’, or ‘video’ can express the user’s needs and expectations for different search results and information types, and what the search engine does in this case is promoting those results that have a higher probability to be relevant to the user’s search.

Query rules

Source: Microsoft

 

The adaptability of the search results can seem remarkable, as we see in these examples, aiming to provide more relevant search results through a better understanding of the user intent. Actually, this is powered by a new feature in SharePoint 2013 called query rules. Even more interesting maybe is that you can define your own custom query rules matching your specific needs without writing any code!

The simplest query rule would be to promote a specific result for a given search query. For example, you can promote a product’s instruction manual when the users search for that product name. Previously, in SharePoint 2010, you were able to define such promoted results (or “best bets”) using the Search Keywords. The query rules in SharePoint 2013 extend this functionality, providing an easy way to create powerful search experiences that adapt to user intent and business needs.

When defining a query rule, there are two main things to consider: conditions and corresponding actions. The conditions specify when the rule will be applied and the actions specify what to do when the rule is matched. There are six different condition types and three action types that can be defined.

For example, a query condition can be that a query keyword matches a specified phrase or a term from a dictionary (such as ‘picture’, ‘download’ or a product name from the term store), or that the query is more popular for a certain result type (such as images when for example searching for ‘cameras’), or that it matches a given regular expression (useful for matching phone numbers for example). The correlated actions can consist of promoting individual results on top of the ranked search results (promoting for example the image library), promoting a group of search results (such as image results, or search results federated from a web search engine), or changing the ranking of the search results by modifying the query (by changing the sorting of results or filtering on a content type). Another thing to consider is where you define the rule. Query rules can be created at Search Service Application, Site Collection, or Site level. The rules are inherited by default but you can remove, add, configure and change the order of query rules at each level. Fortunately, it also allows you to test a query and see which rules will fire.

There is one more thing though that you need to take into account: some features of query rules are limited in some of the licensing plans. Some plans only allow you to add the promoted results, and the more advanced actions on query rules are disabled. Check TechNet for guidelines on managing query rules and a list of features available across different licensing plans.

With the query rules, you have the freedom and power to change the search experience and adapt it to your needs. Defining the right keywords to be matched on the user queries and mapping the conditions with the relevant actions is easy but the process must undoubtedly be well managed. The management of the query rules should definitely be part of your SharePoint 2013 search governance strategy.

Let’s have a chat about how you can create great search experiences that match your specific users and business needs!

Mobility 2013 top trend among Sweden’s CIOs

Each year CIO Sweden conducts a trend survey among Sweden’s CIOs. They also host an annual event where they discuss the results and the CIOs from some of Sweden’s largest companies talk about their vision. On February 6 I attended this year’s CIO Trends event at Münchenbryggeriet in Stockholm.

The main conclusion from this year’s survey is that compared to last year not that many things have changed. However, one interesting change this year was that last year’s most important trend, cloud and cloud solutions, had been kicked down by Mobility. Mobility as in easiness to move around not only in the office but also in large scales around the world. Information should always be on your fingertip no matter the device or connection. The Cloud is still a hot topic and focus on that is still high among companies. I guess henceforth we will see more of a combination of the two where you use cloud to create more mobility.

Fun fact of the day from the CIOs of Sweden: The most common CIO in Sweden is Male (84%), around 45-49 years old (33%) and don’t like shopping (2%).

//Ludvig Aldrin still Sweden’s youngest CIO (CIO’s under 30,  1%)