The Deep Web?

Posted on February 17, 2015 by tamsons

The Deep Web

In today’s ever changing world we are becoming more and more adept at creating names for things. Being into technology and the uses of it, I always think I am ahead of the game or at least trying to be and then a term pops up and I think, here we go again.
So when the term Deep Web came around I thought let’s actually look at how this is being used and what does it mean to the layman, now and in the future?

So how is it being used?

Well it is a term that talks about areas of the Internet that main stream, search engines just cannot reach. It is so buried that they don’t see it or how to get to it. Here is one definition I found for it.

“Deep Web (also called the Deepnet, Invisible Web, or Hidden Web) is the portion of World Wide Web content that is not indexed by standard search engines.” This is from Wikipedia and can be found here

This of course this has led to other definitions and I love the idea of standard search engines being like a fishing net cast across the sea and only catching fish in the top layers, then deep web is at the bottom layers and the net doesn’t go that far. Traditional search engines cannot see or retrieve content in the deep web. So they have named the section of the web that is indexed by standard search engines as the Surface Web, Yes another term to get your head around. You tend to wonder if Spiderman has all this trouble.

So is this the same as the Dark Internet?

The popular thinking is that the Deep Web should not be confused with the Dark Internet, which refers to network hosts and the Internet that no one can reach.

Why should we even be aware of the Deep Web?

Well most of the use of the deep net is perfectly OK and the usage need not be thought of anything other than perfectly innocent. However, government agencies and enforcement agencies are concerned that it could be a place where serious criminals can hide and carry out some unscrupulous activities. This of course will lead to, what seems to be the main way that things are handled today, passing laws that treat everything as the same and where this maybe catches some of the intended targets it also causes the innocent who were going about their normal business up to this point to have issues and have to change almost everything they do at present.

Remember most of the Deep web is Ok.

Of course there are loads of conspiracy theorists out there who claim all sorts about the use of the Deep Web, from one article I saw when researching saying that contract killers use it for activities, again this was from a tabloid known for it’s out there opinions that have sometimes little basis in fact. Down to webmasters keeping their websites away from standard search engines for security and other reasons.

To summarise

I think the problem, like many times in the past: is going to be unscrupulous people using an area of the Net that can be of benefit to organisations in a safe and useful way. This will cause paranoia and worry to users, governments and authorities. So legislation will come about and whether this causes all sorts of issues in using the Internet in the future we will have to wait and see. With everyone becoming more mobile and more and more dependent on the cloud and net technologies then these are going to be interesting times.

Your friendly neighbourhood Spiderman…….

BIG DATA EXPOSED

Posted on November 6, 2014 by tamsons

An SME owner’s (non-technical) perspective on the impact of Big Data.

People like to compare, categorise and count. From basic ‘one, two, many’ counting systems to hyper-complex variations on different types of infinities, we seem to be impelled to view patterns, detect trends and evaluate our daily experiences, individually and collectively, through numerical frameworks. At a mundane level, we value our work input in terms of money earned and measure business performance by accounting for profit or loss; more imaginatively, we give dimension to the universe by calculating light-years between galaxies to which none of us could ever travel, but which we like to count anyway!

Over the last 60 years, computers have enabled us to count (and record our totals) at an increasing pace and to a magnitude that would have appeared both incomprehensible and functionally senseless to many of those early IT pioneers. “Why would we ever need to count so much, so quickly?”, they might have asked. The current benefits of storing petabytes of data on the internet on a daily basis (Google processes lots of petabytes, by the way) were not so obvious in the 1950s, when the technological challenges were focused on making the great mainframes hulks more reliable and keeping them cool enough to work. But now, our IT capabilities have made the compilation of massive data-sets seem almost routine. Big Data, as a concept, is emerging as the latest evolutionary step in a line which includes its earlier diminutive cousins – relational databases and data-warehousing.

But doesn’t the ‘Big’ in Big Data signify that it is only of relevance to big organisations and groups which can access and analyse it? As a small B2B business owner, I don’t believe that to be the case, so here’s my take on what the existence of Big Data means for SMEs. I’ll start with two brief scene-setting questions – How have we created it and why do we think it’s worth having?

How have we been able to collect so many data-sets, public and private, in such a comparatively short period of time from the birth of the modern computer? The expansion of IT and the internet into daily living– and their adoption and understanding by the masses in the last two decades via PCs and smartphones – have allowed us to record our counts super-massively and with unimaginable speed. The sense of amazement I felt in the late 70s when hearing that a program would be able to carry out the calculations necessary for a college project OVERNIGHT appears embarrassingly naïve today. We’ve all heard the one about the computing power that guided the first men to land on the moon – that there’s more ‘oomph’ in a modern washing-machine chip now than in the whole of NASA in 1969 – stretches the comparison somewhat, but it makes the point that almost-microscopic processors are now orders of magnitude more powerful than their pioneering mainframe progenitors. And today, when we can link up computers in very large arrays to view the universe, analyse statistics on diseases via PCs connected across continents or announce our every waking thought on vast social media ‘soapboxes’, then our sense of conquest – that there is no piece of recordable data out there which we cannot collect and store – becomes limitless. Which leads me to ‘why’?

Why is having Big Data beneficial? That’s been part-answered in my introductory comments. We like to collect, compare and count things, and to me, in a sense, the numbers we can define and then amass on our storage systems have become those ‘things’. So, some of the answer as to why we deem it worthwhile creating evermore data is because “we can” (the mountain’s there, so climb it). Big Data’s existence, as a by-product of the internet-age, reaffirms to us that we can keep tallies of what matters to us. However, whereas, for the first 50 years of the technical development of IT, increasing memory and speeding up the circuitry to pipe the 1s and 0s to their storage point was the main focus (the digits were the means to the end), once the engineering reached a level of efficiency and reliability to guarantee operating stability, deciding what could now be done with the data thereby collected – the things as objects – became the scientific quest.

So, the question has moved on to become ‘what’s the point of Big Data – how can we extract information we believe to lie in the layer upon layer of digital substrates that form the internet’? Can Big Data, envisaged as a constantly growing entity it itself, a real-time flow of interactions across networks between people and organisations, now be mined by those with the sophisticated analytical skills and insight to ask the right questions, to yield motherlodes of information that could improve our understanding of human behaviour in a vast range of contexts? The answer, of course, is yes it can.

At a practical level, I’ve mentioned Big Data being analysed by astronomers and medical researchers to give but two small examples of how it is being exploited to test theories and hypotheses. There are, of course, other areas where Big Data is providing previously unavailable opportunities for other types of organisations and individuals to delve into data-sets to ask their own questions, be they commercial, not for profit or academic. For example, the main accountancy firms are in the process rapidly developing their capabilities to purchase and analyse Big Data as the value of their compliance services (making sure tax and other statutory returns are being made on time) diminishes and business-advisory (selling knowledge back to a business to help it grow or manage itself better) increasingly generates larger margins from their clients. My focus, however, now turns to what impact Big Data is having on SMEs by considering two cases based upon real contemporary events.

My first scenario originates from the world of banking, admittedly not the most popular of professions currently, but an essential commercial service for SMEs. The analyses emerging from the masses of Big Data on our transactions the banks own are revealing the fundamental changes in the way we use and interact with our money. Retail banks are closing branches and laying off staff in their thousands, not without complaint or customer reaction, but nevertheless with confidence that it’s the right thing to do. Why? Because they know, from near real-time Big Data analyses, that more customers are using internet banking and a decreasing number see any need to visit a branch (knowing your local bank manager is no longer a selling feature for your banking services – if it ever was for the majority of us). Having access to your accounts from your mobile phone has much more relevance, and therefore more value, for customers. This is not some banker’s hunch; the analytics prove it, right now! They see cash transactions dropping as cards and smartphone payment facilities are used to make 60% of purchases below £20 by some client demographics – and this is not being restricted to younger customers.

So what’s the impact on SMEs of this evidence from banking Big Data analyses? Well, at a basic practical level, it forcefully shows the more ‘cash-based’ trader that offering cashless payment facilities to customers will definitely bring in more business. However, for me there’s an additional learning point that has emerged from the banks’ current infrastructural changes – it demonstrates that Big Data can now be analysed in such a way as to provide reliable answers to increasingly specific and complex questions about commercial activity.

The banks and other organisations utilising Big Data are not ‘taking a punt’ when they decide to implement radical changes in their structure or operations. Rational decisions are being made, after analysing near real-time information, on product development, marketing campaigns and organisational structure because Big Data supports adaptive change to take place based upon what is required today. Likewise for ambitious SMEs, the opportunities are expanding to access meaningful information about their markets in their geographies that is near-real time, not months out-of-date or carelessly slung together from national marketing samples and sold at extortionate rates. Sure there will be a cost to obtain such intelligence, but there are more data-analysis organisations in the market which will provide more relevant and reliable external information than was available before. Big Data will allow SMEs to be more informed decision-makers, just as it has made large organisations more adaptive decision-makers.

My second scenario arises from a recent Big Data analysis conducted by an expanding financial management app company which provides services specifically for SMEs. Basic, easy-to-use (but perfectly functional and compliant) bookkeeping and accounting apps are now being marketed with the small business owner being viewed as the main purchaser, not their accountant. For most of the UK’s 4 million SMEs, getting over the unappealing bookkeeping hurdle could be made really simple (even enjoyable, for some) by adopting any one of the online financial management services such as Free Agent, QuickBooks and Sage Online. These make simple accounting very affordable and straightforward to do and allow the working relationship with one’s accountant to become more productive as the streamlined and rapid data-input process removes the drudgery of the paperwork, allowing a business to keep close to its most valuable asset – its information, i.e. those facts and figures that let it know how it is performing operationally and commercially. And here Big Data and small business inevitably and fortuitously collide.

Every online transaction is securely recorded in the Cloud by the SaaS providers – so they collectively have the records of their customers’ businesses writ very large. They know, from the transactional data that we pass to them, how we behave as organisations. For my example, Xero.com, a financial management app specialising in the SME market in the US, UK and the Antipodes, has used its anonymised data-sets to demonstrate that businesses which invoice promptly using online delivery methods can reduce their debtor days by 40%. Big Data on how SMEs manage their finances, once more in near real-time, has provided contemporary evidence not only that efficient invoicing gets you paid quicker (which we already knew) but also that using email to send out your bills and offering payment services to your customers can get you paid in 24 days rather than 40; this insight could be worth a fair bit to a cash-strapped business. So SMEs, utilising cloud-based financial, administrative and operational apps, can benefit from contributing their transactional records to a vast data-pool which can be analysed to give back information on comparative performance when measured against their peers.

The development of key performance indicators (KPIs) for SMEs will be an increasingly active market in the next few years. Competitive advantage will attained by those businesses which understand the value of devising and measuring KPIs which are specific to sector, geography, technology or markets and which have access to insightful analysts who understand the product or service being offered to customers. Analysis for its own sake has never been sufficient, but Big Data now makes more purposeful, commercially-focused analysis possible for even the smallest of businesses. Knowing why customers accept or reject what the market is offering can be gleaned from Big Data examinations of purchasing behaviour married to key-word reviews of social media comments. While the vast majority of SMEs are not able to do this for themselves, the opportunities to benefit from the existence of Big Data are beginning to open up through the growth in the tailored data-analytics market.

So, by moving into the era of Big Data, our ability to count has moved one stage further along the developmental path that started with ‘one, two, many’. We now, large and small businesses alike, must now count ‘one, two, how many?’ in order to profit from the advantages that Big Data offers us all to improve our analysis and decision-making.

What are your experiences and thoughts on Big Data and how we can use it?

Guest Blogger this month is
Rory H D Cooper
Managing Director
Canmore in Business
www.canmore.co

What do you use to browse the shops?

Posted on September 10, 2014 by tamsons

Imagine the internet as a large series of shop windows from all over the globe. We all need a method of browsing through them, and finding and buying information or physical goods. So, what do you use as your internet browser?

For a long time, Microsoft had the market sewn up – as it built its browser, Internet Explorer, into the Windows OS – and so everyone used it without giving it much thought. If it works, then why change? Well, people did change – and they did it because they felt that IE wasn’t doing a good enough job of displaying the web to you, the customer, in an accurate and intuitive way. So various other browsers have been developed, and the majority run quite happily on the Windows platform.

I have tried various browsers over the years, mainly on my Windows based machines – and now more recently on my Android based devices – and find each browser to have its own set of positives and negatives. The picture above shows a rough breakdown of internet browsers in use at the moment, mainly for desktop machines running Windows.

So what do we look for?

So what do we look for in an Internet Browser? Are they all the same? Should we be bothered?

It is a personal decision, and you should use which ever one you feel most comfortable with, but be aware of the following areas: –

Rendering of web content. Some browsers display web content much faster than others, and for you the end user that saves time and frustration waiting for web pages to load.
Security features. Each browser claims a set of security features that allow for secure connections and more secure shopping etc. Check them out and make sure you are happy with what they are offering and how they are handling it.
Cookie handling. Browsers each handle cookies, which are small text based files that store some details of your path through the Internet. Most cookies are time saving and harmless, but some are Malware – and can cause popup windows etc. Check what settings each browser allows you to change to get the level of security that suit you and your business.
Some browsers allow you to save a list of your open tabs and create a snapshot of where you have been – this is then available when you leave your desktop machine and go mobile. Chrome for example lets me see the tabs I was looking at when I was seated at my desk – and this all leads to an easier work environment.
The look and feel. Again, this is a personal choice, some of it is down to the look and feel of the browser. You may find some are easier than others to use and navigate around. They all constantly update themselves, and so just as you think you have sussed the settings and where to find stuff they can change it all. But, hey, that’s computers and applications for you.

Why not let us know what browser you use, and why you use that one. Give us your experiences of browsers you have tried and why you moved on to others.

We look forward to reading your posts.

To have Wi-Fi or not to have Wi-Fi that is the question, whether it is nobler …?

Posted on August 6, 2014 by tamsons

You get the picture! I write this after having a short break down in Shakespeare country. On my return, I heard a survey being conducted on the radio.

The presenter was telling us that he had recently encountered a survey that rated the most common criteria that young couples (aged 35 years old or less) used to buy or rent a house.

They were asked what the main reason for the choice was. Of course – listeners were thinking about school choice, local area, number of rooms, was it well priced. Considering the age group, I wondered if the need for high speed broadband might play a major part in the choice – it was revealed I wasn’t far off, it was the second top reason for making a choice. The first reason most of them quoted was availability of a good mobile signal. If the house did not have good mobile signal, most of the other factors didn’t matter – how things have changed over the years.

Now, that was a slight aside, as the main topic here is Wi-Fi (as you can tell from my Shakespearean reference in the title). I am slightly sad (as a geek) and when my wife suggested a cottage to hire, I said to make it remote, and that it MUST have Wi-Fi.

Being a small business owner, I often need the flexibility to deal with potential issues – even when away on holiday.

My wife trawled the net, and found a cottage that seemed to tick all the boxes. I checked it over, it all looked great, BUT it had not ticked the Wi-Fi box – so I told her it wouldn’t do. I should point out at this point that she loves looking for holiday cottages, so this isn’t as harsh as you might think. Off she went again, and soon came up with another solution and shortly after the cottage was booked.

We made it down without incident, and settled in. I gained the Wi-Fi key and connected my tablet, only to find that the Wi-Fi was atrocious – the connection slow and not stable. Mobile phone signal was non-existent in the house, and so you had to dance around outside to try and find a signal that worked. I was not a happy chappy. So it was that tearooms and coffee shops were the next best thing, and I was asking at every one: “Do you have Wi-Fi?”

Surprisingly in such a tourist filled area, there were quite a few owners that looked at me like I had asked for a space age technology they hadn’t yet heard of.

So that brings me back to the question, to have Wi-Fi or not to have Wi-Fi?

Operating in the mobile world now, where we are asked to trust all our data to the cloud and the great storage in the sky, I want to ask you if Wi-Fi should be more widely available than it is just now. Some Towns are even installing it in town centres (although sadly in my opinion, the setup is generally being chosen by politicians and not by specialists – so the Wi-Fi you get it substandard, and it would probably be better if it wasn’t there).

So, should tearooms and coffee shops see this as a must have for their clientele? Or is it something extra outside of the norm, and not their problem. I know I spend time in coffee shops, usually having meetings and catch-ups with clients and other business owners, and we use the Wi-Fi a lot. Being honest, if it wasn’t there, we would very likely go somewhere else.

What are you experiences of Wi-Fi availability? We’d love to your opinion on the above discussion!

Has the Cloud changed the business weather?

Posted on May 8, 2014 by tamsons

I have always promoted the ways in which technology can help us, and how its advancement is changing the game in many different areas – from remote surgery via a net connection, to the way we communicate and interact. Some would say that this is great, and these changes are for the better – at least better than the sluggish old ways we used to do things. Others are more sceptical, and suggest some of what is happening is taking away from human interaction, often to the degree that we just can’t interact effectively face to face anymore.

With the above in mind, I must confess that I do a lot more typing than writing, and as a result my writing skills are just not what they used to be. Saying that, some would say my typing skills also leave a lot to be desired.

Anyway, I digress; I titled this article, “Has the cloud changed the business weather?”

This was a direct hit at what the Internet (or as it’s often called, the cloud) is doing to the way we do business. Let’s look back at the history of how it was done; again I will speak from the experience I gained over my working life.

In times gone by

In past lives I have used written reports, sending them back to my direct line manager. Then we got the marvel that was carbon paper copies, which meant I could keep a copy myself.

A fax was installed in my home office and I could fax info straight to main HQ and get it actioned. No more waiting on the snail mail to deliver. This was a revolution.

I was then made the proud owner of a pager. It would bleep to signify that I had to go to a phone and call the office. The next version had a small LCD screen where I could read a streaming text message instead of phoning in. Where was technology taking us?

OK, you have probably guessed by now that I am not a newcomer to the work environment. In fact I have been through a good number of changes to the way things are done.

The next development was a phone mounted in my company car. This was a large brick like device in the cabin, connected to a larger box that was taking up most of my boot space. The aerial was attached to the roof of the car, and off I went. However, my sales area included the highlands of Scotland, and the signal at that time was really very poor, so generally I was uncontactable unless I found a landline.

The car phone I was given after that was the first that could be considered truly mobile, and could be removed from the car and taken, yes taken with you, anywhere. WOW! This was just amazing. I could text and phone from anywhere and no longer needed to be tethered to my car.

I was then simply given a mobile phone, and along with that my first mobile computer. It had details of all the products I used to sell on it, and had the ability to allow searches and pricing on the spot in front of a client…

How could this be I hear you cry? Well that was technology for you, and it was driving sweeping changes to what we were able to do in business.

Obviously things have moved on greatly since these bygone days, and companies have had to accept technology moves one. They also have to deal with the way it has influenced what they do, and landscape of their proposed market places.

Access to the Internet started very slow, I still remember connecting via a dial up modem (33.6k which by today’s standards is the slowest thing ever) but it was new and exciting at the time. Then ADSL has superseded that, and now ADSL is on the wane due to Fibre broadband being rolled out nationwide.

With this advancement, and mobile broadband reaching similar speeds, it finally means that the cloud has come of age. The idea of ‘Always there Internet’ has truly arrived.

What we can do now in the cloud, and through the cloud, is an order of magnitude more impressive than my first work experiences of technology.

Where will it all go?

The question now, I suppose, is where will it all go? But what I want to ask you is where will you take it?

Will you adopt the latest technology and keep pushing what you can do beyond what you do now? Beyond what others are doing? The cloud is truly changing the weather in the business world in ways that a younger me could only dream of.

We can collaborate worldwide as if we were in the same office. We can have instant access to real-time information that allows us to make informed decisions faster than ever before.

We can access information at any time and any place, which means we don’t have to be tied to an office desk. Mobile Internet usage (or cloud usage if you like) has increased year on year to around 68 to 70% of all Internet traffic. Technology has improved beyond a large bulky desktop computer or chunky laptop, the information is now actually in the palm of your hand.

Our mobiles (and remember I started with a brick in my car) have now turned into smart phones. We can do all sorts of tasks using them, and that includes good quality business work.

Conclusion

I am still excited about where technology can take us, and would like to think I’m still a people person. It will never make me a recluse, so that I do not interact, but it can make my life and business world easier. It can change the weather on the business front, and for me this has meant more sunshine and less rain, even though there will still be clouds.

What are your thoughts on adopting new technology for you or your business?

Is It Clouding my Judgement………?

Posted on June 3, 2013 by tamsons

As I was sitting at my office window and gazing at the sky, which unfortunately is more times grey than blue, I started to think about the shapes of clouds out there and obviously then being a geek my mind was drawn to cloud computing and all things to do with it.

I have trodden the boards of the IT stage for a number of years now, and it’s always fresh as new development is always on the horizon. The use of the term cloud has always seemed to have been thought up as a throwaway term by some marketing executive or journalist at some point, and has then just stuck with us. In practice – it is simply the Internet to most people, which has been around for many years. Of course, for some of us, the connection has been not too reliable, and it has occasionally been almost impossible to connect to over the years. But basically it all boils down to areas of storage on the Internet where data and websites live and we can all marvel at their content.

It is amazing how it has changed the world’s habits over the short time it has been around. We work there, shop there, talk there, and then we spend a disproportionate amount of our free time there.

Of course things have developed over the years, and we are now able to connect much more easily. In fact when our Internet connection goes down we are sometimes at a loss, all we have and do is attached to it. That feeling of your right arm being cut off … second only to those times when you misplace your phone…

However, I digress, what about this cloud thing. Well I suppose the natural extension to the Internet and surfing web pages is the fact we can put most, if not all, of our lives up on the Internet. It’s then stored on servers sited all around the world, thankfully not in an actual cloud. Although a friend of mine recently told me that his elderly mother had reasoned that this is why the weather is deteriorating, we are putting far too much stuff up in the clouds … an interesting thought.

Cloud storage has become a big thing, and also of course cloud based applications. Both allow mobile devices to carry out what seems to be very complex work, when in fact they are merely displaying it and the work is being done elsewhere.

Companies are now letting us sign up for free online storage space. When we upload data to it, it can be seen from any handheld connected device we have; we can also share it with others more easily. This all sounds good, and in the opinion of many it is the way ahead. Sceptics have worries about security, who has access and who actually owns your data? What happens if the the server is down and you can’t access your data? All these are reasonable questions and need to be answered, and the cloud is not necessarily the best option for everyone. It may even only be a supplementary solution for some people and companies.

My personal experience has involved using it for storing various documents and information that I may want whilst out and about. There is nothing worse than being somewhere and remembering that the file you want is on your storage at home or office. In the past I used to email myself things, and when out and about if I could access my email account I could retrieve the data. Then came pen drives and I could carry vast amounts of data around in my pocket on something no bigger than a postage stamp. Think of the security risk with that, there have already been a few red faces from such items being left unattended.

With regard to the best cloud storage solution out there, that varies depending on who you speak to. In a lot of cases people have simply stuck with the first one they tried.

I can really only talk about Google Drive and the use of Google Drive and Google Apps. I have used them for some time and found them to be exactly what I need, allowing me to access data from my PC at the office, my Laptop at home and my phone and tablet as I travel. All are working on the same document held in the cloud so there are no duplicates or multiple versions. Google Drive also lets you share documents and I have worked with documents in situations where they were getting updated by a number of people simultaneously. The usability of the Google Apps side I always feel could be much improved, but then I am a Microsoft Office trainer and always use that as a measuring stick I am afraid.

Other offerings out there are many and more are arriving every day, such as Microsoft’s Sky Drive, Dropbox, Justcloud, Live drive, Apples Icloud and many more.

Which is best for you? Well it is difficult to choose, some people choose because of the space they are given, others because they thought they would give it a try and have just stayed there. I chose because I had tried Google Apps and found them an interesting start to online applications. Then I wanted to share files and found that Google would allow me to edit files as well as share them. I then started to get into Android, Google’s mobile operating system, and my account simply and seamlessly joined together and everything worked everywhere. What else did I need?

I hope this explains the move from the hard drive in your machine to the cloud. The use of it will only increase, driven by the 4G network expanding and access to the Internet becoming faster and more available. You may have to jump to a cloud at one point, so check it out – there is loads of information about it out there … where?

In the cloud of course…

Ian Thomson
Consultant at
IT Turning Point