Uncategorized
Good Article on Why AI Projects Fail
Today I ran across this article that was very good as it focused on lessons learned, which potentially helps everyone interested in these topics. It contained a good mix of problems at a non-technical level.
Below is the link to the article, as well as commentary on the Top 3 items listed from my perspective.
https://www.cio.com/article/3429177/6-reasons-why-ai-projects-fail.html
Item #1:
The article starts by discussing how the “problem” being evaluated was misstated using technical terms. It led me to believe that at least some of these efforts are conducted “in a vacuum.” That was a surprise given the cost and strategic importance of getting these early-adopter AI projects right.
In Sales and Marketing you start the question, “What problem are we trying to solve?” and evolve that to, “How would customers or prospects describe this problem in their own words?” Without that understanding, you can neither initially vet the solution nor quickly qualify the need for your solution when speaking with those customers or prospects. That leaves a lot of room for error when transitioning from strategy to execution.
Increased collaboration with Business would likely have helped. This was touched on at the end of the article under “Cultural challenges,” but the importance seemed to be downplayed. Lessons learned are valuable – especially when you are able to learn from the mistakes of others. To me, this should have been called out early as a major lesson learned.
Item #2:
This second area had to do with the perspective of the data, whether that was the angle of the subject in photographs (overhead from a drone vs horizontal from the shoreline) or the type of customer data evaluated (such as from a single source) used to train the ML algorithm.
That was interesting because it appears that assumptions may have played a part in overlooking other aspects of the problem, or that the teams may have been overly confident about obtaining the correct results using the data available. In the examples cited those teams did figure those problems out and took corrective action. A follow-on article describing the process used to make their root cause determination in each case would be very interesting.
As an aside, from my perspective, this is why Explainable AI is so important. There are times that you just don’t know what you don’t know (the unknown unknowns). Being able to understand why and on what the AI is basing its decisions should help with providing better quality curated data up-front, as well as being able to identify potential drifts in the wrong direction while it is still early enough to make corrections without impacting deadlines or deliverables.
Item #3:
This didn’t surprise me but should be a cause for concern as advances are made at faster rates and potentially less validation is made as organizations race to be first to market with some AI-based competitive advantage. The last paragraph under ‘Training data bias’ stated that based on a PWC survey, “only 25 percent of respondents said they would prioritize the ethical implications of an AI solution before implementing it.”
Bonus Item:
The discussion about the value of unstructured data was very interesting, especially when you consider:
- The potential for NLU (natural language understanding) products in conjunction with ML and AI.
- This is a great NLU-pipeline diagram from North Side Inc. in Canada, one of the pioneers in this space.
- The importance of semantic data analysis relative to any ML effort.
- The incredible value that products like MarkLogic’s database or Franz’s AllegroGraph provide over standard Analytics Database products.
- I personally believe that the biggest exception to assertion this will be from GPU databases (like OmniSci) that easily handle streaming data, can accomplish extreme computational feats well beyond those of traditional CPU based products, and have geospatial capabilities that provide an additional dimension of insight to the problem being solved.
Update: This is a link to a related article that discusses trends in areas of implementation, important considerations, and the potential ROI of AI projects: https://www.fastcompany.com/90387050/reduce-the-hype-and-find-a-plan-how-to-adopt-an-ai-strategy
This is definitely an exciting space that will experience significant growth over the next 3-5 years. The more information, experiences, and lessons learned shared the better it will be for everyone.
Apollo 11 50th Anniversary – Interesting photos & article link
I still remember my parents allowing me to stay up late to watch the first moonwalk. It was 9:30 pm, I was 5 years old, and we were huddled around an old “black and white” television that had a circular viewing area. My parents tried to convey how important and monumental that moment was – telling me that I would be telling this story to my children someday.
What I remember most was being amazed seeing the astronauts hop around with ease 
and not understating how that could be. We had watched the launch on TV and were getting updates nightly from Walter Cronkite on the evening news. Normally my dad would sit at a TV table to eat dinner and watch the news as my mom sat with my sister and me at our kitchen table, but this week was different.
With all of the news this past week on the 50th 
Anniversary of the first moonwalk it triggered a couple of memories. One of them was that I had a collectible item that I purchased in 2005 at the annual Children’s Circle of Care leadership conference in San Diego, CA. There was a luncheon held on the deck of the USS Midway Museum and afterward, I took a tour. It is an incredible place to visit if you are ever near San Diego.
Before leaving that day I went to the gift shop to get a few trinkets for my wife and children. What I found was a beautiful display, which I immediately purchased and had shipped home. This display was taken to school a couple of times for “show and tell.” It hung on my office wall for 3 years or so and then went into storage with other artwork. It then sat for the past decade and I almost forgot that I had it.
To me, this display is both beautiful to see and very inspirational as well. Human creativity is an incredible thing! As an aside, I have never seen anything like this display so I thought I would share it with you.
Today I also ran across a good article regarding this event that provided information that I had not seen before. It is very interesting and can be found here: https://go.usa.gov/xyVGh
Edit: This was another good article that discusses the advanced flight control computer used at the time – https://www.linkedin.com/pulse/apollo-11-moon-landings-fourth-crew-member-computer-far-fishman/
This anniversary is a great reminder of the power of individuals, teams, and partnerships when they are mission-focused. I find people like the men and women of NASA to be extremely motivational, and the few that I have met have all been very friendly people as well. They are the Humble Heros!
Commentary on an HBR article about Start-ups & Entrepreneurship
A friend posted this article on LinkedIn.com. Due to character limitations for comments, I decided to post my response here. Below is a link to the article referenced: https://hbr.org/2019/07/building-a-startup-that-will-last
The article is interesting, but the emphasis on “second and third acts” assumes that the start-up will successfully navigate the first act. Even with addressing what the author views as key points this is still a very big assumption. The reasons for Longevity and Success are far more complex and multi-dimensional, but it does place a spotlight on some of the more important areas of focus.
Long-term success requires several things: The right combination of having a unique goal that has the potential to make a big impact (think “No software” from Salesforce.com); Innovative ideas to achieve that goal; A diverse team to build the product (a mix of visionaries, insightful “translators,” technical experts, designers, planners, adept doers, etc.); Very good sales / business development / marketing to describe a better way of doing things and converting that to new business; and ultimately a management team focused on sustainable and scalable growth.
The point made about the need to, “Articulate a value framework oriented toward societal impact, not just financial achievement” seems a bit superficial and too tactical in nature.
First, there are unintended consequences to most new technologies. Social Media is a recent example, but Genetic Editing and AI are two areas that are likely to provide more examples over the next decade. Not every societal impact will be positive, and having a negative impact could very well lead to the untimely demise of that company.
Second, the two ideas (societal impact and financial achievement) are not mutually exclusive. When I owned my consulting company we had a goal of funding $1M worth of medical research that would find a cure for Arthritis. We allocated half of our net profits for this goal. Every employee was on-board with this because there was a tangible example of why it mattered (my daughter). We invested $500K, helped launch a few careers for some brilliant MD/Ph.Ds and at least one national protocol came out of their research.
Mission and Vision are so important to a company, yet so many companies fail to view this as anything more than a marketing effort. Those companies fail to realize that this is as much to motivate and inspire their employees, as it is to grab the attention of a prospective customer. These should be both inspirational and aspirational, such as the “BHAG” (Big Hairy Audacious Goals) that Collins and Porras wrote about 25 years ago.
Regarding Endurance and the assertion that “…the best businesses are intrinsically 
aligned with the long-term interests of society,” my take is slightly different. The best businesses are always looking for trends and opportunities in an ever-changing global competitive landscape – as opposed to looking to their competitors and trying to ride on their coattails. Companies with a culture of fostering innovation as a way to learn and grow (Amazon and Google are two great examples) are able to find that intersection of “good business” and “positive societal impact.” It is much more complex than a simple one-dimensional outlook.
But, it was a good article to help reframe ideas and assumptions around growth.
One Successful Approach to Innovation that worked for an SMB
When I owned a consulting company we viewed innovation as an imperative. It was the main thing that created differentiation, credibility, and opportunity. We had an innovation budget, solicited ideas from the team, and evaluated those ideas quarterly.
Almost as important to me was that this was fun. It gave everyone on the team the chance to suggest ideas and participate in the process. That was meaningful and supported the collaborative, high-performance culture that had developed. The team was inspired and empowered to make a difference, and that led to an ever-increasing sense of ownership for each employee.
The team also had a vested interest in having the process work, as quarterly bonuses were paid based on their contributions to the company’s profitability. There was a direct cause and effect correlation with tangible benefits for every member of the team.
We developed the following 10 questions qualify & quantify the potential of new ideas:
- What will this new thing do?
- It is important to be very detailed as this was used to create a common vision of success based on the idea being presented.
- What problem(s) does this solve and how so?
- This seems obvious, but if you are not solving a problem (which could be something like “lack of organic expansion”) or addressing a pain point then selling this new product will be an uphill challenge.
- What type of organizations have those problems and why?
- This was fundamental to understanding if a fix was possible from a practical perspective, what the value of that fix might be for the target buyer, and how much market potential existed to scale this new offering.
- What other companies have created solutions or are working on solutions to this problem?
- The lack of competition today does not mean that you are the first one to attack this problem. Due diligence can help avoid repeating the failure of others, and potentially provide lessons learned by others and help you avoid similar pitfalls.
- Will this expand our existing business, or does it have the potential to open up a new market for us?
- There are upsides and downsides to each answer, but breaking into a new market can take more time and be more difficult, time-consuming, and expensive to achieve.
- Is this Strategic, Tactical, or Opportunistic?
- An idea may fall into multiple categories. When Sarbanes-Oxley (SOX) Act became law we viewed a new service offering as both a tactical means to protect our managed services business as well as an opportunistic means to acquire new customers and grow the business.
- What are the Cost, Time, and Skill estimates for developing a Minimally Viable Product (MVP) or Service?
- What are the Financial Projections for the first year?
- Cost to develop and go-to-market.
- Target selling price, factoring-in early adopter discounts.
- Estimated Contribution Margin Ratio (for comparison with other ideas being considered).
- Break-even point.
- Would we be able to get an existing customer to pre-purchase this?
- A company that is willing to provide a PO that commits to making a purchase of that MVP within a specific timeframe increased our confidence in the viability of the idea.
- What are the specific Critical Success Factors to be used for evaluation purposes?
- This was an important lesson learned over time that helped minimize emotional attachment to the idea or project, as well as providing objective milestones for critical go / no-go decision making.
This process was purposeful, agile, lean, and somewhat aggressive. We believed it gave our company a competitive advantage over larger companies that tended to respond slower to new opportunities and smaller competitors that did not want to venture outside their wheelhouse.
With each project, we learned and became more efficient and effective, and made better investment decisions that positively impacted our success. We monitored progress on an ongoing basis relative to our defined success criteria, and adjusted or sunset an offering if it stopped providing the required value.
The process was not perfect…
For example, we passed on a couple of leading-edge ideas such as a “Support Robot” in 2003 that was essentially an interactive program that used a machine-learning algorithm. It was to be trained using historical log files, could quickly and safely be tested in a production environment, refined as needed and ultimately validated.
This automation could have been used with our existing managed services and Remote DBA customers to further mitigate the risk of unplanned outages. Most importantly, it would have provided leverage to take-on new business without jeopardizing quality or adding staff – thereby increasing revenue and profit margin.
At the time we believed this would be too difficult to sell to prospective customers (“pipe dream” and “snake oil” were some of the adjectives we envisioned), so it appeared to lack a few items required by the process. Live and learn.
In summary, having a defined approach for something as important as business needs innovation to grow and prosper, as best demonstrated by market leaders like Amazon and Google (read the 10-K Annual Reports to gain a better understanding of their competitive growth strategies that are largely based on innovation).
Implementing this type of approach within a larger organization requires additional steps, such as getting the buy-in from a variety of stakeholders and aligning with existing product roadmaps, but is still the key to scalable growth for most businesses.
Creating Customers for Life (4 minute read)
This should be the goal for any business, regardless of the products you sell or services you provide. The idea is to create a mutually beneficial relationship that motivates people to want to continue working with you, despite the availability of competitive products and/or the possible concerns or objections of others (e.g., those pushing for a “Corporate Standard” involving another product.)
The best part is that this concept applies to all companies and all Product Life Cycle stages. Whether your company is on a rapid growth trajectory towards ‘Unicorn status,’ your offerings are mature and may be viewed as ‘less exciting,’ or your products are on the decline and you are seeking the ‘longest tail’ possible – this will help. At each phase there are credible threats from competitors that seek to grow through the erosion of your business.
Several years ago I was responsible for two product lines in two major geographic regions (Americas and APAC/Japan). Our attrition rate (“churn”) had traditionally been slightly below the industry average. We began seeing an increase in churn and a corresponding slight decrease in organic growth. Both were indicators that something needed to change.
After discussions about tactical approaches to address this, our small leadership team agreed that this was a strategic issue that we needed to address. The result was an understanding that we needed to create ‘Customers for Life.’ Everyone agreed with the concept, but due to a variety of differences (culture, who our customer was – end customer vs. channel partner, buying patterns, etc.) we agreed to try what was best for our own businesses and share the results and lessons learned.
My approach was to focus on developing strong relationships that fostered collaboration and ultimately led to growth and success for both parties. The basic premise was simple:
- People tend to buy from people they like, respect, and trust. Become one of those people for your customers.
- Helping companies achieve better outcomes leads to greater success for both our customers and us.
How did we do it? It was a systematic process that included the following:
- Develop simple profiles for each customer (e.g., products used, date of first purchase, size of footprint, usage and payment trends, industry).
- A minimum size – based on either the size of the product footprint, annual amount spent with us, or size of the company, was used to prioritize companies and organizations having the greatest potential impact.
- Make contact multiple times each year, and not just when you wanted money.
- These “out of cycle” contacts turned became very important.
- Ask questions about key initiatives, milestones, and concerns.
- The responses were documented, and that helped seed following conversations and demonstrate interest in what they were doing.
- Follow-up!
- Request meetings to understand how they are using our products and get a brief update on what our company has been doing.
- Meeting people face-to-face is always good.
- Learning more about their business, systems, goals and challenges created opportunities to really add value.
- Look at what they were doing with our products and offer suggestions to do more, do something better or more efficiently, call out potential problems and offer suggestions and discuss best practices. Often, I would have a technical expert follow-up and provide an hour or two of free assistance relating to those findings.
- Look for opportunities to congratulate them.
- It demonstrates that they are important enough that you are paying attention.
- Google Alerts made this easy.
- Regularly ask our customers if there is anything that we could do to help them.
- They would often reciprocate, which led to an increase in references and referrals.
- Continual improvement – Analyze the results and refine the process as needed.
As I met with our Customers and Channel Partners I would explain what ‘Customer for Life’ meant to us, and the potential benefits to them. Prior to the meeting I would check to see if we had (or they wanted) a NDA in-place so that they could speak freely without having concern that this information would be shared with potential competitors. It was a good step towards developing trust and helping them feel comfortable in disclosing information that would help us understand their situation.
Prior to the meeting I spent an hour or two researching the company, their history, major events for that company and within their industry, identify their top 2-3 competitors and then contrast our customer with those competitors. This is where my consulting background really came in handy. Showing interest and understanding created credibility, allowing conversations to progress to substantive issues in much less time.
Over the course of two years my team and I helped our customers innovate by providing different perspectives and ideas, modernize (e.g., move to spatial analytics to get a more granular understanding of their own business), improve their systems and grow their businesses. We also received feedback that helped us improve a variety of processes – something that benefits all customers. Collaboration and success created strong relationships with many of those customers.
From a business perspective our customer churn decreased by 50% over the same period, and organic growth increased slightly more than 20%. We had achieved our objectives and improved our bottom line. The concepts behind Strategic Account Management, Voice of Customer, Customer Loyalty and Customer Success had blended into a practical approach that was not burdensome and provided a great ROI.
One of my biggest lessons learned was that adopting this mindset and creating a repeatable process is something that can be done anytime, and should be done sooner than later.
Every day that you are not creating your own ‘Customers for life’ there is a good chance that your competition is.
Good article on being an Entrepreneur
Nearly every morning I start the day out by reviewing news on business, technology, and finance / markets. Occasionally there is a general interest article that I stumble across. Today it was a short article about Curt Culver, Co-Founder of Culver’s restaurants.
There are several great points that seem like common sense in hindsight, but are often well out of focus during the “heat of the battle” as you are building your business. Mr. Culver touches several of them:
- The Importance of having the proper Work / Life Balance
- For me personally, this was one of the toughest aspects of growing my business. I was working 100+ hours a week, traveling a minimum of 50% of the time, and was often “not there,” even when I was spending time with my family.
- My habits also set the expectations for others on the team, and I later realized that this created some strife at home for them as well.
- The turning point for me was when my youngest daughter, then 4 years old, was telling her twin brother and my older daughter that, “Daddy really does love us, he just works all the time so that we can live here and have all of this stuff.” It was painful enough to hear that, but was a wake-up call about what is really important in life – people (especially family and friends), not “stuff.”
- For me personally, this was one of the toughest aspects of growing my business. I was working 100+ hours a week, traveling a minimum of 50% of the time, and was often “not there,” even when I was spending time with my family.
- The Need to Develop others on your Team
- From past experiences I understood the need to hire the best people who you could afford – people with complementary skills (not just clones of yourself), and who were better than you in at least one aspect.
- One of my goals around developing my team was to have everyone understand the big picture, and empower them to make good decisions for the business.
- While most of this occurred, my goal was to have each and every person think and act like owners of the business. That level of engagement and accountability only happened with my most senior person, who was also my first hire and actually did own a small part of the company.
- The moment when I recognized success was during a mission-critical ERP system upgrade for our largest customer – a multi-billion dollar semiconductor reseller. I sat-in on project and team meetings, reviewed reports, and asked a few questions, but that was it. It was a very proud and empowering moment for me.
- The weekend of the pre-migration test I received a call telling me that everything had been successful and that the migration was going forward the next weekend.
- The following weekend I received a nightly summary email, and on Sunday afternoon received a call telling me that the new system was operational and supporting production with ease.
- Culture
- Mr. Culver states that, “Culture is all about people.” That is true, but it is just one aspect of culture.
- To me, the Cultural Identity of your company starts out as something aspirational, and grows into the glue that bonds each and every member on your team. It helps bring out the best in everyone, including the camaraderie and support that comes from working with people who you like and trust.
- There were two unexpected consequences of actively focusing on culture, which were:
- We quickly transformed into a High Performance Organization. Everyone pushed to continually “raise the bar.” There was healthy competition between people, but each member of the team was there to be a “safety net” for others as having the team win was far more important that winning as an individual.
- New Hires that were not a good fit recognized that very quickly, and usually quit within the first 2-3 weeks. I only had to terminate one person during the probationary period that wasn’t a good fit.
- There were two unexpected consequences of actively focusing on culture, which were:
- Having a Support System
- Mr. Culver addresses failure and the importance of family to help support you in times of need.
- One of the biggest lessons learned for me personally was nothing that I did or accomplished with my company would have been possible without the support of my wife, children, parents and in-laws (the later two providing financial support during the early years in times of need).
- With understanding comes humility.
These are lessons learned that can be applied to any size organization, and in my opinion are a great investment in the future growth, value, and longevity of your company.
Here is the link to the article referenced – https://www.qsrmagazine.com/start-finish-what-inspires-execs/craig-culver-culture-all-about-people
The Downside of Easy (or, the Upside of a Good Challenge)
As a young boy, I was “that kid” who would take everything apart, often leaving a formerly functional alarm clock in a hundred pieces in a shoe box. I loved figuring out how things worked, and how components worked together as a system. When I was 10 I spent one 
winter completely disassembling and reassembling my Suzuki TM75 motorcycle in my bedroom (my parents must have had so much more patience and understanding than I do as a parent). It was rebuilt by spring and ran like a champ.
By then I was hooked – I enjoyed working with my hands and fixing things. That was a great skill to have while growing up as it provided income and led to the first company I started at age 18. There was always a fair degree of trial and error involved with learning, but experience and experimentation led to simplification and standardization. That became the hallmark to the programs I wrote and later the application systems that I designed and developed. It is a trait that has served me well over the years.
Today I still enjoy doing many things myself, especially if I can spend a little bit of time and save hundreds of dollars (which I usually invest in more tools). Finding examples and tutorials on YouTube is usually pretty easy, and after watching a few videos for reference the task is generally easy. There is also a sense of satisfaction to a job well done. And most of all, it is a great distraction to everything else going on that keeps your mind racing at 100 mph.
My wife’s 2011 Nissan Maxima needed a Cabin Air Filter, and instead of paying $80 again to have this done I decided to do it myself. I purchased the filter for $15 and was ready to go. This shouldn’t take more than 5 or 10 minutes. I went to YouTube to find a video but no luck. Then, I started searching various forums for guidance. There were a lot of posts complaining about the cost of replacement, but not much about how to do the work. I finally found a post that showed where the filter door was. I could already feel that sense of accomplishment that I was expecting to have in the next few minutes.
But fate, and apparently a few sadistic Nissan Engineers had other ideas. First, you needed to be a contortionist in order to reach the filter once the door was removed. Then, the old filter was nearly impossible to remove. And then once the old filter was removed I realized that the length of the filter entry slot was approximately 50% of the length of the filter. Man, what a horrible design! A few fruitless Google searches later I was
more intent than ever on making this work. I tried several things and ultimately found a way to fold the filter where it was small enough to get through the door and would fully open once released. A few minutes later I was finally savoring my victory over that hellish filter.
This experience made me recall “the old days.” Back in 1989 I was working for a marketing company as a Systems Analyst and was given the project to create the “Mitsubishi Bucks” salesperson incentive program. People would earn points for sales, and could later redeem those points on Mitsubishi electronics products. It was a very popular and successful incentive program.
Creating the forms and reports was straight forward enough, but tracking the points presented a problem. I finally thought about how a banking system would work (remember, no Internet and few books on the topic, so this was reinventing the wheel) and designed my own. It was very exciting and rock solid. Statements could be reproduced at any point in time, and there was an audit trail for all activity.
Next, I needed to create a fraud detection system for incoming data. That was rock solid as well, but instead of being a good thing it turned out to be a real headache and cause of frustration. Salespeople would not always provide complete information, might have sloppy penmanship, or would do other things that were odd but legitimate. So, I was instructed to turn the dial way back. I let everyone know that while this would minimize rejections it would also increase the potential for fraud, and created a few reports to identify potentially fraudulent activity. It was amazing how creative people could be when trying to cheat the system. By the third month the system was trouble free. It was a great learning experience. Best of all, it ran for several years once I left – something I know because every month I was still receiving the sample mailing with the new sales promotions and “Spiffs” (sales incentives).
This reflection made me wonder how many things are not being created or improved today because it is too easy to follow an existing template. We used to align fields and columns in byte order to minimize record size, overload operators, etc. in order to maximize space utilization and performance. Code was optimized for maximum efficiency because memory was scarce and processors slow. Profiling and benchmarking programs brought you to the next level of performance. In a nutshell, you were forced to really understand and become proficient with technology out of necessity. Today those concepts have become somewhat of a lost art.
There are many upsides to easy. My team sells more and closes deals faster because we make it easy for our customers to buy, implement, and start receiving value on the software we sell. Hobbyists like myself are able to accomplish many tasks after watching a short video or two. But, there may also be downsides relative to innovation and continual improvement simply because easy is often good enough.
What will the impact be to human behavior once Artificial Intelligence (AI) becomes a reality and is in everyday use? It would be great to look ahead 50 to 100 years and see the full impact, but my guess is that I will see some of the effects in my lifetime.
