DevOps

  • December 5, 2019
  • The tools you work with have a lot of impact on what you can accomplish and the more sophisticated the tools the better, especially in software. Beagle Research (my company) just completed a study into using a DevOps strategy with the Salesforce Lightning Platform. The work was sponsored by Copado a DevOps solutions provider. DevOps is a strategy for building, changing and deploying enterprise software that can also be used with a Scrum or Agile methodology as well as others. More than concentrating on code and coding, DevOps is more holistic looking at culture and infrastructure in its broadest manifestation.

    Even if you’ve never built systems you can surmise that planning, developing, assessing, testing and deploying software are all critical milestones and they’re often spread across technical departments of IT like development and operations, hence the name.

    It can be challenging to compare enterprise software strategies. For instance, using an on-premise hardware and software stack has been common for decades but with the development of cloud computing, users find they can eliminate having to care about a good deal of their development environments leaving it all to the cloud vendor. How do you compare overhead and costs between cloud and on-premise? What are the effects on speed to market, reliability, security? To control for some variables and enable us to make an apples-to-apples comparison, we chose to research only companies developing and maintaining systems using Salesforce Lightning and a DevOps strategy.

    Companies ranged in size from fewer than 100 employees to more than 10,000. There were similar measures for number of salesforce users and number of developers as well as the number of production orgs. Two-thirds or 67 percent said they run between 2 and 7 production orgs. Most of the respondents were C-level executives (48 percent) or upper management (40 percent).

    We found that DevOps is delivering value for most of its users though the larger organizations have greater challenges, more on that in a moment; 17 percent claim over $5 million in benefits from using a DevOps strategy. These people have a good understanding that software flexibility drives business agility and impressively, 54 percent say their lead time for making changes to their Salesforce orgs is between one day and one week. Compare that to a more traditional process that takes weeks or months.

    But we also identified an elite group that operates even faster–21 percent say their lead time for making changes is less than a day, and 8 percent say it takes less than an hour. Taken together 83 percent can make changes in a week or less.

    In other recent research I’ve been involved in, delivering running, tested and deployable code was much slower. Clearly, if a business depends on its ability to quickly change to meet changing market demands this is where you want to be.

    On the other hand

    As you might expect though, the benefits of a DevOps strategy were not evenly distributed across all users. Generally, smaller businesses with smaller development groups did better overall at establishing DevOps programs and at excelling within them.

    The most successful businesses using DevOps are those that use a well-integrated set of tools to move through development and deployment. Many organizations, especially smaller ones, use a combination of in-house developed and opensource management tools. At best the great variety of tool choices suggested to me that some best practices are still being worked out.

    Even with Salesforce Lightning and a DevOps approach you can still have issues and almost everyone had the experience of deploying a release to a production org and having a service degradation. A plurality of respondents, 43 percent, said a problem occurred up to 15 percent of the time and the vast majority or 86 percent said service degradations happen less than half of the time. This is an important snapshot of the state of the industry. Speed of delivery slightly exceeds stability of releases indicating a need to bring the two metrics more in alignment.

    Some best practices considerations

    1. A strong majority (60 percent) say each developer in the business has a private development environment.
    2. Also, 77 percent say they use version control to store code and click-based Salesforce customizations.
    3. Most synchronize their development environments with the latest changes from other teams with 41 percent doing this on-demand or at most once per day and 42 percent saying they do this between once per day and once a week.
    4. 75 percent say changes made in version control trigger automation tests.
    5. 87 percent have confidence that when automated tests pass the software is ready for release. However, meta-analysis of the data strongly suggests that the greater a team’s confidence in their tests, the higher their change failure rate. Skeptics who were neutral on this question experienced a 40% lower change fail rate than those who expressed strong confidence in their tests.

    It’s good to be skeptical.

    Some analysis

    Part of the allure of the digital disruption is having the capacity to change a business process to take advantage of changing market conditions and many businesses are already having that experience. Big data and analytics tell us what needs attention but then we still need to change our systems’ behaviors. Flexible software contributes to a business’ agility and that’s good. But that speed and flexibility need to be balanced by security and what I can only call the bulletproof-ness of the new or changed code.

    The businesses most able to reap the rewards of DevOps tend to be smaller though large enterprises have their bragging points. While larger businesses already see benefits from a DevOps strategy, they are the ones with the greatest potential to do more. What’s holding them back?

    In any organization size breeds complexity which causes business friction. We don’t have all the data to say so unequivocally, but it seems that bigger organizations have more walls to break down.

    It looks to me like the development tools are pretty good. Not enough businesses have well integrated management suites to handle the complexity and it also seems like culture forms stovepipes which causes less stellar performance. If that’s so there’s still some cultural work to be done enhancing communications within and between developer groups and the business. DevOps tools can be a big part of that help but as with the psychiatrist trying to change a lightbulb, the bulb still has to want to change.

     

     

    Published: 4 years ago


    The software development lifecycle has always reminded me of the proverb of the three blind people confronting an elephant. One grabs the trunk and says it’s a snake, another a tusk and says it’s a spear while the third feels its side and calls it a wall. The moral of the proverb is that perception has a lot to do with perspective.

    For a long time, the perspective on software was that it was a cost, a necessary cost for sure, but other considerations like how users experience it and how employees work with it, as determined by its quality, were secondary. That perception was handed down pretty much intact from the mainframe days and as long as cloud computing and subscription services didn’t exist, it was good enough.

    But when cloud computing and subscriptions became mainstream the definitions of profit and ROI also changed. Profit shrank on a per-transaction basis though vendors knew they had to excel at small interactions to keep customers coming back. ROI was once a one and done phenomenon in which a new system paid for itself through cost savings that eliminated some labor from business processes through automation that let customers self-serve.

    Today ROI has changed because the return on a software investment is much less about automating to save money and much more about using software driven business processes to capture opportunities that pop up in the business world. So calculating the return is much more about time to market or time to value than ever. With that change, business needs to speed delivery of software but also, importantly, deliver software that works, is error-free, and gets a vendor there first to capture those ephemeral opportunities.

    It’s the old better-faster-cheaper conundrum but it’s no longer acceptable to get two out of three. We’re playing for all of the marbles here.

    New tools

    Into this milieu we’ve launched numerous intellectual tools and a few software of the software variety. The brain tools go by names like Agile, Scrum, Lean and more. The software tools are code generators, clicks instead of code development, and embedded functions like analytics, workflow, security, and integration services that the code generators weave together into a working application. Significantly, all of this lives on the modern software platform.

    In my humble opinion I don’t see how you can operate a modern application development shop without a platform. Many, if not most, vendors offer a platform or platform-like environment and a new approach to development called DevOps has been percolating in the IT space.

    A recent article in Harvard Business Review by Melody Meckfessel, VP of Engineering, Google Cloud, provides a thorough grounding in DevOps for executives wanting to understand more about yet another thing that has landed on their plates. A successful DevOps rollout in your organization will require some executive involvement because at its heart it is a culture change moving from silos to collaboration, transparency, and sharing. Check out Meckfessel’s article for more.

    Key values of DevOps

    Unlike the values of earlier programming paradigms, like lowering costs, a DevOps strategy orients toward time to value. I’ve been researching the topic over the summer and will have a detailed report soon but for now let it suffice to say that a well-articulated DevOps strategy can lower costs significantly while empowering employees to take reasonable chances when conceiving and delivering their work products.

    Most importantly for the business, DevOps, along with a software development platform that generates running code, is essential to any attempt at digital disruption. Gathering customer data and analyzing it will generate useful information, but a major part of the information needs to be incorporated into the software that supports new or enhanced business processes. So, I like to suggest an equivalence that says: software flexibility drives business agility, which drives profits in the modern enterprise.

    And what drives software flexibility? The close-in answer is the platform but the less obvious companion is DevOps. According the Harvard Business Review Analytic Services study mentioned above, 86 percent of those surveyed say that it is important for their company to develop and put new software into production quickly. But it goes without saying that the code has to work and be error free and that’s where platform is needed.

    It’s not too late

    If you’re feeling left out because your business is struggling with building and delivering software quickly, don’t be. The same study says only 10 percent of respondents say their company is very successful at rapid development and deployment. There’s a vast middle of respondents or 61 percent, who report being neutral or somewhat successful at rapid deployment and implementation.

    There’s more to this though. How do we determine what’s fast and what’s just average practice? Earlier data from my research suggests that leaders just getting into modern platform-based CRM think that rapid change is something that’s done as many as four times per year. But people who are in the middle of the transformation are shooting for being able to change their applications’ behavior nearly continuously deploying weekly or faster.

    My two bits

    Clearly, such rapid iteration needs both tools and approaches and that’s why DevOps is becoming such a big deal. Your approach to DevOps will be significantly different if you’re using a platform. For instance, issues surrounding operating systems and databases can evaporate if your platform deals with those issues thus enabling you to encounter DevOps at a higher level from the outset. From there on, DevOps is largely about supporting people, encouraging sharing and transparency and involving users. It’s an important part of your future especially if you’re trying to figure out if the rest of your business is successful, more so if you’re looking for ways to improve.

     

     

    Published: 4 years ago


    The tools you work with have a lot of impact on what you can accomplish and the more sophisticated the tools the better, especially in software. Beagle Research  just completed a study into using a DevOps strategy with the Salesforce Lightning Platform. You can get a copy of it here. The work was sponsored by Copado a DevOps solutions provider. DevOps is a strategy for building, changing and deploying enterprise software that can also be used with a Scrum or Agile methodology as well as others. More than concentrating on code and coding, DevOps is more holistic looking at culture and infrastructure in its broadest manifestation.

    Even if you’ve never built systems you can surmise that planning, developing, assessing, testing and deploying software are all critical milestones and they’re often spread across technical departments of IT like development and operations, hence the name.

    It can be challenging to compare enterprise software strategies. For instance, using an on-premise hardware and software stack has been common for decades but with the development of cloud computing, users find they can eliminate having to care about a good deal of their development environments leaving it all to the cloud vendor. How do you compare overhead and costs between cloud and on-premise? What are the effects on speed to market, reliability, security? To control for some variables and enable us to make an apples-to-apples comparison, we chose to research only companies developing and maintaining systems using Salesforce Lightning and a DevOps strategy.

    Companies ranged in size from fewer than 100 employees to more than 10,000. There were similar measures for number of salesforce users and number of developers as well as the number of production orgs. Two-thirds or 67 percent said they run between 2 and 7 production orgs. Most of the respondents were C-level executives (48 percent) or upper management (40 percent).

    We found that DevOps is delivering value for most of its users though the larger organizations have greater challenges, more on that in a moment; 17 percent claim over $5 million in benefits from using a DevOps strategy. These people have a good understanding that software flexibility drives business agility and impressively, 54 percent say their lead time for making changes to their Salesforce orgs is between one day and one week. Compare that to a more traditional process that takes weeks or months.

    But we also identified an elite group that operates even faster–21 percent say their lead time for making changes is less than a day, and 8 percent say it takes less than an hour. Taken together 83 percent can make changes in a week or less.

    In other recent research I’ve been involved in, delivering running, tested and deployable code was much slower. Clearly, if a business depends on its ability to quickly change to meet changing market demands this is where you want to be.

    On the other hand

    As you might expect though, the benefits of a DevOps strategy were not evenly distributed across all users. Generally, smaller businesses with smaller development groups did better overall at establishing DevOps programs and at excelling within them.

    The most successful businesses using DevOps are those that use a well-integrated set of tools to move through development and deployment. Many organizations, especially smaller ones, use a combination of in-house developed and opensource management tools. At best the great variety of tool choices suggested to me that some best practices are still being worked out.

    Even with Salesforce Lightning and a DevOps approach you can still have issues and almost everyone had the experience of deploying a release to a production org and having a service degradation. A plurality of respondents, 43 percent, said a problem occurred up to 15 percent of the time and the vast majority or 86 percent said service degradations happen less than half of the time. This is an important snapshot of the state of the industry. Speed of delivery slightly exceeds stability of releases indicating a need to bring the two metrics more in alignment.

    Some best practices considerations

    1. A strong majority (60 percent) say each developer in the business has a private development environment.
    2. Also, 77 percent say they use version control to store code and click-based Salesforce customizations.
    3. Most synchronize their development environments with the latest changes from other teams with 41 percent doing this on-demand or at most once per day and 42 percent saying they do this between once per day and once a week.
    4. 75 percent say changes made in version control trigger automation tests.
    5. 87 percent have confidence that when automated tests pass the software is ready for release. However, meta-analysis of the data strongly suggests that the greater a team’s confidence in their tests, the higher their change failure rate. Skeptics who were neutral on this question experienced a 40% lower change fail rate than those who expressed strong confidence in their tests.

    It’s good to be skeptical.

    Some analysis

    Part of the allure of the digital disruption is having the capacity to change a business process to take advantage of changing market conditions and many businesses are already having that experience. Big data and analytics tell us what needs attention but then we still need to change our systems’ behaviors. Flexible software contributes to a business’ agility and that’s good. But that speed and flexibility need to be balanced by security and what I can only call the bulletproof-ness of the new or changed code.

    The businesses most able to reap the rewards of DevOps tend to be smaller though large enterprises have their bragging points. While larger businesses already see benefits from a DevOps strategy, they are the ones with the greatest potential to do more. What’s holding them back?

    In any organization size breeds complexity which causes business friction. We don’t have all the data to say so unequivocally, but it seems that bigger organizations have more walls to break down.

    It looks to me like the development tools are pretty good. Not enough businesses have well integrated management suites to handle the complexity and it also seems like culture forms stovepipes which causes less stellar performance. If that’s so there’s still some cultural work to be done enhancing communications within and between developer groups and the business. DevOps tools can be a big part of that help but as with the psychiatrist trying to change a lightbulb, the bulb still has to want to change.

     

     

    Published: 4 years ago