The Lessons Learned Survey

Another useful tool in the Lessons Learned process is the Lessons Learned Survey.  This is a survey that can be sent to team members during or after a project, to solicit their feedback on how the project was conducted. It applies to any project; and questions can easily be added to focus on additional areas for your project.

A survey like this can be very useful for capturing lessons learned from the project while they’re fresh in people’s mind. The results can be summarized and recommendations passed on to future teams.

It’s usually best to send this survey by email to members of the project team. Let them know that results can be kept anonymous (to encourage people to be frank in their assessments). Send out this survey before any group “lessons learned” meetings. The feedback you receive from the survey can help point to particular areas that should get special exploration in the group lessons learned meeting.

Again, use this if it’s meaningful to your projects – it’s just another template or project tool that I’ve picked up along the way and wanted to share with our readers.  I’ve found it to be helpful in gathering post-project information from my team members on several key projects.

Post-Project Survey

SECTION 1: General Project Issues and Communication

The questions are geared to your particular project but wherever appropriate you can comment about release-level issues too.

Note: add any particular comments you wish….

1. How clearly defined were the objectives for this project?

___Very ____somewhat ___not very ___not at all

2. How clearly defined were the objectives for your work?

___Very ____somewhat ___not very ___not at all

3. How clear were you on your role in the project?

___Very ____somewhat ___not very ___not at all

4. How adequately involved did you feel in project decisions?

___Very ____somewhat ___not very ___not at all

If you did not feel involved, what decisions did you feel left out of?

5. How efficient and effective were project team meetings?

___Very ____somewhat ___not very ___not at all

What would you change?

6. How efficient and effective were technical meetings?

___Very ____somewhat ___not very ___not at all

What would you change?

___Very ____somewhat ___not very ___not at all

8. How adequate has cross-functional participation been?

___Very ____somewhat ___not very ___not at all

What were the problems encountered in the project-functional area relationship, why, and how could they be fixed? What cross-functional participation, if any, was lacking?

9. Do you feel appreciated, recognized and rewarded for your efforts?

___Very ____somewhat ___not very ___not at all

What if anything has been lacking?

10. To what degree is do you feel the entire team was committed to the project schedule?

___Very ____somewhat ___not very ___not at all

What if any issues are there?

11. To what degree have any “people issues” gotten in the way?

___Very ____somewhat ___not very ___not at all

What issues?

12. What communication, organization, structural problems in general were encountered, and how could we have done better in these areas?

SECTION 2: Schedule Estimation Issues

NOTE: This survey isn’t intended to collect exhaustive data on everything right now. We might decide after the post-mortem to work with a sub-group to investigate certain estimation issues, in order to help us improve next time around. This survey just helps us ferret out the rough scope of any issues.

Which of the following estimation issues did you personally have and what was the impact?

___ I was diverted to work on another project full-time.

Project: ________________________________________ Diverted for how long? ________________

Impact on your project work: ____________________________________________________________

___ I overestimated the amount of time I would have each week to work on this project.

The other work that interfered was ________________________________________________________

The amount of time per week it took up was ________________________________________________

Impact: calendar schedule slip of ____days ____weeks ____ months

___ My initial schedule did not include some pieces of technical design or coding work that I subsequently realized I had to do.

Describe briefly: ______________________________________________________________________

Impact (additional hours of work): ________________________________________________________

___ My initial schedule did not take into account certain project “other” work such as attending other people’s design reviews, doing two rounds of my own design reviews, etc.

Describe: ____________________________________________________________________________

Impact: calendar slip to my work of __ days __ weeks __ months

___ My estimates for particular tasks were not accurate.

Describe: type of task, how “off” the estimate was (days, weeks).

Why was it difficult to estimate?

What would help produce better estimates next time?

__ I unexpectedly had to re-do some work.

Describe: (Did something in the system design change that forced you to redesign? Was there a spec misunderstanding? etc.)___

Impact on your schedule: _______________________________________________________________

What could have helped prevent the problem?

Knowing what you know now, how would you do the scheduling/estimating process differently next time to avoid any problems noted above?

SECTION 3: Design, Implementation, Test Processes

1. How effective was our architecture/system design process in phase 2 and 3?

__Very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

2. How effective were our functional specs?

__very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

3. How effective were our design (or implementation) specs?

__Very __somewhat ___not very ___not at all

Comments:__________________________________________________________________________

4. How effective were our design reviews?

__Very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

5. How effective were our code reviews or hardware reviews?

__Very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

6. How well were interfaces defined?

__Very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

7. How well were design and interface decisions documented?

__Very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

8. How effective has interaction/cooperation between technical “Sub-teams” been?

___Very ____somewhat ___not very ___not at all

Comments:_________________________________________________________________________

9. How useful was your unit testing?

__very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

Did you take unit testing into account in your schedule? ______________________________________

10. How smooth do you feel Integration has been?

__very __somewhat ___not very ___not at all

Comments (why/why not?):___________________________________________________________

11. How comprehensive was integration testing, especially to allow SQA testing to get off to a good start?

__very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

12. How well is the build process working?

__very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

13. To what degree did you have the tools you needed for testing?

__very __somewhat ___not very ___not at all

Comments:_________________________________________________________________________

SECTION 4: Perceived Project Life Cycle, Development, or Process Issues

1. Is there any way in which you think our development process hampered this project?

If so, how?

2. What would you change about our development process?

3. What would you like to better understand or see better documented about how to use our process on this type of project?

SECTION 5: Closing

1. What were up to 5 main causes for schedule slips, and how could we avoid those causes in the future?

2. Was the project significantly delayed/hampered by outside dependencies (outside to the project, that is)? Which ones? How can we resolve these issues?

3. What were the main bottlenecks on the process?

4. What were the main sources of frustration in the project?

6. For the next project, how could we improve on the way project was conducted?

Phases of a Construction Project Life Cycle – Part 4

In Part 4 we will examine the final two construction project phases as described by F. Lawrence Bennett in his book “The Management of Construction – A Project Lifecycle Approach.” In this final installment, we review the project operations and project closeout and termination phases.

Project operations phase

In presenting the contractor’s activities on the construction site, we will suggest, perhaps too simply, that the responsibilities involve three basic areas: monitoring and control, resource management and documentation and communication. Five aspects of monitoring and controlling the work are important. Actual schedule progress must be compared against the project program to determine whether the project is on schedule; if it is not, actions must be undertaken to try to bring the program back into conformance. Likewise, the cost status must be checked to establish how actual performance compares with the budget. An equally important part of monitoring and control is quality management, to assure that the work complies with the technical requirements set forth in the contract documents. In addition, the contractor has an important role to play in managing the work safely and in a way that minimizes adverse environmental impacts.

In managing the project’s resources, the contractor will, first, be concerned with assigning and supervising personnel and assuring that the labor effort is sufficiently productive to meet schedule, cost and quality goals. In addition, materials and plant must be managed so that these same goals are met. Because construction projects require large amounts of paperwork, a special effort is required to manage this documentation effectively. Examples include the various special drawings and samples that must be submitted to the owner or design professional for approval prior to installation, the frequent need to respond to requests for changes in the project after the on-site work has begun and the all-important process for periodically assessing the value of work completed and requesting payment for this work. Various on-line and other electronic means are available to assist contractors with document management and project communications.

Project closeout and termination phase

Finally, as the project nears completion, a number of special activities must take place before the contractor’s responsibilities can be considered complete. There are the various testing and startup tasks, the final cleanup, various inspections and remedial work that may result from them and the process of closing the construction office and terminating the staff’s employment. In addition, a myriad of special paperwork is required, including approvals and certifications that allow the contractor to receive final payment, a set of as-built drawings that include all changes made to the original design, operating manuals, warranties and a final report. The contractor will also be responsible for transferring and archiving project records and will conduct some sort of project critique and evaluation; operator training may also be part of the contractor’s contractual responsibilities.

Stopping doesn’t equal closing

We talk about stopping projects as if it always means that they are over – and effectively, we are closing them down.  It isn’t always the case.  There is a fine line between stopping a project and closing a project.

Stopping a project can happen once a major issue is uncovered.  If it is something you need a Project Board decision on, the project stops until you have the direction that you were waiting for. In practice, what will happen is that as soon as you realise you are going off track in a serious way, you’ll have to go through the issues process (talking in terms of the PRINCE2 approach) and produce an exception report.  The Project Board will request an exception plan and project effort will shift to producing one of those, based on the options available.  The project manager and Project Board will arrange an exception assessment to discuss and agree the new way forward.

During this planning and approval process there isn’t much that can be done, depending on the issue you are facing. The project, therefore, is stopped.  You might want to call it ‘on hold’ but the outcome is the same regardless.  In practical terms it might not be everything that is stopped.  You could find that there is some project work that is not subject to the exception plan and these tasks can carry on.  It is likely, however, that for a significant issue there will be an impact on all areas of the planned work, so even if you are able to keep things moving in certain workstreams, there may be changes to these later as a result of the outcome from the exception assessment.

The exception assessment will give you the green light to continue, albeit by putting the exception plan into practice.  The old plan gets thrown away and the exception plan takes its place, and you follow that until the end of the stage.  The ‘stopping’ is over, the issue is resolved, the Project Board decision is made about the route forward and the project can recommence.  So a stopped project can get ‘unstopped’ if there is a way out of the problem.

Closing a project does mean closing it down.  The project may have been temporarily stopped – either like in the above situation or for any other reason such as a change in the economic situation.  In PRINCE2 terms, closing is a project is the equivalent of the Managing Stage Boundaries process, but in your final iteration of the Controlling a Stage process, instead of invoking Managing Stage Boundaries, you invoke Closing a Project.  It involves some of the same principles as Managing Stage Boundaries, but doesn’t include any of the work required to start up a new stage, as obviously by this point there isn’t any more work to do.

During the Closing a Project process you are effectively decommissioning the project in its entirety.  The project manager gains operational acceptance from the people who will be running with the product in the long term.  The customer also has to provide their acceptance and agree that the project has delivered what was required.  Files are archive, the post-project review is planned and the lessons learned log is updated.  Any follow on actions are documented for the operational team.  Finally, you should produce an end project report, summarising whether the project has met its objectives and any comments on the project management process.

In summary, if you stop a project you can start it up again, but if you close a project, it’s decommissioned and no longer possible to do any work on it.  Next time someone asks you to stop a project, make sure you understand what they are asking for!