New Cognos Maps! (Almost)

An IBM R&D team lead was kind enough to invite me for a chat at one of their labs. The team is building a new mapping solution for Cognos! It doesn’t look like it’s going to be as complicated, or have as many features as the ESRI maps, but it is far superior to what vanilla Cognos has now.

While I don’t have access to any screenshots to share here, I can describe what I was seeing. The demo was showing data pulled from the Amsterdam public transportation system. Unplanned bus stops by time of day. Unplanned could be red lights, stop signs, traffic, or even accidents. They showed a simple map of the city, with a clock plot over each area showing stops by time of day.

Creating a map can be as simple as taking an image and defining the coordinates for the corners. Apparently they support 3,500 different coordinates systems. This tool allows for the creating of internal maps too. Import your image, use a fill or polygon tool to create areas, or drop dots in certain locations. Both of which can be assigned various names for use in reports. They’re also working on a way for the software to analyze the image and try to guess specific zones. This would be incredibly useful for malls, or other places which need to track many small zones.

At the moment Cognos doesn’t have any form of map creators. The native maps (pre-RAVE), needed a third-party tool with a hefty price-tag. RAVE maps are possible, but tricky. You need to use mapping software and export is as a GeoJSON featureset. Several years back my client had a requirement to build an internal map showing the workflow of a series of manufacturing machines. Each step had to be colored based on a metric, and each machine had to have it’s grade displayed prominently next to it. As I didn’t have a MapInfo license, I needed to get tricky. Ultimately I had a solution in which each machine part was a separate image with transparency set. With each image in it’s own absolute positioned div, and all of the divs inside a singleton, a lot of conditional formatting setting the background color. This tool would have saved me a week of work.

Don’t get too hopeful about seeing this tool anytime soon though. They reminded me that they’re an R&D lab, not a software group. What they’re developing should become the basis of a new tool. We’re going to set up another meeting, and hopefully I’ll be able to get their test software installed at one of my clients. They need to know more about customer needs. How will customers use the maps? What are customers hoping for?

Feel free to leave a comment about what you would want in a new Cognos mapping tool. I’ll bring the list of comments to my next meeting with them.

A few notable solutions from the IBM Insight conference

There were many wonderful examples of ingenuity at the IBM Insight conference. From the cognitive computing teams (I <3 Watson) to the tips and tricks from the various sessions, the conference was well worth every penny. Unfortunately I can't describe every session or expo booth I attended, but here are three that are outstanding. 1. QUBEDocs
I recently had the pleasure of working with a certain organization with a “mature” TM1 environment. The culmination of years of bad practices left thousands of rules, and the stability of a house of cards. Except the cards are made of crystal and the house is in San Fransisco. That makes it sound worse than it was, but as the reporting guy there were a few days I was sitting on my hands waiting for the system to come back up. The people there were wonderful, and I honestly hope to come back there.

If only we had QubeDocs software. At the most basic level, Qubedocs is an automated documenting and tracking tool for TM1. But that hides the wonderful intricacies of the tool. At this project, like many others, we had to deal with a spiderweb of interconnecting rules and cubes. Qubedocs could very quickly parse through the rules and describe dependencies and find invalid rules.

Impact analyses, error highlighting, change tracking, documentation. These are all things that should natively part of the tool. Nothing I can say would give it the justice it deserves. I strongly recommend clicking on “See how it works” to see the videos. I’m going to see if I can get one of my regular clients to buy a license to give me the chance to play with it.

2. ITGain
ETL is one of those things that I can do, but it’s never sexy. ITGain’s software SpeedGain is ETL monitoring software. In their demo, they showed a simple dashboard displaying the state of server, CPU time and sort operations. In ETL proceses, high sort means bottlenecks. CPU means the ETL is doing something, anything else means you’re sitting there twiddling your thumbs.

speedgain dashboard

A mature environment might have dozens or more processes. How can you identify which module is causing the bottleneck? SpeedGain will allow you to drill down to find the module in question, or even the individual SQL statements. It will list the individual statements by executions and cpu time.

speedgain SQL Statements by CPU time

Sort operations, as we all know now, are often caused by poorly designed indexes. So SpeedGain will actually recommend one. After implementing the suggestions the runtime of the slow ETL module is reduced dramatically. Since the statements didn’t need to scan the table, we could see the sort operations drop to almost nothing, with CPU time increasing as it has data to work with.

speedgain SQL analysis

At the moment they are supporting DB2 and Oracle.

3. Miami-Dade County Cognos Audit
The Miami-Dade County is a large user of Cognos. The reporting for many services have been folded into their implementation. They also have internal and external facing Cognos setups, meaning that we can actually view many reports. Because of their immense set up, and thousands of named users, they need to have a robust security and audit system set up. The audit also serves as proof of use to justify budgets and to encourage moving more services to their systems.

By default the Cognos audit reports are fairly ugly and slow. When dealing with thousands of users, and even more reports, just opening the prompt page can be an exercise in patience. The reports here are designed to be fast dashboards.

The biggest issue I have with this solution is that is was built natively against Oracle. Adapting it to SQL Server or DB2 is possible, but takes some work.

I’ve attached the solution with their permission below.
Miami-Dade County Audit Reports (779 downloads)

Quickie: Aggregating text in a Cognos crosstab

The ability to show text in a crosstab is highly requested feature. Various work-arounds have been found, such as using layout expressions like: case when [Flag] = 1 then ‘Yes’ else ‘No’ end. This works, but doesn’t allow for truly dynamic crosstabs.

Consider the following requirement. The user wants a crosstab that shows Region, Retailer Type, and a list of Company Names in the intersections. He wants to be able to filter by Product Line to limit the companies that are shown.

aggregating text

In the above example, I’m using DB2. DB2 has the function listagg, which aggregates text with a specified delimitter. Oracle has something similar, group_concat. SQL Server has some UDFs that can do the same thing, such as found here.

This can now be accomplished as of 10.2.1 Fix Pack 3. One of the new features of this fix pack is a way of using non-standard aggregation functions. By prepending “aggregate:” before the function, we are instructing Cognos to trust us that this is an aggragative function. It won’t try to put it in the group by. This makes it incredibly easy to get this effect, the expression in it’s entirety is aggregate:listagg([Sales (query)].[Retailers].[Company name],’, ‘)

aggregating-text.txt (2119 downloads)