Monday, 2 February 2015

Planning 11.1.2.4 New Features

So much was promised for the 11.1.2.4 release of planning but unfortunately some of the key new functionality missed out on the release and it looks like it will be delivered in a PSU.

The main new feature is the simplified interface even though it is not really new as it first appeared in 11.1.2.3.500 and was aimed purely at accessing the interface through a tablet which I blogged about here.

You still got the same functionality if you accessed the interface through a desktop browser but now in 11.1.2.4 the interface has been expanded to include more options and new functionality for administrators.

Basically the new functionality is a port of the PBCS .601 release, in fact some of the functionality that probably should not really be in 11.1.2.4 release has been left it and the documentation is practically the same with references to PBCS which I will get on to this later.

Oracle has highlighted some key performance enhancements when using the simplified interface:
  • Because Planning forms now use the latest client-side scripting technologies in the new simplified user interface you’ll enjoy faster response times when you scroll, enter data.

  • Because most work is now done on the client side, server requests are greatly reduced. We estimate that servers can now handle 33 percent more load than before in the same response time.

  • Planning is, by default, configured to preload data when you open forms. To optimize performance, turn on compression by updating your web server or Load Balancer configuration. The Oracle HTTP Server instance that you install from the EPM System installer is configured to support compression. If you are using a different web server, see your web server or Load Balancer documentation for instructions to turn on compression.
Now I am not going to go through every screen in the simplified interface because you only need to search for details on PBCS .601 and you will find it has all been done before, I am going to concentrate on the areas that are different from 11.1.2.3.500 and from an administrative perspective.

The good news is the interface will work on most browsers including chrome and bypasses the requirement of logging into workspace.

To access the simplified interface point your browser to either:

http(s)://<planning_server>:<port>/HyperionPlanning
http(s)://<web_server>:<port>/HyperionPlanning


Once you log in you will be presented with the available planning applications.


An administrator can now mange data sources and create/ delete applications.

Once the application has been selected you will be presented with all the sections that can be accessed through the interface.


In 11.1.2.3.500 there was a section called Forms this has now been renamed to Plans but basically they are the same.

It is worth pointing out that if you want users to view task/forms/rules then you will need to add them using tablet access which can be access from the standard and simplified interfaces.


One of the new features is the ability to create eye pleasing dashboards which include forms, charts, external link and commentary.


The other new area is console which is aimed at planning administrators.


The console area has many of the same features as the standard interface such as setting dense/sparse, dimension order, evaluation order, refresh planning etc


There is the functionality to import/export metadata and data but with this release there are additional options for the location of the import/export and the concept of jobs and scheduling.


The location options for exporting are Local, FTP and Planning Outbox.

Selecting Local will allow the metadata/data to be download in a compressed format to the local client machine.


The FTP option allows to import/export from an FTP site.


If it is an import then you also provide the file names of the import files.

When using the FTP option a job has to be created.

“Jobs are actions, such as exporting data or refreshing the database, which you can start right away or schedule to run at intervals. The Jobs console lets administrators manage jobs in the simplified interface.”

The following types of jobs can be managed in the console:

Rules, Import data, Import metadata, Export data, Export metadata, Refresh database, Plan type map.




Once the Job has been saved it can then be scheduled.


I have selected the Job to run immediately though are a number of different scheduling options available.


If you have multiple jobs created you can select the required one.


Once the job was executed I checked on the FTP server and all looked good.


A compressed file named the same as the Job is sent to the FTP site and contains each of the import/export metadata/data files.


It is worth understanding what is happening on the server side when an import/export takes place for housekeeping reasons.

In the EPM instance tmp directory there will be a file generated for each of the import/export metadata/data files and the compressed file.


These files are not deleted so over time if a lot of activity is taking place the size of this directory can mount up and should be added to housekeeping plans.

It is also possible to change the location of the temp directory by changing the option values for the Planning java web application.

There are also logs generated in the planning logs directory so if any issues are experienced then that is the place to check out.


So how about the third location option for import/exports which is the Planning inbox/outbox.

“The Planning Inbox/Outbox enables you to upload files to the server/inbox and download the files from the server to your local computer. It also lets you view the files that are in the inbox/outbox and then use the files to schedule import and export jobs.”

This time I will export data to the Planning outbox.


The slice definition is exactly the same as you will probably be used with the outline load utility or through the planning standard interface.

The process is the same as I went through previously, save the Job and then schedule it.


Once again I am going to run the job immediately.


So this time the data is exported to the Planning outbox which you can access through the console so you can download whenever you like.


The explorer also allows you to upload files.

You may be wondering where is the location of the inbox/outbox, well it is exactly the same location which has been defined as the LCM import/export directory which in many cases has been assigned to a share.


I am not aware that the location can be changed so you will need to be mindful of naming conventions to differentiate between LCM files and if the inbox/outbox is going to be heavily used there are going to many files sitting in the root import/export directory.

As with the metadata the temp directory will also be used as part of generating the files.


It looks like the export data is first created in the temp directory and then renamed and copied to the LCM directory.

If on windows the account running the planning service will no doubt need access to the LCM directory.

Once again there will also be logs generated for the export.


I am not sure what the 0KB file is all about in the temp and log director, maybe the log files should have been added to the zip.

What looked a little odd to me was the recent activity in the job console seemed to always be empty in the simplified interface.


The job console can be accessed through the standard interface under Tools > Job Console and correctly contained the job history.



It is also possible to view the import/export status through standard planning by going to Tools > Import Export status.



I have noticed something strange with LCM which I am assuming is a functionality change or a bug because it did not occur in 11.1.2.3.

When you start up Shared Services you will see the following in the logs


Basically every time you restart foundation any of the zip files in the LCM import/export directory will be extracted which in my opinion can’t be correct but it seems that LCM now does not compress the LCM files into zip format by default which is a change from 11.1.2.3, I can’t see this documented anywhere though.

This is also causes problems related to the Planning inbox/outbox.

Currently I have the data export ExpData.zip sitting in the outbox directory (LCM directory)

I restart foundation.


The zip is extracted and the zip is removed so you left with a folder and the extracted files.

If you go to the Planning Inbox/Outbox Explorer the file has now disappeared.


As it is now extracted if I go into Shared Services I can now see the folder under the file system.


If I zip it up again then it appears in the Planning inbox/outbox explorer.

I am sure this is going to cause confusion if the Planning inbox/outbox is going to be used.

While we are on the topic of confusion there is an option in the console called “Maintenance Time


This is for PBCS only and even the on-premise documentation is for PBCS

“By default, Planning automatically performs daily system maintenance starting at midnight local time. During the nightly maintenance window, the system performs backups, applies any patches, recycles the application, and so on. If you prefer, you can schedule daily maintenance to occur at another time.”

I am sure if an on-premise planning administrator reads the above statement they would start to get a little concerned.

Another new area in the simplified interface is the Navigator area, this provides access to administrative options and can links back to Shared Services (Application Management) and FDMEE by opening a new window while still maintaining the SSO.



Nothing really surprising in the navigator section but it shows that a lot of functionality is covered in the simplified interface, shame to see that the user statistics has still not progressed from the early days of planning and is still as bad as ever.

There is a new planning property called FUSE_MEMBERS_THRESHOLD

“If performance slows when you launch the Edit Member page in the simplified interface, Oracle recommends you add the FUSE_MEMBERS_THRESHOLD system parameter to limit the maximum number of members displayed during page member lookup. The default value is set to 500. If this property is defined, the maximum number of members displayed will not exceed the value defined for the FUSE_MEMBERS_THRESHOLD property.”

The property can be added through standard planning.


The forms accessed through simplified interface now include instant save.

“When planners work in simple data forms and they click or tap Save, their new or changed data is saved instantly—without a confirmation message—if the structure of the data form hasn't changed. For example, instant save works automatically unless any of these options is selected for the data form (because they change the structure of the data form):
  • Suppress missing data
  • Suppress missing blocks
  • A business rule is selected to launch on Save (other than the default Calculate Form and Calculate Currencies business rules).” 
There is also the option to set a property called Autosave in the grid properties of a form, this option is only for forms accessed through the simplified interface.

When planners move out of a cell, their changes are automatically saved, with no prompt or message. Cell values are aggregated to their parents, and the affected cells are displayed with a green background.

Planners can successively undo actions with Ctrl+Z.

Again this functionality does not work when suppress missing data or blocks is enabled.

“For optimal Autosave performance, you must have only dense dimensions on rows and columns. However, if you must put a sparse dimension on either a row or a column, for improved Autosave performance on block storage databases, enable hybrid aggregation with the Essbase configuration setting ASODYNAMICAGGINBSO.”

It’s worth mentioning that a new feature in Hybrid Essbase is that Time-balance tagged members and Dynamic Time Series members can be calculated so it is definitely worth investing time to see if Hybrid mode will work for your planning application.

If you are going to use both the simplified and standard planning then when moving from simplified to standard make sure you log out and clear the cookies or you could end up with formatting issues in standard planning.



Finally planning no longer supports the Classic user interface (that is, up to and including Planning Release 11.1.2.1) so if you are upgrading there will be no option to use it anymore.

Wednesday, 28 January 2015

EPM 11.1.2.4 Installation and configuration

As expected there was a flurry of activity on social media that 11.1.2.4. had been  released though it was only the downloads that had been released on OTN, no documentation, no support matrix or edelivery and the OTN release is not packaged up in the same way, one year the OTN EPM downloads were a beta release so should never be trusted (wait for the edelivery release)

It would make more sense to release the documentation first but then again the way some people go about it these days is to install first and then ask questions before even reading any of the docs :)

All that time Oracle had to prepare the way it was  released and in the end it was done in an unstructured way. :)

Seeing as I have no choice to go down the route of OTN and with no documentation then so be it, I will update this post once all the documentation becomes available with the highlights.

UPDATE 29/01/2015: Documentation can be found here or all documentation here

UPDATE 28/01/2015: Support Matrix has now been updated and can be downloaded from here

The noticeable changes in 11.1.2.4 compared to 11.1.2.3.x are:
  • OS support added for Windows Server 2012 (all SP levels inc)/R2
  • OS support removed for Windows Server 2003
  • Client OS support added for Windows 8.1 and Windows Server 2012 (all SP inc/R2)
  • Client OS support removed for XP and Vista
  • Browser support added for Internet Explorer 11.x and Firefox 31.x ESR
  • Browser support removed for Internet Explorer 7 and 8
  • No changes in Oracle database repository support though Microsoft SQL Server 2012 (all SP levels inc) has been added
  • No changes in supported versions of Microsoft Office which are 2007/2010/2013
  • Websphere application server support removed
  • Smart View compatible version for 11.1.2.4 is 11.1.2.5.400
There are some caveats on the above so for more detailed information check out the support matrix.

As windows 2012  is at last supported I am going to take the plunge and install on it and configuring against Oracle 12c (12.1.0.2.0) database.


Just like in my previous installation post this is not going to be a step by step guide to installing and it will be only be covering key aspects or changes from 11.1.2.3

Please be aware as this has just been released it just my initial view which I am sure will change once I have gained more knowledge on the release.

Once the files are downloaded and extracted under the same location you will notice there have not been any changes to the file structure.


There are a few additions in the root installation folder.


Supplemental Data Manager and Tax Supplemental Schedule Smart View Extension installers.

Running through the installation is exactly the same as previous versions.


Interesting to see the operating system is supported but categorised as Windows NT (unknown)

Most of the options are the same on the product components screen though there are few changes.


As you will notice FDM has been removed, farewell and time to move on to the much superior FDMEE.

The new Tax Management product including Tax Governance and Reporting is available.

Financial Management includes the new SDK and the ADM option has gone.


I went to install all the products just to test whether there would any problems installing on Windows 2012 but as you can see all green.

The underlying directory structure remains constant.


What I am surprised at the versions of jdk and jrockit have not been updated from 11.1.2.3

Now on to the configuration which remains in the whole pretty much similar to 11.1.2.3 and I will miss out some sections.


The configuration to Shared Services and Registry Database has no changes.


Once again the product configuration options are very similar to that of 11.1.2.3


There is the new addition of Tax Management and the removal of DCOM and the web server from the FM configuration.

In this configuration I am not going to configure FCM/Tax Management as they require SOA so I will leave that for another day.

Under FDMEE the register HFM adaptor is no more now that HFM has moved into the Java world so it will be built into FDMEE by default.

The common components screen now has a new option to enable SSL offloading and host details.


The configure database screen no longer has the option to upgrade from a 11.1.1.4+ version.


The deploy application server still has the annoying deploy to single managed server enabled by default which I quickly deselected.


The essbase configuration has a new additional option to set the binding host name which I know will help in cluster configurations.


From the docs:
"Specify a Binding Host Name to have Essbase bind only to the IP address for the specified Binding Host Name. Otherwise, at startup, Essbase binds on all available IP addresses."

There are now only two configuration screens for FM


>The FM configure server has the new options for the server port and datasource port range.

The cluster configuration remains the same.


The hardly ever used and more annoying than anything Oracle Configuration Manager (OCM) Registration has been removed so another less thing to worry about especially on Linux.

And besides all screens which are exactly the same as 11.1.2.3 then that is pretty much it and off the configuration goes.


Surprisingly enough I didn’t have any failures on win2012 and the validation report is all happy too.

If you take a look at the windows services there is not much of a shock.


Financial Management is down to two services instead of four.


The service names, logs etc still contain references to system 9 how we have moved on :)


IIS is very quiet indeed with no FDM and no FM now that it has fully moved in to java web application world.


Firing up all the services was once again successful and you can see that workspace has a very slight makeover.



Well I will leave it there for now, obviously there will be much more to follow once I delve a little deeper

Thursday, 1 January 2015

EPM - Did you know? #5

Time now for the fifth and final part of the “did you know” miniseries and from the list of topics the following has been randomly selected for today:

Did you know there is an EPM System Activity Report in 11.1.2.3+?

It is not documented and probably was only developed for use with Oracle’s PBCS but nevertheless it does exist and can be run on any EPM server.

The report generates the following statistics:
  • Weblogic Top 10 Least Performing End User URL Requests
  • WebLogic Top 10 URL Request Instances by Duration
  • WebLogic Top 10 Functions by Number of Executions
  • WebLogic Number of Requests by Webapp
  • WebLogic Top 10 Number of Active Users by Period
  • WebLogic Top 10 Users by Duration
  • WebLogic Non-200 Status by Number of Requests
  • WebLogic Top 10 URLs by Number of Requests
  • WebLogic Top 10 URL Requests by Size
  • WebLogic Funtionally Unknown URLs
  • Database Top 10 Queries by Duration
  • Database Top 10 Queries by Execution
  • Essbase Top 10 Calc Scripts by Duration
  • Essbase Top 10 Calc Scripts by Execution
  • Essbase Top 10 Calc Scripts Execution Instance by Duration
As this looks like it has been developed for PBCS then the WebLogic statistics are only against the planning web application, the database statistics are produced against an Oracle database and looking at a single schema development.

So this report is obviously not for everybody but it highlights what is being developed in the background to the on-premise world.

Basically the WebLogic section of the report is built up from parsing the access log in the planning managed server logs directory.

The database section is generated from the Automatic Workload Repository (AWR), the AWR is used to collect performance statistics for the Oracle database.

The essbase section is generated by parsing the application logs for each database and focusing on the execution time of calcs.

To run the report is very simple and can be achieved from command line by running something similar to:

set classpath=E:\Oracle\Middleware\modules\com.bea.core.apache.velocity_1.4.jar;%EPM_ORACLE_HOME%\common\SharedServices\11.1.2.0\lib\epmactivity.jar;%EPM_ORACLE_HOME%\common\jlib\11.1.2.0\epm_j2se.jar;
set EPM_ORACLE_INSTANCE=E:\Oracle\Middleware\user_projects\epmsystem1

java -DEPM_ORACLE_INSTANCE=%EPM_ORACLE_INSTANCE% com.oracle.epm.activity.EPMActivityReport


This will generate an html report named EPMActivty.html in the diagnostics reports directory.


The report is broken down into all the statistics which I mentioned earlier.

It is possible to use parameters to generate the report within a specified number of days or between a specified time period.

To run the report for a specified number of days you would use:
–tday <DAYS>


So to run for the last 10 days it would be:

java -DEPM_ORACLE_INSTANCE=%EPM_ORACLE_INSTANCE% com.oracle.epm.activity.EPMActivityReport –t  10

To run the run against a time period the parameter format is
–t  <from date/time> <to date/time>


The “from and “to” time must be specified in YYYY-MM-DDTHOUR:MIN:SEC format using a 24-hour clock.

For example:

java -DEPM_ORACLE_INSTANCE=%EPM_ORACLE_INSTANCE% com.oracle.epm.activity.EPMActivityReport -t 2014-12-01T00:00:00 2014-12-31T23:59:59

There is also a separate report available which is only run against essbase and something similar can be run on any essbase server:

set classpath=E:\Oracle\Middleware\modules\com.bea.core.apache.velocity_1.4.jar;%EPM_ORACLE_HOME%\common\SharedServices\11.1.2.0\lib\essbaseactivity.jar;%EPM_ORACLE_HOME%\common\jlib\11.1.2.0\epm_j2se.jar;
set EPM_ORACLE_INSTANCE=E:\Oracle\Middleware\user_projects\epmsystem1

java -DEPM_ORACLE_INSTANCE=%EPM_ORACLE_INSTANCE% com.hyperion.essbasemonitor.EssbaseLogParser



There is another caveat to the reports generating any essbase results and that is it will only run against the appname.log and not the equivalent appname_odl.log

If the ODL logs exist the essbase sections of the reports will be blank, to get around this the ODL logs can be removed and disabled by editing the logging xml file, and did you know that was possible? Sorry that didn’t to the selected topics for this series.

The essbase activity report will be generated in the same location and named EssbaseActivityReport.html


If you are wondering what the inline scripts are in the report these are generated from planning business rules

I am not going to cover it but It is even possible to alter the design of the reports by editing certain template files.

So that is the end of the series which I hope some have found useful, there are many other topics in the list that could have been covered but unfortunately I have run out of time, maybe the series will return again some time in the future.

Tuesday, 30 December 2014

EPM - Did you know? #4

Back again with the fourth instalment of the “did you know” series and the random topic for today is:

Did you know that you can alter the frequency or disable the essbase OPMN ping?

Personally I think OPMN was a bad choice to inflict on essbase and has been more trouble that it is worth, it only seems a viable solution for clustering on *nix type systems and the rest of the time it is a waste of space, it would have been nice to be given the option of not having to deploy it with essbase, anyway it is an old technology and looks like it is not going to be in Oracle’s strategic future.

In case you are wondering what the OPMN ping is all about I will give a little bit of background information.

If you look in the essbase product bin directory you will see the OPMN ping executable:


What it basically does is log into essbase with the admin account and then log out this indicates whether essbase is alive or not which is a requirement when clustering.

By default this happens every 20 seconds and if you take a look at the essbase log you will see it constantly polluted with something like:

[Tue Dec 30 10:12:29 2014]Local/ESSBASE0///964/Info(1042059)
Connected from [192.168.1.115]

[Tue Dec 30 10:12:49 2014]Local/ESSBASE0///964/Info(1042059)
Connected from [192.168.1.115]


As you can imagine this amounts up to many entries over time and doesn’t serve much purpose in the log.

There are also other logs that get written to under the OPMN logs directory.


I seem to find that at many clients this log folder is not part of any housekeeping solution and the essbase ping and agent log can become large in size.

Unfortunately there does not seem to be any options to rotate these logs even though there is a setting in the opmn.xml


The rotation size works with the opmn log but not does not seem to work with the ping or agent log, I remember a enhancement request back in 2012 to be able to add the option to but I am not sure it got anywhere.

14556989 - ABILITY TO DO LOG ROTATIONS ON ESSBASE. OPMN, AND ESSBASE STUDIO

If you look in the EssbasePing.log then you will see the following messages repeating every 20 seconds.

[2014-12-30T11:02:15.272-18:02] Initializing Ping Request
PM-PingUtility INFO: Connection is done
PM-PingUtility INFO: Received Response from the Essbase Agent
PM-PingUtility INFO: Essbase Message - PING_OK
PM-PingUtility INFO: PING SUCCESS


If there is a problem connecting or logging into Essbase then you will see a similar message to:   

[2014-12-30T11:25:13.539-18:58] Initializing Ping Request
PM-PingUtility: Couldn't connect to Essbase with Essbase ERR# 1042006
PM-PingUtility: Fails to Ping the Essbase Agent 1042006


In a non-clustered essbase environment this is not really providing much benefit as the message just repeats and unless the log is being monitored it would go unnoticed, if required the same solution could be easily created with a Maxl script.

Luckily the opmn ping log does not have a lock on it so it can be removed with stopping services.

So how about altering the frequency of the ping and how can it be done.

Well it is back to the opmn.xml file located in:

<EPM_ORACLE_INSTANCE>\diagnostics\logs\OPMN\opmn


There is an element called ping and an attribute called interval that can be added to the XML file

For example <ping interval="60"/>


The interval is the number of seconds between each ping so in the above example after a restart to OPMN the ping will have gone from 20 seconds to 60 seconds.

After making any changes to the xml file I was always like to use the validate command to check the file is still valid.


The maximum value is 7200 seconds and if you try and set it any higher then you should see the following error message:


The maximum value is defined by the XML schema definition file:


It is possible to change the value in the XSD file so I tested increasing the maximum value to 10800 and the ping interval matched the value.

So how about disabling the ping process well it couldn’t be simpler just set the interval value to 0.


If you set it to 0 and restart OPMN then you will no longer be bothered by the ping.