DEU

Data Services

We are your translator for geodata

Data Services

We support you with the analysis of source data and the conception and the realization of suitable interfaces and conduct all data migration necessary for the implementation of new IT systems.

We edit and convert your data meeting various requirements, using our long-standing expertise as well as up-to-date software technology.

We support all processes relevant to Spatial ETL (Extract-Transform-Load): Therefore, the data is usable for various applications, can be edited according to specific requirements and can be implemented in core systems.

 

Analysis

 

Clear formulation of targets: Since one cannot take the right path without knowing the destination.

 

As a first step we define the exact goal together.

No matter what is important to you, whether it is data migration, the adoption of data from a legacy system or the realization of an interface which constantly converts data, what is always essential to us is the following:

The result has to be at least as good as the original material. Valuable contents and connections are preserved or become visible and evaluable in the first place and redundancies and inconsistences are corrected.

Particularly if legacy systems have been used for a long time, the original data is often decentralized and there are overlaps, duplicates and different versions in different divisions. We gladly take on the challenge of finding a consistent, unitary structure for you.

In the case of a migration the first and often automated step is the analysis of the source data, in order to be able to make statements about the quantity structure, different layer and coordinate systems, geometry types, symbolisms, line length, attribute contents, explicit values for line types etc. and much more. We try to make the result even more intelligent within further steps such as the intersecting of different data sets or using indirect information from the source data.

 

Conception

 

We specify the mapping rules – together, we define the optimal workflow.

 

Which information from the source system is transferred into the target system? This has to be done in both directions in a bidirectional interface. In doing so, it is essential to consider the properties of the different formats. A relational link from a data set, for example, cannot be plotted in a CAD format identically. This means that we have to find another way to plot this information according to the requirements of the task.

Such a specification has to be made in close accordance with our customer, since the semantics of the contents have to be taken into account.

At the same time, we define if and to what extent the data has to be prepared for the adoption into the target system as well as which follow-up steps will be necessary.

We provide advice on selecting suitable software components.

We define test scenarios in order to ensure that no data will be lost.

 

Implementation

a) Daten Integration

We particularly focus on only presenting the information relevant to the specific task. The data is not only derived from GIS, but from various systems. In our daily business we are often asked: “Should we create interfaces or manage copies?”

In practice, multilayered problems can result from copying GIS data into the different systems, in which they are needed: information has to be transformed into other data models and the amount of data processed requires a robust mechanism for a difference update. If data is to be modified in the target systems and restored in the original system, another complex step is added to the procedure, which should ideally require only little control by editors in order to work as sufficiently as possible.

 

b) Data Migration

In the case of migration, the data is transferred from one system into another one. Usually, a legacy system is replaced by a new system. Data migration relates data sets that have been isolated, links geometries and looks for “hidden” properties and connections between sets of data, in order to generate even more information which can be used directly. For instance, in the course of this data enhancement, spatial references and topological relationships are derived from the existing attributive data or topologies are established. Therefore, the value of the data increases. Spatial and attributive data exists in different data formats in many companies. This data has a high informative value, which has to be preserved by a loss-free transformation into different target systems.

GRINTEC has transferred spatial data for different IT-systems in several costumer projects, ensuring maximum quality and data security. Data conversion was, among others, conducted for Smallworld Systems, AutoCAD, ESRI (Geodatabase, Network Engineer), ORACLE, PostGIS, Bentley MircoStation, MapInfo or Tomtom. It is always ensured that the data can be used fully within the respective systems.

 

c) Interfaces for Data Actualization

Utility companies often assign the surveying of construction sites to external service providers. In order to allow easy processing of the data, the data of the network information system has to be provided for them in an appropriate form.

Then the updated data has to be implemented into the central database as efficiently as possible.

GRINTEC allows for optimal future data processing by realizing suitable interfaces. Planning areas in network information systems can be defined and relevant data such as line information and topographies can be exported from the database in the required data format. The external service provider can use this initial data for measurements and the incorporation of changes.

The result is then imported into the network information system again in a so-called differential update. In this update modifications of existing geometry data and factual data is adopted, new objects are inserted and data that is to be deleted is erased. This reduces the possible follow-up workload for the customer to a minimum.

The all-rounder FME

We primarily use FME (Feature Manipulation Engine of Safe Software) for the implementation of interfaces. FME covers all important data formats: FME combines all interfaces centrally – scenarios, in which applicants want to synchronize data with ORACLE or MS SQL Server or PostGIS as well as the adoption of data from a digital basic city map or GIS data from other sources are included. FME also supports common XML formats, which enables the user to provide the GIS data to other analysis programs (e.g. network calculation).

Comprehensive possibilities for translation rules: It can for example be ensured that no wrong, inconsistent data gets into the GIS and that an automated, bidirectional data exchange is realized with external sites. The interfaces are not affected by changes in or upgrades of GIS: Due to technological decoupling of the interfaces of Smallworld GIS and a clear separation of data exchange, interface development is affected by future upgrades in a smaller degree. From a holistic point of view this presents a simplification of the IT environment.

The core of FME is handling the geodata and formats. Besides the classical vector and grid formats, which comprise all GIS/CAD systems, FME supports various 3D, XML and point cloud formats. Of course, the integration of web services is possible as well. Additionally, several non-spatial formats are supported, e.g. Microsoft Office products, text-based formats, databases, cloud systems and similar formats. At the moment 400 different formats are supported.

There is a new version of FME each year, which expands existing formats (e.g. new DWG versions) and adds new ones. FME can be upgraded easily, as the new version simply has to be downloaded and installed.

 

The advantages of FME can be summarized as follows:

 

• Product independent framework

• Enormous amount of features

• Diverse range of applications, as a mere data converter, to provide data in different formats and to synchronize data of different database systems

• Applicable for special analysis demands

• Easily maintainable

In sum it can be said that using FME covers various task areas successfully and provides solutions within these – without needing any additional software.

 

References

GRINTEC clients use FME to exchange data with data providers and thereby display differential data actualization. Only the real changes made by data providers are transported back into Smallworld GIS. Additionally, our customers use FME to provide GIS data to network calculation programmes.

 

The FME Smallworld Edition is used successfully by the following GRINTEC customers:

 

• Energie AG Oberösterreich: to provide data to Upper Austrian provincial government

• Energie AG Oberösterreich, grid gas division: to exchange GIS data with the surveyor´s offices responsible for data collection and actualization. Additionally, FME is used to provide network data to the network calculation programme PSS*SINCAL.

• Holding Graz and Energie Graz GmbH: uses FME to exchange data with the data providers and to provide Smallworld GIS data in an ORACLE data warehouse.

• Stadtwerke Bruneck: to exchange Smallworld GIS data with the internal surveying department (Leica MobileMatriX) to update data on-site with a digital field book solution.

• Deutsche Bahn Energie, S-BEV Berlin: to migrate network data from Bentley MicroStation to Smallworld. Pevious comprehensive analysis, evaluation of the situation and consolidation of legacy data. Interface to transfer infrastructural data from MS to SW.

• Smallworld customers in Austria: for the regular transfer of DKM to Smallworld

• Stadtwerke Bruneck: working on an interface to export network data for the regulator periodically (INSPIRE)

• Energie Ried: to migrate network data from DWG/PostgreSQL to Smallworld

• iNIS: to visualize performance data and feed-in power of photovoltaic systems according to various aspects such as spatial structure, temporal sequence etc.

• Energie AG Oberösterreich: to process (generation of zones of point clouds with long-term average wind values) and import data for a windstorm risk map to analyse zones at risk of windstorms with regard to overhead lines

• All Smallworld customers: for diverse exports, to easily pass on data in other popular geo formats such as DWG, Shape, KML, etc.

• Linz AG: to actualize topographical data in Smallworld with measured data from DWG

• Stadtwerke Leipzig: to process and transfer the digital basic city map to Smallworld