At this point you should have completed all of the tasks described in this Get Started guide. To confirm that you are fully set up to use the HERE Workspace, the last step is to run a sample application. While not an absolute requirement, running the sample application is a good practical exercise in the basic skills required to process data in the Workspace.
You must have a fully credentialed HERE Workspace account to run this demo. If not, return to the topic Set Up Your Team and complete that process.
This demo uses a stream pipeline to process some mock data stored in an input catalog and output the processed data to an output catalog. This demo will guide you through the following tasks:
- Set up input and output catalogs using the portal
- Build a pipeline JAR file from supplied source code
- Deploy the pipeline jar file using the OLP CLI (Command Line Interface)
- Create access tokens for your pipeline
- Send data to your pipeline via ingestion
- Verify that your pipeline application is running
- View the data processed in your pipeline and saved in the output catalog
- View log messages that record pipeline activities
You will need to download the demo and follow the instruction for setting up and running the catalogs and pipeline. The demo is called the Flink SDII Read/Write Example and you can get it from the artifactory here: Download Demo
- Save the zip file in a new directory on your computer. Then, extract the contents.
Open the README.html or the README.md file (they are the same document) in the root directory of the demo project.
All of the code examples are structured the same way as this demo. The README files have all of the instructions on how to use the code examples.
Follow the instructions under the Build Instructions heading. Note the prerequisites for running the demo. You should also have a basic programming editor.
Go to the examples > flink-sdii-read-write-java folder and open the README.html or the README.md file. Then, follow the instructions for building and running the demo application.
Credentials, tokens, ID's, and other information that you create along the way may be needed later in the process of running your pipeline or accessing data. Save this information so that it is readily available when you need it.
When you have completed the demo project, do not leave it on the pipeline service because it uses resources. Delete the pipeline from the pipeline service (identified by the
pipelineID) and the catalogs. You can do this from the Portal or using the CLI.
At this point, you can explore and use the HERE Workspace tools, features and resources according to the plan you have purchased. The documentation is your guide on what everything is and how to use it. There are two key things to remember.
Thanks and welcome to the HERE Workspace community of users!