Home

Table of Contents

I. CloudConnect Overview
1. CloudConnect Products
CloudConnect Designer
CloudConnect Platform
II. Installation Instructions
2. System Requirements for CloudConnect Designer
III. Getting Started
3. Initial Setup
4. Starting CloudConnect Designer
5. Creating CloudConnect Projects
CloudConnect Project
Creating GoodData Project from CloudConnect
6. Structure of CloudConnect Projects
Standard Structure of All CloudConnect Projects
Workspace.prm File
Opening the CloudConnect Perspective
7. Appearance of CloudConnect Perspective
CloudConnect Designer Panes
Graph Editor with Palette of Components
Navigator Pane
Server Explorer Tab
Outline Pane
Tabs Pane
8. Creating CloudConnect Graphs
Creating Empty Graphs
Creating a Simple Graph in a Few Simple Steps
9. Running CloudConnect Graphs
Successful Graph Execution
Using the Run Configurations Dialog
10. Deploying the CloudConnect project
IV. CloudConnect Project Examples
11. Examples Setup
12. HR Example: Connecting multiple datasets together
13. Forex Example: Using the Time Dimension
14. Salesforce: Loading Data from Salesforce
15. GA: Loading Data from Google Analytics
16. REST: Invoking Complex REST APIs
V. Advanced CloudConnect Project Examples
17. Advanced Examples Setup
VI. CloudConnect Project Management
18. CloudConnect Project Deployment and Execution Mechanics
19. List All Deployed CloudConnect Projects
20. CloudConnect Project Scheduling
21. CloudConnect Project Notification
CloudConnect transformation has been scheduled.
CloudConnect transformation has been started.
CloudConnect transformation finished successfully.
CloudConnect transformation error.
VII. Working with CloudConnect Designer
22. Common Dialogs
URL File Dialog
23. Import
Import CloudConnect Projects
Import Graphs
Import Metadata
Metadata from XSD
Metadata from DDL
24. Export
Export Graphs
Export Metadata to XSD
25. Advanced Topics
Program and VM Arguments
Example of Setting Up Memory Size
Changing Default CloudConnect Settings
VIII. Graph Elements, Structures and Tools
26. Components
27. Edges
What Are the Edges?
Connecting Components by the Edges
Types of Edges
Assigning Metadata to the Edges
Propagating Metadata through the Edges
Colors of the Edges
Debugging the Edges
Enabling Debug
Selecting Debug Data
Viewing Debug Data
Turning Off Debug
Edge Memory Allocation
28. Metadata
Data Types and Record Types
Data Types in Metadata
Record Types
Data Formats
Data and Time Format
Numeric Format
Boolean Format
String Format
Locale and Locale Sensitivity
Locale
Locale Sensitivity
Autofilling Functions
Internal Metadata
Creating Internal Metadata
Externalizing Internal Metadata
Exporting Internal Metadata
External (Shared) Metadata
Creating External (Shared) Metadata
Linking External (Shared) Metadata
Internalizing External (Shared) Metadata
Creating Metadata
Extracting Metadata from a Flat File
Extracting Metadata from a GoodData Dataset
Extracting Metadata from Salesforce
Extracting Metadata from Google Analytics
Extracting Metadata from an XLS(X) File
Extracting Metadata from a Database
Extracting Metadata from a DBase File
Creating Metadata by User
Dynamic Metadata
Reading Metadata from Special Sources
Creating Database Table from Metadata and Database Connection
Metadata Editor
Basics of Metadata Editor
Record Pane
Field Name vs. Label vs. Description
Details Pane
Changing and Defining Delimiters
Changing Record Delimiter
Changing Default Delimiter
Defining Non-Default Delimiter for a Field
Editing Metadata in the Source Code
29. Salesforce Connections
Creating Salesforce Connection
30. Facebook Connections
Creating Facebook Connection
31. ExactTarget Connections
Creating ExactTarget Connection
32. Google Analytics Connections
Creating Google Analytics Connection
33. Database Connections
Internal Database Connections
Creating Internal Database Connections
Externalizing Internal Database Connections
Exporting Internal Database Connections
External (Shared) Database Connections
Creating External (Shared) Database Connections
Linking External (Shared) Database Connections
Internalizing External (Shared) Database Connections
Database Connection Wizard
Encrypting the Access Password
Browsing Database and Extracting Metadata from Database Tables
34. JMS Connections
Internal JMS Connections
Creating Internal JMS Connections
Externalizing Internal JMS Connections
Exporting Internal JMS Connections
External (Shared) JMS Connections
Creating External (Shared) JMS Connections
Linking External (Shared) JMS Connection
Internalizing External (Shared) JMS Connections
Edit JMS Connection Wizard
Encrypting the Authentication Password
35. Lookup Tables
Internal Lookup Tables
Creating Internal Lookup Tables
Externalizing Internal Lookup Tables
Exporting Internal Lookup Tables
External (Shared) Lookup Tables
Creating External (Shared) Lookup Tables
Linking External (Shared) Lookup Tables
Internalizing External (Shared) Lookup Tables
Types of Lookup Tables
Simple Lookup Table
Database Lookup Table
Range Lookup Table
Persistent Lookup Table
Aspell Lookup Table
36. Sequences
Internal Sequences
Creating Internal Sequences
Externalizing Internal Sequences
Exporting Internal Sequences
External (Shared) Sequences
Creating External (Shared) Sequences
Linking External (Shared) Sequences
Internalizing External (Shared) Sequences
Editing a Sequence
37. Parameters
Internal Parameters
Creating Internal Parameters
Externalizing Internal Parameters
Exporting Internal Parameters
External (Shared) Parameters
Creating External (Shared) Parameters
Linking External (Shared) Parameters
Internalizing External (Shared) Parameters
Parameters Wizard
Parameters with CTL Expressions
Environment Variables
Canonizing File Paths
Using Parameters
38. Internal/External Graph Elements
Internal Graph Elements
External (Shared) Graph Elements
Working with Graph Elements
Advantages of External (Shared) Graph Elements
Advantages of Internal Graph Elements
Changes of the Form of Graph Elements
39. Dictionary
Creating a Dictionary
Using the Dictionary in a Graph
40. Notes in the Graphs
41. Search Functionality
42. Transformations
IX. Components Overview
43. Introduction to Components
44. Palette of Components
45. Common Properties of All Components
Edit Component Dialog
Component Name
Phases
Enable/Disable Component
PassThrough Mode
46. Common Properties of Most Components
Group Key
Sort Key
Defining Transformations
Return Values of Transformations
Transform Editor
Regex Tester
Common Java Interfaces
47. Common Properties of Readers
Supported File URL Formats for Readers
Viewing Data on Readers
Input Port Reading
Incremental Reading
Selecting Input Records
Data Policy
XML Features
CTL Templates for Readers
Java Interfaces for Readers
48. Common Properties of Writers
Supported File URL Formats for Writers
Viewing Data on Writers
Output Port Writing
How and Where Data Should Be Written
Selecting Output Records
Partitioning Output into Different Output Files
49. Common Properties of Transformers
CTL Templates for Transformers
Java Interfaces for Transformers
50. Common Properties of Joiners
Join Types
Slave Duplicates
CTL Templates for Joiners
Java Interfaces for Joiners
51. Common Properties of Others
52. Custom Components
X. Component Reference
53. Readers
CloudConnectDataReader
ComplexDataReader
SF Reader
Facebook Reader
Zendesk Reader
ExactTarget Reader
Google Analytics Reader
HTTPConnector
EventStore Reader
WebServiceClient
DataGenerator
DBFDataReader
DBInputTable
EmailReader
JMSReader
LDAPReader
MultiLevelReader
ParallelReader
CSVReader
XLSDataReader
XMLExtract
XMLXPathReader
54. Writers
GD Dataset Writer
CloudConnectDataWriter
EventStore Writer
EmailSender
StructuredDataWriter
Trash
CSVWriter
XMLWriter
55. Transformers
Aggregate
Concatenate
DataIntersection
DataSampler
Dedup
Denormalizer
EmailFilter
ExtFilter
ExtSort
FastSort
Merge
MetaPivot
Normalizer
Partition
Pivot
Reformat
Rollup
SimpleCopy
SimpleGather
SortWithinGroups
XSLTransformer
56. Joiners
ApproximativeJoin
DBJoin
ExtHashJoin
ExtMergeJoin
LookupJoin
RelationalJoin
57. Others
CheckForeignKey
DBExecute
LookupTableReaderWriter
RunGraph
SequenceChecker
SpeedLimiter
XI. CTL - CloudConnect Transformation Language
58. Overview
59. CTL1 vs. CTL2 Comparison
Typed Language
Arbitrary Order of Code Parts
Compiled Mode
Access to Graph Elements (Lookups, Sequences, ...)
Metadata
60. Migrating CTL1 to CTL2
61. CTL1
Language Reference
Program Structure
Comments
Import
Data Types in CTL
Literals
Variables
Operators
Simple Statement and Block of Statements
Control Statements
Error Handling
Functions
Eval
Conditional Fail Expression
Accessing Data Records and Fields
Mapping
Parameters
Functions Reference
Conversion Functions
Date Functions
Mathematical Functions
String Functions
Container Functions
Miscellaneous Functions
Dictionary Functions
Lookup Table Functions
Sequence Functions
Custom CTL Functions
62. CTL2
Language Reference
Program Structure
Comments
Import
Data Types in CTL2
Literals
Variables
Dictionary in CTL2
Operators
Simple Statement and Block of Statements
Control Statements
Error Handling
Functions
Conditional Fail Expression
Accessing Data Records and Fields
Mapping
Parameters
Functions Reference
Conversion Functions
Date Functions
Mathematical Functions
String Functions
Container Functions
Miscellaneous Functions
Lookup Table Functions
Sequence Functions
Custom CTL Functions
Functions for Dynamic Field Access
CTL2 Appendix - List of National-specific Characters
List of Figures
List of Tables
List of Examples
 Home