Creating New Confluent KSQL Connections

Arcadia Enterprise supports Confluent KSQL data connections.

Confluent KSQL data connections enable you to build datasets and dashboards that display real-time streaming data.

These visual types support smooth rendering of streaming data when running on this connection: Lines, Bar, Areas, Stacked Bars, Combo, Calendar Heatmap, Correlation Heatmap, Packed Bubbles, Pie, and Scatter.

Developer Note.
  • Note the following known issue that affects Confluent KSQL connections:

CONNECTION: User-Defined Aggregate Expressions Do Not Validate

For more information about Confluent KSQL connections, capabilities, advantages, and limitations, see Support for Confluent KSQL Connections.

The following steps demonstrate how to create new Confluent KSQL data connections.

Create New Data Connection Modal Window: Confluent KSQL
Create a New Confluent KSQL Data Connection
  1. On the main navigation bar, click Data.

    Click DATA on main navigation bar

    The Data view appears, open on the Datasets tab.

    Main landing page of DATA
  2. In the side bar, click New Connection.

    Create New Connection

    The Create New Data Connection modal window appears.

  3. In the Create New Data Connection modal window, under Connection type, select Confluent KSQL.
  4. Under Connection name, specify the name of the new connection. Here, we use ConfluentKSQLConnection.
  5. Under Hostname or IP address, specify the name of the KSQL REST server, or its IP address.

    You can use both http:// and https:// IP addresses. Use localhost when the data source is local.

  6. Under Port #, enter the port number. The default port # for Confluent KSQL connections is 9098.
  7. Under Credentials, complete the following entries.

    • Under Username, enter the username for establishing the connection.

    • Under Password, enter the password for establishing the connection.

  8. At the bottom of the modal, click Test.

    testing connection
    Testing the New Connection

    If the connection is valid, the system returns a 'Connection Verified' message.

  9. Click Save.

    connection verified, connecting
    Connecting a Verified Connection

After this operation succeeds, the new connection name appears on the side navigation bar. To customize the connection, see the options available under the Cache tab.

Result Cache Options

  • Click the Cache tab.

    Cache tab, specifying Retention Time option
    Specifying Cache
  • In the Retention Time field, specify the frequency of cache updates, in seconds.

    For example, the default value of 86400 indicates an update every 24 hours, and a value of 300 initiates a refresh every 5 minutes.