Powerful Data Processing and Automation
For Every Data Professional
Organizations and technology providers are struggling with an increasing number of flat files and the limitations of Excel for large and computationally-demanding data models, migrations and unlocking data silos. General integration tools and APIs alone are not built for the everyday needs of data workers with SQL experience who want to automate data processes, offload desktop CPU processing to the cloud and transform business processes.
Organizations want to accelerate automation and data-driven decision making, however existing tools are not designed to easily transform, aggregate and process large amounts of distributed data.
The Lingk Experience
Powerful data transformation and integration solutions with the Recipe Editor.
Simplify building recipe solutions with the Visual SQL Wizard.
Collaborative and dynamic data workspaces for project management.
LingkQL combines the data analysis capabilities of Apache Spark in-memory processing with integration-focused SQL statements.
Connect events using custom webhooks to listeners from workflow tools (like Zapier) or iPaaS platforms (like Mulesoft).
Simplify Data Processing and Automation
Visual SQL Wizard
Recipes enable many different solutions - batch, streaming, and big data analytics scenarios - to be processed in parallel and in record time. Recipes are human-readable, reusable YAML configurations that combine connector information, data orchestration, and powerful SQL commands to enable almost any type of transformation and aggregation on large sets of data.
The Visual SQL Wizard enables fast and smart data processing, integration and automation solutions by generating recipes for on-premise or cloud-based systems. The wizard is much easier to use than typical drag-and-drop tools, providing specific guidance for building quality data transformations and automations.
Connect Enterprise and Industry
Connectors remove the complexity of connecting to files, cloud and on-premise systems. Lingk connectors automatically read data into an in-memory staging table, so you can transform and cleanse data. Lingk for Good connectors include common SIS and LMS platforms.
Anatomy of a SQL Recipe
A Lingk SQL Recipe is simply a YAML file configured with SQL statements about "where" data resides and "what" should process and output the data.
The Local File connects stored flat files (including Excel, JSON, and CSV). Configuring other connectors will enable you to join, aggregate or transform additional datasets in a recipe. Many connectors can read and write data.
After data is read by a connector, a post-processor can add immediate value to your dataset. A commonly used post-processor is "data diff" - which compares new data with old data - and helps you process change sets based on new, updated, or deleted records.
Files can be stored in different file formats and APIs can return different content types. Using formats, you can instruct a recipe on the format to read data in or write data out.
LingkQL (Lingk SQL) statements represent an opportunity to select data using Apache Spark SQL into new tables or write existing tables out to connectors. Each statement in a recipe represents another step in the recipe solution. Statements can call out to Lingk APIs to trigger other recipes or external workflows via webhooks.
Lingk Platform Components
The Lingk Transformer Engine (LTE) is the Lingk in-memory SQL Recipe Engine that processes the data for the Lingk Platform. Built on top of Apache Spark, the LTE has the ability to power all your ETL, event streaming and big data analytics needs. A Lingk recipe is the way to harness all the power of the LTE and to orchestrate data flows.
In a SaaS deployment, all data flowing through the LTE is “stateless” and in-memory. This means that you never have to worry about Lingk data on our servers.
A hybrid deployment of LTE is typically used if your organization’s compliance or policy requirements prevent you from using a multi-tenant cloud service. LTE can be deployed in hybrid implementations on Amazon AWS, Google Cloud, Microsoft Azure and Oracle Cloud.
Security by Design
Your data is owned by you and we take careful measures to make your data as safe as possible. We use Amazon Web Services (AWS) for our infrastructure which has achieved both ISO 27001 certification and successfully completed multiple SSAE 16 audits.
Have questions? Our team is here to help.
From general inquiries about the Lingk Platform to more technical questions about specific recipe solutions—we’ve got you covered. We offer standard and premium support level options and include in-app customer communication with our platform.