A Market in Motion
The integration platform market emerged to simplify connectivity of disparate systems to handle general integration needs. Historically, vendors surfaced to support connecting on-premise systems to each other through enterprise service buses (ESB). Some ESB vendors transformed into Integration Platform as a Service (iPaaS) offerings as cloud SaaS and IaaS systems proliferated the enterprise markets. But moving big data is different.
Big data pipelines are less about general integration needs and more about powering AI and data-driven decisions. Traditional iPaaS tools are not built for the needs of AI and data-driven decision making, as they are not designed to process large amounts of distributed data. Additionally, in the education and learning domains, data-driven decisions require connecting deeper with domain specific sources (like SIS, LMS, and learning standards) that aren't available in a traditional iPaaS.
Lingk DX Platform Components
Lingk HQ organizes all integration activities for a collaborative and dynamic integration experience. Users of Lingk HQ see the workspaces they create and are invited to. Users can then quickly build data pipelines through wizards and recipes.
Workspaces enable stronger collaboration and organization for 10s, 100s or even 1,000s of integration projects. Workspaces are designed to increase transparency across teams, departments and with approved vendors. Each workspace includes only invited users and are ideal for project teams of all sizes.
Inside workspaces, users can build integrations by simply using a LingkSync Speed Wizard or the web-based Recipe Builder. Integration configurations can be versioned and deployed across customizable environments in the workspace supporting your entire integration development life-cycle.
LingkSync Speed Wizards
LingkSync Speed Wizards enable fast and smart Integration for on-premise or cloud-based systems. Using the Lingk Adapter, cloud connectors, and step-by-step wizards including intelligent auto-mapping, you'll be able to build high quality data pipelines easier than ever before. Wizards are much easier to use than those typical drag-and-drop tools that only provide limited guidance for building quality pipelines and integrations.
Recipes enable many different data scenarios (batch, streaming, and big data analytics) to be accomplished in record time. Recipes are human-readable, reusable YAML configurations that combine connector information, data orchestration, and powerful SQL commands that enable almost any type of transformation and aggregation on large sets of data.
Managing recipes in the web-based Recipe Builder is easy. Inside the Recipe Builder you can build, save, test, version, deploy and schedule recipes. The Recipe Builder becomes a one-stop shop for managing all types of integrations that align to your integration development processes.
Lingk DX connects your CRM, LMS, SIS, ERP and other systems with commercially supported Apache Spark connectors. Data pipelines and integrations can be orchestrated using powerful in-memory data processing.
Categories of connectors:
- Customer/Constituent Relationship Management (CRM)
- Student Information Systems (SIS, ERP)
- Learning Management Systems (LMS)
- Cloud and On-Premise Databases
- Data Warehouses / Data Lakes
- Learning Events
- Cloud File Stores
- Student Success
- and more...
The Lingk Adapter is simple-to-use, install and a powerful way to provide RESTful access to on-premise databases and files needed for data pipelines and integration. The Lingk Adapter is a distribution of Apache Nifi that utilizes Docker for easy installation. After running the Lingk Adapter and connecting databases or adding files, you can create unlimited API endpoints that you can easily use with recipes.
Identifying and resolving issues with data pipelines and integrations quickly reduces the management burden when you have many pipelines feeding 360 degree views, analytics and deep learning. Lingk DX provides high level monitoring at the workspace level and detailed execution plans at the recipe level.
Lingk Transformer Engine
The Lingk Transformer Engine (LTE) processes the data for the Lingk DX Platform. Built on top of Apache Spark, the LTE has the ability to power all your ETL, event streaming and big data analytics needs. A Lingk recipe is the way to harness all the power of the LTE and to orchestrate data flows.
In a SaaS deployment, all data flowing through the LTE is “stateless” and in-memory. This means that you never have to worry about Lingk data on our servers.
A hybrid deployment of LTE is typically used if your organization’s compliance or policy requirements prevent you from using a multi-tenant cloud service.
Lingk DX In Action
Lingk provides solutions that make it easy for teams of any size to drive new revenue streams and retain students and employees using data pipelines and transformation processing. Lingk DX connects core enterprise sources like ERP, SIS, CRM, LMS and SaaS Apps emitting event streams to data warehouses, lakes and engagement system targets for 360 degree views, big data analytics, distributed ledger and deep learning applications.
Security by Design
Your data is owned by you and we take careful measures to make your data as safe as possible. We use Amazon Web Services (AWS) for our infrastructure which has achieved both ISO 27001 certification and successfully completed multiple SSAE 16 audits.
Have questions? Our team is here to help.
From general inquiries about the Lingk DX Platform to more technical questions about specific data syncs—we’ve got you covered. We offer standard and premium support level options and include in-app customer communication with our platform.