StreamSets Data Collector

It’s simple to connect StreamSets Data Collector (SDC) to Apache Kafka through the Kafka Consumer Origin and Kafka Producer Destination connectors. And because those connectors support all Kafka Client options, including the secure Kafka (SSL and ... [More] SASL) options, connecting to an SSL-enabled secure Kafka cluster is just as easy. In this blog post I'll walk through the The post Fast, Easy Access to Secure Kafka Clusters appeared first on StreamSets. [Less]

This release has been superseded by version 2.7.1.0. Please upgrade to v2.7.1.0 at the earliest. We are happy to release version 2.7.0.0 of StreamSets Data Collector. You can download the latest open source release here. This release has 134 new ... [More] features and improvements and over160 bug fixes. For a full list, see What's New. For The post Announcing Data Collector v2.7.0.0 appeared first on StreamSets. [Less]

In today’s microservice revolution, where software applications are designed as independent services that work together, two technologies stand out. Docker, the defacto standard for containerization, and Kubernetes, a container orchestration and ... [More] management tool. In this blog I will explain how to run StreamSets Data Collector (SDC) Docker containers on Kubernetes. There are two ways in The post Scaling out StreamSets with Kubernetes appeared first on StreamSets. [Less]

Redis is an open-source, in-memory, NoSQL database implementing a networked key-value store with optional persistence to disk. Perhaps the most popular key-value database, Redis is widely used for caching web pages, sessions and other objects that ... [More] require blazingly fast access – lookups are typically in the millisecond range. At RedisConf 2017 I presented a session, Cache All The Things! The post Cache Salesforce Data in Redis with StreamSets Data Collector appeared first on StreamSets. [Less]

Last December, I covered Continuous Data Integration with StreamSets Data Collector and Spark Streaming on Databricks. In StreamSets Data Collector (SDC) version 2.5.0.0 we added the Spark Executor, allowing your pipelines to trigger a Spark ... [More] application, running on Apache YARN or Databricks. I'm going to cover the latter in this blog post, showing you how The post Triggering Databricks Notebook Jobs from StreamSets Data Collector appeared first on StreamSets. [Less]

September 25, 2017 - September 27, 2017 - All Day Javits Center 655 W 34th Street New York

June 27, 2017 - All Day New World Stages 340 W 50th St New York

June 20, 2017 - June 21, 2017 - All Day Metro Toronto Convention Centre 222 Bremner Blvd Toronto

Hi, my name is Wagner Camarao and I'm a Software Engineer at StreamSets focusing on the user-facing aspects of our products. Today I'm going to talk about a new feature in the StreamSets Data Collector to optimize the interactions with our support ... [More] team. In version 2.6.0.0 of Data Collector, we’ve added a feature called Support The post Introducing the Data Collector Support Bundle appeared first on StreamSets. [Less]

We are excited to announce version 2.6 of StreamSets Data Collector. This release has important functionality focused on helping customers to modernize their enterprise data warehouses on Hadoop, CyberSecurity, IoT and Spark. You can download the ... [More] latest open source release here. This release has 6 new features, 20 improvements and 72 bug fixes. For a full list, see What's New. For The post Announcing Data Collector ver 2.6.0.0 appeared first on StreamSets. [Less]