StreamSets Data Collector

A couple of weeks ago, as May the 4th approached, a lively Star Wars debate brewed at StreamSets: “Do new school characters get as much play as old favorites like Darth Vader, Yoda and Han Solo?” “Does the Dark Side of the Force dominate the Light?” ... [More] “Does Yoda prevail over Darth Vader?” It occurred to us The post May the 4th Be With You – Analyzing Star Wars Twitter Mentions in Minecraft appeared first on StreamSets. [Less]

As I’ve mentioned a couple of times, my previous gig was as a developer evangelist at Salesforce, with particular focus on integration. A few weeks ago, I wrote a custom destination allowing StreamSets Data Collector (SDC) to write data to Salesforce ... [More] Wave Analytics; today, I’ll show you how to ingest data from Salesforce and write it to any destination supported The post Using StreamSets to Ingest Salesforce Data for Analysis appeared first on StreamSets. [Less]

At the Hadoop Summit in Dublin this week, Ted Malaska, Principal Solutions Architect at Cloudera, and I presented Ingest and Stream Processing – What Will You Choose?, looking at the big data streaming landscape with a focus on ingest. The session ... [More] closed with a demo of StreamSets Data Collector, the open source graphical IDE for The post Ingesting JSON Data Into Apache Kudu with StreamSets Data Collector appeared first on StreamSets. [Less]

With this release we have a number of exciting new features and integrations. And as usual, we’ve addressed a number of bug fixes. Integrations: Want to send data to Amazon Redshift? Use the new Kinesis Firehose destination to do it. If you deal with ... [More] a lot of unstructured data, here’s a MongoDB destination you can use. Testing The post Announcing Data Collector ver 1.3.0.0 appeared first on StreamSets. [Less]

At the Strata+Hadoop World conference last week, I met with Pratik Verma, Chief Product Officer at BlueTalon, a Bay Area startup focused on big data security. As Pratik and I were talking, he explained some of the problems that arise when ... [More] organizations collect more and more data, and they need to start thinking about exactly who should have access The post Data in Motion: Simplifying Security & Building Custom Integrations appeared first on StreamSets. [Less]

At the Strata+Hadoop World conference last week, I met with Pratik Verma, Chief Product Officer at BlueTalon, a Bay Area startup focused on big data security. As Pratik and I were talking, he explained some of the problems that arise when ... [More] organizations collect more and more data, and they need to start thinking about exactly who should have access The post Data in Motion: Simplifying Security & Building Custom Integrations appeared first on StreamSets. [Less]

In my last blog entry I explained how you can write custom destinations to send data to systems not currently supported by StreamSets Data Collector. As you might know, my last gig was as a developer evangelist at Salesforce, so I put my experience ... [More] to work writing a destination for Salesforce Wave Analytics. Now you can ingest data The post Integrating StreamSets with Salesforce Wave Analytics appeared first on StreamSets. [Less]

In my last blog entry I explained how you can write custom destinations to send data to systems not currently supported by StreamSets Data Collector. As you might know, my last gig was as a developer evangelist at Salesforce, so I put my experience ... [More] to work writing a destination for Salesforce Wave Analytics. Now you can ingest data The post Integrating StreamSets with Salesforce Wave Analytics appeared first on StreamSets. [Less]

One of the first things I hear after I explain the basics of StreamSets Data Collector is, “Cool, so can I ingest data from/send data to X?”, for varying values of X. The short answer is, “Yes, you can!”, while the longer answer involves checking the ... [More] lists of origins (for ingesting data from X) and destinations (for writing The post New Tutorial: Creating a Custom StreamSets Destination appeared first on StreamSets. [Less]

One of the first things I hear after I explain the basics of StreamSets Data Collector is, “Cool, so can I ingest data from/send data to X?”, for varying values of X. The short answer is, “Yes, you can!”, while the longer answer involves checking the ... [More] lists of origins (for ingesting data from X) and destinations (for writing The post New Tutorial: Creating a Custom StreamSets Destination appeared first on StreamSets. [Less]