StreamSets Data Collector

Financial services (FS) is one of the world’s most highly regulated sectors. That’s understandable given its role as critical national infrastructure and the enormous volumes of sensitive customer and corporate data that institutions hold. But with ... [More] regulations come challenges. Authorized… The post How Banks Can Corral Their LoB Users To Tame a Data Wild West appeared first on StreamSets. [Less]

Financial services (FS) is one of the world’s most highly regulated sectors. That’s understandable given its role as critical national infrastructure and the enormous volumes of sensitive customer and corporate data that institutions hold. But with ... [More] regulations come challenges. Authorized users looking to make better decisions need access to data, but controls to ensure data… The post How Banks Can Corral Their LoB Users To Tame a Data Wild West appeared first on StreamSets. [Less]

Salesforce Data Pipelines is a Salesforce add-on that allows users to enrich and transform Salesforce data without taking it outside of Salesforce. It requires a separate fee and has limitations around scale, concurrency, and the maximum amount of ... [More] recipes or… The post 5 Design Patterns to Bypass Salesforce Data Pipeline Limits appeared first on StreamSets. [Less]

Salesforce Data Pipelines is a Salesforce add-on that allows users to enrich and transform Salesforce data without taking it outside of Salesforce. It requires a separate fee and has limitations around scale, concurrency, and the maximum amount of ... [More] recipes or pipelines. The only endpoint available is back into Salesforce, so the enriched data cannot be… The post 5 Design Patterns to Bypass Salesforce Data Pipeline Limits appeared first on StreamSets. [Less]

When you focus on the theory of democratized data, it’s easy to get idealistic.  In this world of theory, practical realities fall by the wayside. The backend, where data pipeline tools and solutions live, quickly becomes an afterthought.  But ... [More] , forced to live in the world of practical application — where scalability, compliance, and quality rule‌… The post How Data Pipeline Solutions Can Push the State of Data Engineering Forward appeared first on StreamSets. [Less]

When you focus on the theory of democratized data, it’s easy to get idealistic.  In this world of theory, practical realities fall by the wayside. The backend, where data pipeline tools and solutions live, quickly becomes an afterthought.  But ... [More] , forced… The post How Data Pipeline Solutions Can Push the State of Data Engineering Forward appeared first on StreamSets. [Less]

A recent StreamSets research report examined data governance challenges in the modern enterprise. Based on survey data from over 650 data decision-makers and practitioners, we found that complex data architectures combined with line of business teams ... [More] building their own data pipeline integrations (outside ITs purview) are leaving them struggling to understand, govern, and manage a… The post [Infographic] Governance Challenges in the Data Wild West appeared first on StreamSets. [Less]

A recent StreamSets research report examined data governance challenges in the modern enterprise. Based on survey data from over 650 data decision-makers and practitioners, we found that complex data architectures combined with line of business teams ... [More] building their own data… The post [Infographic] Governance Challenges in the Data Wild West appeared first on StreamSets. [Less]

StreamSets has added support to run Transformer for Spark on a new type of cluster: Amazon EMR (Elastic MapReduce) Serverless. Choose it or any of the other available supported cluster types.  What is Amazon EMR Serverless? Amazon EMR Serverless is a ... [More] feature of Amazon EMR that allows users to run big data processing workloads without… The post Support for Amazon EMR Serverless appeared first on StreamSets. [Less]

StreamSets has added support to run Transformer for Spark on a new type of cluster: Amazon EMR (Elastic MapReduce) Serverless. Choose it or any of the other available supported cluster types.  What is Amazon EMR Serverless? Amazon EMR Serverless is… The post Support for Amazon EMR Serverless appeared first on StreamSets.