HP Site Flow is a workflow and production automation system for HP digital press owners.
When HP Inc began developing HP Site Flow, an end-to-end workflow and production automation system for HP digital press owners, they encountered several challenges including: addressing the growing personalized market; the need to ‘normalize’ PDFs, given the wide variation in the quality of files entering the system; and the ability to quickly scale up or down to accommodate varying levels of demand.
Read the case study to see how Mako Core™ SDK proved its capability and adaptability by rising to HP Site Flow’s development challenges, resulting in increased productivity and profitability for its users.
In this second post about digital watermarking in the print workflow, author Martin Bailey explains the stages when it’s possible to add a digital watermark.
Digital watermarking is an emerging technology, part of the latest step on the evolution of product identification. Global Graphics Software has partnered with Digimarc, a leader in digital watermarking and a member of our Partner Network, to explore this topic and future developments.
Adding a digital watermark during the design stage
In some workflows the designer may apply digital watermarks to a design by, for instance, using a plugin to an application such as Adobe Illustrator. This is equally appropriate for both steganography and an artwork masking layer, and gives the maximum opportunity for approval of the design with the digital watermark in place, and for any rework to the design that might be requested to realize the greatest benefit from using that watermark. It will not normally be appropriate for the digital watermark to be added by the designer if each instance of the print requires unique data to be encoded in it; variable data composition is usually performed later in the workflow.
Application of digital
watermarking has different advantages and disadvantages at
various stages in the design and production workflow.
Adding a digital watermark in composition/prepress
In other workflows adding the digital watermark may be a function of a variable data composition or prepress department. Just as for application by the designer, this is applicable for both steganography and an artwork masking layer. There is a reasonable opportunity for approval of the design with the digital watermark in place. But it would be slower and more expensive to rework the design if that is required at this stage than if the watermark were added by the designer.
If the digital watermark is added in prepress then it can carry both static and variable data. As discussed above, however, variable data is best suited to use of an artwork masking layer rather than steganography, if only because of the amount of data that must be generated and then incorporated into a PDF file when steganography is used for a significant number of unique codes.
But applying even an artwork masking layer in prepress does bulk up the resulting print-ready PDF file with many copies of that layer, each one carrying different data. And it can also slow down processing in the Digital Front End (DFE) for a digital press. An overprinted graphic covering large areas of each piece of output in the PDF file can make it harder for the variable data optimization in a DFE to break the design apart so that it can minimize the total amount of processing required to read, color manage, render and halftone screen the job. (See Global Graphics Software’s guide: Full Speed Ahead: How to make variable data PDF files that won’t slow your digital press.)
Late-binding in the Digital Front End (DFE)
A new development in the application of digital watermarking is to add the marks right at the very last minute before the data is printed. In our SmartDFE™, for example, this can be done in parallel with or after the color management and rendering.
Applying the watermarks in parallel with color management and rendering (in the RIP) allows full access to all color channels for the output, while also removing the need to generate a fully resolved “optimized PDF” or PDF/VT file containing all of the variable data further upstream. In turn, this can reduce the overhead of optimizing variable data processing in the RIP. The final result is increased throughput, both in composition/prepress and in the DFE.
Applying marks after the RIP enables even higher performance through the DFE, with the added benefit of providing a more predictable processing speed because the amount of processing required is more deterministic than is rendering PDF. This might restrict the watermark to be painted in only one color channel, though.
Increasing speed and predictability in the DFE allows the use of lower cost hardware in those DFEs, or assists with printing at full engine speed for a larger proportion of jobs.
Late-binding application of digital watermarks will also always occur in an environment where the characteristics of the press that will be used to print the items are known, including resolution, bitdepth etc.
These benefits make this the optimum choice for highly efficient printing workflows for variable data digital watermarks, driving digital presses at full engine speed. The trade-offs are that it’s a little harder to review and approve proofs of the output, and that use for images with steganography is not usually appropriate.
White paper: Optimizing digital watermarking in print workflows
About the author
Martin Bailey, former distinguished technologist at Global Graphics Software, is currently the primary UK expert to the ISO committees maintaining and developing PDF and PDF/VT. He is the author of Full Speed Ahead: how to make variable data PDF files that won’t slow your digital press, a guide offering advice to anyone with a stake in variable data printing including graphic designers, print buyers, composition developers and users.
Digital watermarking is an emerging technology, part of the latest step on the evolution of product identification. Global Graphics Software has partnered with Digimarc, a leader in digital watermarking and a member of our Partner Network, to explore this topic and future developments.
In this first of two posts, Martin Bailey explains the ways you can add a digital watermark:
A digital watermark may be added in one of two ways:
1. Using steganography If a product design includes images, whether photographic or generated digitally, data can be hidden within that image data using steganography. Steganography is the practice of concealing a message within another message or a physical object (source: Wikipedia).
In order to hide the data, the color values of individual pixels in the image are altered in a way that is intended to not be obvious to the human eye. The alterations may need to be applied slightly differently depending on the image content and the print technology to be used. This means it’s often valuable to be able to proof a design with the images in place, and to do that either on the printing device that will be used for production, or on one that has been carefully tuned to reproduce color, tones and levels of detail to match that production device.
Alternatively both the printer/converter and their customer can inspect the artwork and verify the Digimarc code using PACKZ® or CLOUDFLOW® Proofscope, professional prepress tools from HYBRID Software. As well as checking for the correctness of the code, this also allows verification that the code placement conforms to the customer’s requirements, and supports a formal approval process.
Reviews of the proofed output may lead to a decision to re-embed the data into the image with slightly different parameters. Systems to automate that adjustment are improving, but the advisability of proofing means that steganography is best used at a point in the workflow where an appropriate review and reconfiguration may be made without disrupting throughput.
Steganography is a very effective technique if the same image will be used on every instance of an item because it can be difficult for a forger to reproduce. But if your goal is to encode unique data in each instance, you’d have to generate an altered image for each one. When you’re producing watermarks for a large number of instances that would mean generating a huge number of copies of what started off as a single image. In most workflows and for most products that’s not a commercially viable approach.
2. Artwork masking layer The second method for adding a digital watermark is to overlay an “artwork masking layer” that encodes the desired data. This is a pattern of graphics across large areas of the design, making sure that those graphics are sufficiently fine that they are not immediately apparent to a viewer. In practice this usually means something that looks like a sprinkling of very fine dots under a magnifying glass or loupe.
A digital watermark as an artwork masking layer over a plain yellow area of a job.
These overlays are also very difficult for a forger to reproduce. They have the advantage over hiding data in images that they can also be used in efficient workflows to carry unique data for each product instance; there is much less data to handle for every copy.
White paper: Optimizing digital watermarking in print workflows
About the author
Martin Bailey, former distinguished technologist at Global Graphics Software, is currently the primary UK expert to the ISO committees maintaining and developing PDF and PDF/VT. He is the author of Full Speed Ahead: how to make variable data PDF files that won’t slow your digital press, a guide offering advice to anyone with a stake in variable data printing including graphic designers, print buyers, composition developers and users.
Are you confident that all your print jobs can be printed at full press speed? How do you know at what speed the press can be run for a given combination of print job – RIP / RIP – PC etc.
In his presentation at the recent FuturePrint Tech Digital Print for Manufacturing, David Stevenson explains how, using Streamline™ and the help of machine learning, we can analyze a PDF file and intelligently estimate how long it will take for that file to run through the press. But it doesn’t stop there: David explains how we can then optimize the file to ensure it will fly through the press without compromising quality or color integrity.
Two new guides, one for designers and one for developers, to ensure best practice in creating PDF files for variable data printing are available now from the PDF Association.
When talking with digital press vendors it soon becomes apparent that the only thing more important than speed is quality; the only thing more important than quality is cost; and the only thing more important than cost is speed. I think I’d have to ask M C Escher for an illustration of that!
To focus on speed, what a press vendor usually means when talking to Global Graphics Software is “I need the Digital Front End (DFE) for my press to be able to print every job at full engine speed”, which is a subject that we’re very happy to talk about and to demonstrate solutions for, even as the press engines themselves get faster with every new version.
But the components such as the RIP in a DFE are not the only things that can affect whether a press can be driven at full engine speed. There are plenty of things that a designer or composition engine can do that can vary how fast a PDF file can be RIPped by several orders of magnitude, without affecting the visual appearance of the print.
Obviously we like it when the files are efficiently built, but sometimes it’s not obvious to a designer, or a software developer working on either a design application or composition engine how they might be able to improve the files that they generate. That’s why we created a guide called “Do PDF/VT Right” back in 2014, stuffed full of actionable recommendations for both designers and developers making PDF files for variable data printing.
It’s been very well received, and clearly filled a gap in materials available for the target audience; there have been thousands of downloads and printed copies given away at trade shows.
At the end of 2020 a new PDF/VT standard, PDF/VT-3, was published, and the committee in ISO that had developed it asked the PDF Association to write application notes for it, to assist developers implementing it with more extensive detail than can be included in International Standards. That sounds very formal, but in practice the two committees have many members in common (as an example I was project editor on PDF/VT-3 and I co-chair the PDF Association’s PDF/VT Technical Working Group (TWG)). The hand-over was mainly to enable much more agile and responsive document development and more flexibility around publication.
After some debate the PDF/VT TWG decided that what the industry really needed was a best-practice guide in how to construct efficient PDF files for VDP, whether they’re PDF/VT or ‘just’ “optimized PDF”. Any developer who has worked with PDF/VT-1 should have no trouble in implementing VT-3, but there are still some issues with slow processing of very inefficient PDF files preventing print service providers, converters etc from running their digital presses at full engine speed.
The next step was to agree to do the development of that guide in a new form of committee within the PDF Association, specifically so that people who were not members of the Association could be involved.
At this stage Global Graphics offered the text of Full Speed Ahead as a starting point for the Association guide, an offer that was very quickly accepted. But it was felt that it could be made more accessible if two editions of the guide were produced: one for designers and one for developers, rather than combining the two into a single document. Amongst other things it means that each guide can use the most appropriate terminology for each audience, which always makes reading easier.
We were lucky to have Pat McGrew working with us and she took over as champion for the designer edition, while I led on the developer one.
And so I’m very happy to announce that both the Developer and Designer editions of the PDF Association’s “Best Practice in creating PDF files for Variable Data Printing” have just been published and are available with a lot of other useful resources at https://www.pdfa.org/resources/.
Martin Bailey, former distinguished technologist at Global Graphics Software, is currently the primary UK expert to the ISO committees maintaining and developing PDF and PDF/VT and is the author of Full Speed Ahead: how to make variable data PDF files that won’t slow your digital press, a guide offering advice to anyone with a stake in variable data printing including graphic designers, print buyers, composition developers and users.
Mass-personalized or -customized products at near mass-production prices is a huge potential area for growth for digital print. Only with digital can you print in real time onto anything and everything, such as 3D objects, clothing, flooring, tiles and wallcoverings, to give a unique customized product.
In this post, Martin Bailey, former CTO and now consultant at Global Graphics Software, explores the rise of the use of variable data and how digital inkjet is the key to unlocking the Holy Grail for many retailers: mass customization at near mass-production prices.
It’s common to think of variable data printing, where at least some of every instance is different from every other instance, as being the preserve of transactional and direct mail printing. Admittedly, that’s where much of it started, but in the broadest sense of the term, variable data printing is now used far more widely, across multiple industries. In situations where the delivery of the product is through a push model (where there is no direct connection between each item produced and a specific recipient at the time of production) several cases are common. Most of these cases are in B2B environments, where the buyer then sells or delivers the result, often B2C.
In mainstream commercial print, labels, packaging and industrial manufacturing, it’s difficult to imagine an alternative to the push model, even given the huge amount of metadata that some companies, such as luxury goods brands and supermarkets, are collecting on their customers.
But there are many situations where there’s a much closer relationship between an end user of the product and the organization that printed or manufactured it, which can be described as a pull model instead. Many of these cases move beyond the traditional idea of variable data as being text and barcodes imaged on top of a static background to each piece being truly unique. They deserve to be described as mass customization, and all of them have been enabled by web-to-print or other forms of online ordering.
The wide format market has long provided display and soft signage, sportswear, tee shirts and car wraps to custom designs on very short runs, down to a single copy. Both signage and sportswear are aimed at both B2B and B2C markets.
Photofinishing has long been a B2C business and has used digital printing for decades. The industry has learned that simply producing 5” x 7” prints does not generate significant profits, but has grown first into photobooks, and then into many other forms of product decoration, printing photographs on hats, shoes, apparel, bed linen, mugs etc and converging with what have historically been wide format opportunities. Each individual order, perhaps for one mug with a photo printed on it, may not appear to be variable data printing. But when orders are aggregated at the producer there may be hundreds or thousands of mugs to be printed per day, each with a different image.
Photobooks offer higher margins than simple print finishing.
The same business model is applied more broadly to print designs which may be uploaded by the customer and/or created in a web portal by combining the customer’s text and graphics from a library. Examples include phone cases, tee shirts, postcards and greetings cards.
And a number of providers effectively act as publishers for customer designs, managing printing and fulfilment for a variety of products or lengths of custom-printed textile. Examples include Red Bubble and Spoonflower.
Several brands have run campaigns whereby products can be ordered with a name on them, usually for gifting. Examples include “My Nutella” and “My Marmite”. A variant of this is where only a label is purchased, often for bottles of spirits, to be applied to the product by the purchaser themselves.
The most famous campaign for ‘personalized’ labels was Coca-Cola’s “Share a Coke”, but in practice most labels were printed in long runs, randomizing the most common names in each country; only labels from roadshows and purchases from the web were actually printed on demand for specific recipients. This makes it an excellent example of a hybrid model taking advantage of the benefits of multiple print technologies.
Personalized product for gifting can attract a significant premium.1
Even in industries producing a design that would historically have been created in multiple mile or kilometer lengths, such as wallcoverings, there are opportunities for increased margins in custom delivery. As an example, consider a decorating company that has been contracted to apply wallcoverings to a large office. If a wallcovering vendor could deliver pre-cut drops of the wallcovering, each of exactly the right length, and with the pattern starting in exactly the right place so that each drop aligns with those on either side, that would save the decorating company a lot of time. And that, in turn, would allow the vendor to charge a sufficient premium to more than cover the reduced total length required because there is no longer any wastage from the decorators cutting each drop to ensure alignment.
A lot of the demand for this mass customization is ascribed to the changing attitudes and communication preferences of millennials and Gen-Z. To generalize, it’s often said that such audiences demand to be treated, and be able to represent themselves as unique, requiring them to be able to obtain unique product in support of that position.
But the demand is not specific to any age group, according to “The Deloitte Consumer Review – Made-to-order: The rise of mass personalization”, based on survey results from YouGov, which also went on to say: “1 in 5 consumers who expressed an interest in personalized products or services are willing to pay a 20% premium”; that figure rises to around 1 in 2 for customized clothing, furniture, homeware and DIY.
Demand for customized product is not restricted to any particular age group.
Of course, personalized and customized products are not warehoused at all; they’ve been created for a specific recipient and will usually be shipped immediately.
Inkjet can achieve unique results
Taking short runs to the extreme, a significant advantage for inkjet that applies across the majority of industries is that it does not need to simply reproduce the same invariant design repeatedly, even for a short run; instead, it can make every item different.
Inkjet can achieve unique results in a variety of different industries and being unique in a useful way is a very effective lever for premium pricing and increased profitability.
This month WhatTheyThink’s third Technology Outlook takes place. It’s a series of webinars and interviews that highlight new innovations from industry analysts and thought leaders.
As part of the Thought Leadership Video series, David Zwang of WhatTheyThink chatted to Mako™ product manager David Stevenson, about how, by using our vast experience in RIPs and rendering, we’ve created a high-performance framework for print inspection systems.
David introduces Smart QI™, a quality inspection system available with SmartDFE™. Designed especially for print, SmartQI is a camera-based, real-time quality inspection system, offering the same real-time streaming of rasters. It is especially useful as the use of variable data increases, and press speeds and resolutions continue to grow, making it essential to inspect the print for defects before it comes off the press and goes into finishing and converting.
Project manager Jason Hook shows how we’ve implemented OPC UA into our solutions in this film: How to transform your inkjet business with Industry 4.0 and OPC UA. Jason demonstrates how we track performance metrics like pressure levels across an entire production line using our PC and Ink Delivery System, all while uploading it securely onto cloud servers using AWS IoT SiteWise and Azure IoT.
Join us at the Industrial Print Integration conference
It’s my first time at the Industrial Print Integration Conference; I’ve packed my suitcase and my passport is raring to go, glad to be out of the drawer after two years of hibernation. I’m looking forward to meeting new people in the industry and learning about the new developments in technology.
If you’re interested in integrating print into your smart factory, join me for my talk at 12.30pm on Wednesday, 18 May 2022. I’ll be explaining how you integrate inkjet into the Smart Factory with the help of fully automated software that connects to the rest of the production system via Industry 4.0 technologies like OPC UA, the open standard for exchanging information for industrial communication. I’ll also explain how you can build in capability so you can deliver everything from mass production to mass customization at the same cost as current print systems.
And if you want to know more, then come along to our booth A7. We’re going to be showing a demo of our SmartDFE™, which I think is pretty impressive. You can watch a snippet here:
SmartDFE is our smart software that drives an inkjet printing subsystem in a factory setting, including those printers used for ultra-high speeds and 300m per minute production rates! The demo shows what happens when you combine high-tech SCADA systems (Supervisory Control and Data Acquisition) with OPC UA to monitor and control virtual print subsystems via iPads. You can control them both inside and outside of your plant location so management always knows what’s happening without ever having be physically present.
Ian Bolton, Product Manager – SmartDFE™ and Direct™
Ian Bolton is the product manager for SmartDFE™ and Direct™. He works with printer OEMs to break down barriers that might be preventing them from reaching their digital printer’s full potential. A software engineer at heart, Ian has a masters in Advanced Computer Science from the University of Manchester, and over 15 years’ experience developing software for both start-ups and large corporations, such as Arm and Sony Ericsson. He draws on this technical background and his passion for problem-solving to define and drive features and requirements for innovative software solutions for digital print.
Be the first to receive our blog posts, news updates and product news. Why not subscribe to our monthly newsletter? Subscribe here
I’ve spoken to a lot of people about variable data printing and about what that means when a vendor builds a press or printing unit that must be able to handle variable data jobs at high speed. Over the years I’ve mentally defined several categories that such people fall into, based on the first question they ask:
“Variable data; what’s that?”
“Why should I care about variable data, nobody uses that in my industry?”
“I’ve heard of variable data and I think I need it, but what does that actually mean?”
“How do I turn on variable data optimization in Harlequin?”
And yes, unless you’re in a very specialised industry, people probably are using variable data. As an example, five years ago pundits in the label printing industry were saying that nobody was using variable data on those. Now it’s a rapidly growing area as brands realize how useful it can be and as the convergence of coding and marking with primary consumer graphics continues. If you’re a vendor designing and building a digital press your users will expect you to support variable data when you bring it to market; don’t get stuck with a DFE (digital front end) that can’t drive your shiny new press at engine speed when they try to print a variable job.
If you’re in category 3 then you’re in luck, we’ve just published a video to explain how variable data jobs are typically put together, and then how the DFE for a digital press deconstructs the pages again in order to optimize processing speed. It also talks about why that’s so important, especially as presses get faster every year. Watch it here:
And if you’re in category 4, drop us a line at info@globalgraphics.com, or, if you’re already a Harlequin OEM partner, our support team are ready and waiting for your questions.
Martin Bailey, distinguished technologist at Global Graphics Software, chats to Marcus Timson of FuturePrint in this episode of the FuturePrint podcast. They discuss Martin’s role in making standards work better for print so businesses can compete on the attributes that matter, and software’s role in solving complex problems and reducing manual touchpoints in workflows.
They also discuss the evolution of software in line with hardware developments over the last few years, managing the increasing amounts of data needed to meet the demands of today’s print quality, the role of Global Graphics Software in key market segments and more.
Listen in here:
To be the first to receive our blog posts, news updates and product news why not subscribe to our monthly newsletter? Subscribe here
